Multimodal Virtual Assistant for Event Planning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current event planning technologies on mobile devices are limited in their ability to efficiently integrate voice and gesture inputs for planning activities and sharing plans with friends, requiring users to manually transfer data between applications.

Innovation Solution

A multimodal virtual assistant (MVA) that utilizes cloud-based multimodal language processing, combining speech and gesture inputs to enable users to plan events interactively on a mobile device, with features like incremental speech recognition, context-aware language understanding, and targeted clarification, allowing users to search and share plans through natural language and graphical interfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If users manually transfer data between voice search applications and social media applications for event planning, then data accuracy can be maintained, but user time and operational efficiency are significantly reduced

Engineering Contradiction:
Improveevent planning efficiencyVSAvoiddata transfer time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent combines voice search functionality and social media event planning into a single integrated application. The system merges data from multiple sources (voice inputs, calendar data, contact information, location data) into a unified event planning interface, eliminating the need for manual data transfer between separate applications while maintaining data accuracy through structured data integration.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The application performs multiple functions within a single system: voice-based information search, event creation, invitation management, location sharing, and real-time collaboration. This multi-functional approach allows users to complete entire event planning workflows without switching applications, significantly reducing time loss while maintaining comprehensive data accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If the system integrates multiple input modes (voice and gesture) for plan creation, then ease of operation is improved, but device complexity increases

Engineering Contradiction:
Improveinput convenienceVSAvoidsystem architecture
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system segments different input modes (voice recognition, gesture recognition, text input) into separate processing modules, each handling specific types of user interactions. This modular architecture manages complexity by organizing functions into discrete, manageable components while providing users with multiple convenient input options for creating and modifying event plans.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a natural language processing intermediary that translates diverse input modes (voice commands, gestures, text) into standardized event planning instructions. This mediator layer simplifies the user interface by accepting various input formats while maintaining a consistent internal processing structure, thereby improving ease of operation without proportionally increasing perceived device complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If the system provides real-time plan sharing and collaboration features, then user collaboration efficiency is improved, but information processing requirements and system complexity increase

Engineering Contradiction:
Improvecollaboration efficiencyVSAvoidsystem architecture
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-processing and structuring event data (participants, locations, timelines, budgets) into standardized formats before sharing. This preparation work is done in advance during plan creation, enabling efficient real-time collaboration without requiring complex processing during shared viewing and editing, thus improving collaboration efficiency while managing system complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements copying mechanisms where event plans, invitations, and collaboration data are replicated across multiple user devices in real-time. This copying approach enables simultaneous viewing and editing by multiple users without requiring complex synchronization protocols, thereby enhancing collaboration efficiency while keeping the information processing architecture relatively simple.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10739976B2System and method for creating and sharing plans through multimodal dialog
Publication Date: 2020.08.11 AT&T INTELLECTUAL PROPERTY I L P
  • US10739976B2 patent drawing
  • US10739976B2 patent drawing
  • US10739976B2 patent drawing

AI summary

Methods, systems, devices, and media for creating a plan through multimodal search inputs are provided. A first search request comprises a first input received via a first input mode and a second input received via a different second input mode. The second input identifies a geographic area. First search results are displayed based on the first search request and corresponding to the geographic area. Each of the first search results is associated with a geographic location. A selection of one of the first search results is received and added to a plan. A second search request is received after the selection, and second search results are displayed in response to the second search request. The second search results are based on the second search request and correspond to the geographic location of the selected one of the first search results.