Automated Assistant Selectable GUI Element for Intent Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users interacting with automated assistants often need to specify both intent and parameters for tasks, which can lead to increased input complexity and ambiguity, especially when controlling foreground applications, as they may be unaware of the assistant's capabilities and may misinterpret spoken utterances.
Innovation Solution
An automated assistant provides a selectable GUI element that identifies operations and solicits parameters, allowing users to provide input without explicitly stating the intent or invoking the assistant, thereby reducing input complexity and clarifying user intent.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the automated assistant requires users to specify both intent and parameters in spoken utterances, then the assistant can accurately understand user requests, but the input complexity and ambiguity increase
Solution Approach 1:
The patent introduces a selectable GUI element as an intermediary between the user and the automated assistant. This GUI element displays suggested operations and parameters, allowing users to select from pre-presented options rather than formulating complete intent statements. The GUI element mediates the interaction by providing structured choices that reduce the cognitive load on users while maintaining accurate intent communication to the assistant.
2Ease of operation
If users directly interact with the foreground application without knowing assistant capabilities, then users can perform tasks manually, but the interaction duration and input quantity increase
Solution Approach 1:
The patent implements preliminary action by pre-displaying suggested operations and parameters through the selectable GUI element before the user provides input. The system anticipates what operations the user might want to perform and presents them in advance, allowing users to simply confirm or modify rather than navigate through complex interfaces. This preliminary presentation of options significantly reduces the time and effort required for manual interaction.
3Loss of information
If the automated assistant provides selectable GUI elements with operation identifiers, then user intent is clarified, but the device interface complexity increases
Solution Approach 1:
The patent applies universality by designing the selectable GUI element to serve multiple functions simultaneously. It displays suggested operations, presents parameters for selection, and provides visual feedback about assistant capabilities all within a single interface component. This multi-functional design avoids the need for separate interface elements for each function, thereby clarifying user intent without proportionally increasing interface complexity.
Data Source
AI summary
Implementations set forth herein relate to an automated assistant that can provide a selectable action intent suggestion when a user is accessing a third party application that is controllable via the automated assistant. The action intent can be initialized by the user without explicitly invoking the automated assistant using, for example, an invocation phrase (e.g., “Assistant . . . ”). Rather, the user can initialize performance of the corresponding action by identifying one or more action parameters. In some implementations, the selectable suggestion can indicate that a microphone is active for the user to provide a spoken utterance that identifies a parameter(s). When the action intent is initialized in response to the spoken utterance from the user, the automated assistant can control the third party application according to the action intent and any identified parameter(s).