XR Assistant Avatar Attention State Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in accurately determining and presenting different attention states associated with voice commands in extended reality (XR) environments, particularly in conveying object-level attention states and substates to users.
Innovation Solution
The solution involves determining attention states and substates based on user inputs such as voice commands and actions, allowing for clear communication and adaptive suggestions, using a hybrid architecture that combines client-side and server-side processes to manage user interactions and render appropriate XR assistant avatar states.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the assistant system uses voice commands in XR environments, then user interaction capability is improved, but accurately determining and presenting attention states becomes difficult
Solution Approach 1:
The patent introduces an attention state indicator as an intermediary element that visually represents the assistant system's attention state. This indicator acts as a mediator between the voice command processing system and the user, making the abstract concept of 'attention state' observable and understandable through visual cues in the XR environment.
Solution Approach 2:
The patent employs color changes in the attention state indicator to convey different attention states. By changing colors or visual properties of the indicator based on the detected attention state, the system provides intuitive visual feedback to users about whether their voice commands are being processed, enhancing the difficulty of detecting attention states by providing clear visual signals.
2Loss of information
If the system presents detailed attention states, then communication clarity is improved, but system complexity increases
Solution Approach 1:
The patent segments the attention state information into distinct, manageable visual indicators. Instead of presenting a complex continuous state, the system divides attention states into discrete categories (e.g., listening, processing, paused) with corresponding visual representations. This segmentation maintains communication clarity while reducing system complexity.
Solution Approach 2:
The patent changes the parameter representation of attention states from complex internal system states to simple visual parameters. The attention state indicator uses manageable visual parameters (such as color, shape, or animation state) to represent different attention conditions, reducing the complexity of presenting detailed attention information while maintaining clear communication.
3Productivity
If the system adapts voice command suggestions based on attention states, then user engagement is improved, but processing requirements increase
Solution Approach 1:
The patent implements preliminary action by pre-defining a set of possible voice commands associated with different attention states. Instead of generating commands dynamically during processing, the system prepares suggestion sets in advance based on detected attention states, reducing real-time processing requirements while maintaining adaptive user engagement.
Solution Approach 2:
The patent applies partial action by providing a subset of voice command suggestions based on the current attention state rather than all possible commands. This selective approach reduces processing requirements by only generating relevant suggestions while still improving user engagement through context-aware command recommendations.
Data Source
AI summary
In one embodiment, a method includes rendering a first output image of an XR assistant avatar for displays of an extended reality (XR) display device, wherein the XR assistant avatar is interactable by a user to access an assistant system and has a first form indicating a first attention state, which indicates whether the XR assistant avatar is interactable via first voice commands for first functions enabled by the assistant system, detecting voice inputs from the user, determining a second attention state associated with the XR assistant avatar based on the voice inputs, and rendering a second output image of the XR assistant avatar for the displays of the XR display device, wherein the XR assistant avatar is morphed to have a second form indicating the second attention state, which indicates whether the XR assistant avatar is interactable via second voice commands for second functions enabled by the assistant system.