Gaze-Based UI Visual Feedback for Faster AR/VR Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, requiring multiple inputs and leading to errors, which wastes energy and prolongs operation times, especially in battery-operated devices.
Innovation Solution
Implementing computer systems with improved user interfaces that utilize gaze tracking, hand tracking, and touch-sensitive displays to reduce the number and complexity of user inputs, providing intuitive interactions through visual feedback and direct touch capabilities, and enabling efficient operation in three-dimensional environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional input methods are used in augmented reality environments, then users can interact with virtual objects, but the interaction becomes cumbersome and requires multiple inputs
Solution Approach 1:
The system displays a visual indication (e.g., ring or highlight) around the target virtual object that provides real-time feedback to the user about which object is currently selected. This feedback mechanism allows users to understand the system's response to their gaze and touch inputs, enabling more efficient interaction without requiring multiple confirmation steps.
Solution Approach 2:
The patent introduces an intermediary visual indication element that mediates between the user's touch input and the virtual object selection. This visual indicator acts as a buffer that shows the system has registered the user's intent, reducing the cognitive burden of tracking whether inputs have been properly received and processed.
2Productivity
If multiple inputs are required to achieve desired outcomes, then users can perform actions in augmented reality environments, but the process takes longer than necessary
Solution Approach 1:
The system performs preliminary selection of the virtual object based on the user's gaze direction and touch input toward the visual indication. The visual indication itself serves as a pre-selected target, so when the user touches the screen in its vicinity, the system has already prepared the selection state, reducing the time needed to complete the interaction sequence.
3Measurement precision
If complex manipulation of virtual objects is required, then users can achieve precise control, but the cognitive burden on users increases significantly
Solution Approach 1:
The visual indication is displayed locally around the specific virtual object that matches the user's gaze direction. This localized visual feedback provides precise information about which object is selected without requiring the user to process global interface state, reducing cognitive burden while maintaining precise control capability.
Data Source
AI summary
A gaze virtual object is displayed that is selectable based on attention directed to the gaze virtual object to perform an operation associated with a selectable virtual object. An indication of attention of a user is displayed. An enlarged view of a region of a user interface is displayed. A value of a slider element is adjusted based on attention of a user. A user interface element is moved at a respective rate based on attention of a user. Text is entered into a text entry field in response to speech inputs. A value for a value selection user interface object is updated based on attention of a user. Movement of a virtual object is facilitated based on direct touch interactions. A user input is facilitated for displaying a selection refinement user interface object. A visual indicator is displayed indicating progress toward selecting a virtual object when criteria are met.