Gaze-Based VR Interface Selection With Attention Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with virtual and augmented reality environments are cumbersome, inefficient, and place a significant cognitive burden on users, often requiring multiple inputs and providing insufficient feedback, leading to errors and energy wastage, particularly in battery-operated devices.
Innovation Solution
Implementing computer systems with improved user interfaces that utilize gaze tracking, hand tracking, and touch-sensitive displays to reduce the number and complexity of user inputs, enhance feedback, and enable direct interaction with virtual objects, including gaze-selectable virtual objects, enlarged views, and direct touch interactions in three-dimensional environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional user interfaces are used in virtual/augmented reality environments, then users can interact with virtual objects, but the interaction becomes cumbersome, inefficient, and error-prone requiring excessive inputs
Solution Approach 1:
The patent replaces traditional mechanical input devices (controllers, joysticks, touch screens) with a gaze-based selection system. Users simply look at virtual objects to select them, eliminating the need for complex hand movements, button presses, or touch interactions. This substitution of mechanical input mechanisms with oculomotor control dramatically reduces the number of inputs required while improving ease of operation.
Solution Approach 2:
The system automatically determines user intent through gaze tracking without requiring explicit selection commands. When a user looks at a virtual object, the system autonomously identifies it as the target for interaction, eliminating the need for users to manually confirm or repeatedly indicate their selection intent. This self-service approach reduces cognitive burden and input complexity.
2Productivity
If multiple input steps are required to achieve desired outcomes, then users can complete tasks, but the process takes longer than necessary and wastes energy
Solution Approach 1:
The system performs preliminary selection actions automatically through gaze tracking. When a user looks at a virtual object, the system pre-selects it as the target before any confirmation or execution command is needed. This preliminary action eliminates intermediate steps and directly transitions from viewing to interacting with the object, significantly reducing task completion time.
Solution Approach 2:
The gaze-based selection system maintains continuous tracking of user attention, allowing seamless transitions between viewing different virtual objects without breaking the interaction flow. Users can naturally shift their gaze between objects, and the system continuously updates selection states, eliminating the need to reset or re-initiate selection processes, thereby maintaining continuous productive action.
3Ease of operation
If traditional input methods are used, then users can control virtual objects, but manipulation becomes complex, tedious, and error-prone creating cognitive burden
Solution Approach 1:
The patent replaces error-prone mechanical input methods (hand coordination, button pressing, touch gestures) with gaze-based selection. Oculomotor control is more precise and less prone to error than manual manipulation, especially when interacting with small or distant virtual objects. This substitution eliminates coordination errors and misselections common in traditional interfaces.
Solution Approach 2:
The system provides immediate visual feedback by highlighting or emphasizing the virtual object currently in the user's gaze. This feedback mechanism confirms accurate target acquisition in real-time, allowing users to verify their selection intent before interaction executes, thereby eliminating errors caused by unintended selections or loss of spatial orientation.
Data Source
AI summary
A gaze virtual object is displayed that is selectable based on attention directed to the gaze virtual object to perform an operation associated with a selectable virtual object. An indication of attention of a user is displayed. An enlarged view of a region of a user interface is displayed. A value of a slider element is adjusted based on attention of a user. A user interface element is moved at a respective rate based on attention of a user. Text is entered into a text entry field in response to speech inputs. A value for a value selection user interface object is updated based on attention of a user. Movement of a virtual object is facilitated based on direct touch interactions. A user input is facilitated for displaying a selection refinement user interface object. A visual indicator is displayed indicating progress toward selecting a virtual object when criteria are met.