Gaze-Based Scrolling and Object Interaction for Low-Burden AR/VR UI
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with augmented and virtual reality environments are cumbersome, inefficient, and complex, leading to a significant cognitive burden on users and excessive energy consumption, particularly in battery-operated devices.
Innovation Solution
Implement gaze-based interaction methods in computer systems, including gaze-directed scrolling, animation of virtual objects based on attention duration, and transition between content items, to reduce the number and nature of user inputs, enhance user feedback, and optimize power usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional input methods (touch, keyboard, mouse) are used to interact with virtual objects, then users can control the system, but the interaction becomes cumbersome and creates significant cognitive burden
Solution Approach 1:
The patent replaces mechanical input methods (touch, keyboard, mouse) with eye-tracking technology. The system uses cameras and image processing to detect gaze direction and duration, substituting physical manipulation with natural eye movements. This eliminates the need for complex input sequences and reduces cognitive burden by automatically interpreting user intent from eye behavior.
Solution Approach 2:
The system performs automatic object selection and interaction initiation based on gaze detection. When users look at a virtual object for a predetermined duration, the system automatically selects and activates that object without requiring manual confirmation or input sequences. This self-service mechanism simplifies interaction while maintaining precision in object selection.
2Productivity
If multiple input steps are required to achieve desired outcomes, then system control is precise, but interaction time and energy consumption increase
Solution Approach 1:
The system continuously monitors eye gaze and pre-processes interaction data in advance. By detecting gaze direction and duration before the user completes the full interaction sequence, the system prepares and executes actions proactively, reducing the time required for actual interaction. This preliminary detection and processing eliminates unnecessary delays between user intent and system response.
Solution Approach 2:
The eye-tracking system operates continuously, maintaining constant monitoring of gaze behavior without requiring discrete input commands. This continuous detection enables seamless interaction flow where the system is always ready to respond to gaze changes, eliminating idle time between actions and optimizing overall interaction efficiency.
3Loss of information
If detailed feedback is provided for each input, then user understanding is improved, but information overload and cognitive burden increase
Solution Approach 1:
The system provides feedback through gaze tracking confirmation and visual response indicators that align with the user's line of sight. Feedback is delivered naturally through the display in the direction the user is looking, avoiding information overload by presenting relevant information only where and when the user needs it. This contextual feedback maintains user understanding without creating cognitive burden.
Data Source
AI summary
Some examples are directed to systems and methods for scrolling scrollable content in response to gaze-based inputs. Some examples are directed to systems and methods for scrolling scrollable content in response to gaze-based inputs and/or input provided by a respective input element. Some examples are directed to systems and methods for displaying virtual objects with an appearance that is based upon a duration of attention directed to the virtual objects. Some examples are directed to systems and methods for displaying animations of virtual objects. Some examples are directed to changing values of audio parameters based on attention of a user. Some examples are directed to changing gaze scrolling regions of content based on characteristics of the content.