3D Interface Navigation Using Gaze-Based Variable Scrolling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for interacting with virtual and augmented reality environments are cumbersome, inefficient, and create a significant cognitive burden on users, often requiring multiple inputs and complex manipulations of virtual objects, leading to energy waste and user frustration.
Innovation Solution
The system employs gaze and hand movements in conjunction with input devices to navigate and interact with three-dimensional environments, allowing for efficient navigation and interaction through reduced and simplified user inputs, such as scrolling and gesturing, while decoupling virtual object positions from hand locations to enhance user interface efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional input methods (multiple inputs, complex manipulations) are used to interact with virtual reality environments, then interaction capability is achieved, but cognitive burden on users increases and efficiency decreases
Solution Approach 1:
The patent extracts and removes unnecessary intermediate input steps from the interaction flow. By allowing direct manipulation of virtual objects through natural hand gestures and eye tracking, the system eliminates redundant confirmation steps and complex multi-stage inputs, reducing cognitive burden while maintaining full interaction capability
Solution Approach 2:
The system employs eye tracking technology to automatically detect user gaze direction and intent without requiring explicit manual input. The virtual objects and interface elements actively respond to user attention, automatically navigating or highlighting items in the user's line of sight, thereby reducing the effort and cognitive load required for interaction
2Productivity
If multiple input steps are required to achieve desired outcomes in augmented reality environments, then precise control is achieved, but interaction time increases and energy consumption rises
Solution Approach 1:
The system performs preliminary actions by pre-positioning virtual objects and interface elements based on predicted user intent. Eye tracking data is continuously analyzed to anticipate user goals, and the interface proactively prepares relevant controls and information before explicitly requested, reducing the number of interaction steps required
Solution Approach 2:
The patent implements continuous eye tracking and gesture recognition that maintains constant awareness of user intent. Rather than requiring discrete, interrupted input sequences, the system continuously processes natural user movements and maintains seamless interaction flow, eliminating idle time between input actions and achieving faster task completion
3Ease of operation
If complex manipulations of virtual objects are required, then precise control is achieved, but user frustration increases and ease of operation decreases
Solution Approach 1:
The patent replaces complex mechanical-style virtual object manipulation (dragging, dropping, precise positioning gestures) with natural eye-based selection and intent recognition. Users simply look at desired virtual objects, and the system interprets gaze duration and direction to determine selection intent, eliminating the need for cumbersome manual manipulation while maintaining precise control capability
Solution Approach 2:
The system introduces eye tracking technology as an intermediary between user intent and virtual object manipulation. Rather than requiring direct hand-controller interaction with complex virtual elements, the eye tracker serves as a natural mediator that translates subtle gaze movements into precise digital commands, reducing user frustration while maintaining accuracy
4Adaptability or versatility
If extended interaction sequences are used in battery-operated devices, then comprehensive control is achieved, but energy consumption increases
Solution Approach 1:
The system employs partial action by using only the minimal necessary input modalities required for each specific task. Eye tracking handles selection and navigation tasks where full hand-controller manipulation would be excessive, consuming more energy for no additional benefit. The system dynamically selects the most energy-efficient input method based on task requirements while maintaining comprehensive control capability
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A computer system concurrently displays a first user interface object, including a first region displaying respective representations of one or more of a plurality of items in a set of items, and a second region corresponding to an index of the set of items. While displaying the user interface object, the computer system detects a first input of a first type. In response to detecting the first input of the first type and a user's gaze directed to the first region, the computer system performs a first navigation operation that navigates through the respective representations of the plurality of items by a first amount. In response to detecting the first input of the first type and a user's gaze directed to the second region, the computer system performs a second navigation operation that navigates through the respective representations of the plurality of items by a second amount greater than the first amount.