Gaze-Aware User Interface Activation for XR Input Disambiguation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems struggle to accurately interpret user input when the gaze location of a user is not aligned with the intended user interface element, leading to unintended interactions in extended reality environments.
Innovation Solution
A method that activates a user interface element at the gaze location if the input location is within a threshold distance of the gaze, and activates a different element if the input location is at least a threshold distance away, using a combination of eye trackers and input devices to differentiate intentional and unintentional interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the system activates a user interface element based on input location alone, then the system responds quickly to user input, but the accuracy of user input interpretation deteriorates when gaze location is not aligned with input location
Solution Approach 1:
The patent introduces gaze location as an intermediary parameter that mediates between input location and user intent determination. The system uses the relationship between gaze location and input location to disambiguate user intent, where gaze acts as a contextual mediator that helps distinguish intentional from unintentional interactions without significantly delaying the response
2Measurement precision
If the system requires precise alignment between gaze location and input location, then user input interpretation accuracy improves, but the ease of operation deteriorates due to stricter interaction requirements
Solution Approach 1:
The patent applies local quality by differentiating the threshold distance requirement based on the specific spatial relationship between gaze location and input location. Instead of requiring uniform precision across all interactions, the system uses a threshold distance that allows flexibility: when input location is within the threshold of gaze location, the system accepts the input as intentional, thereby maintaining ease of operation while still ensuring accuracy through contextual validation
Data Source
AI summary
In one implementation, a method of activating a user interface element is performed at a device including an input device, an eye tracker, a display, one or more processors, and non-transitory memory. The method includes displaying, on the display, a plurality of user interface elements and receiving, via the input device, a user input corresponding to an input location. The method includes determining, using the eye tracker, a gaze location. The method includes, in response to determining that the input location is at least a threshold distance from the gaze location, activating a first user interface element at the gaze location and, in response to determining that it is not, activating a second user interface element at the input location.