Extended Reality Eye-Motion Control for Object Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
XR systems face challenges in detecting user gaze and field of view accurately, particularly when multiple objects are present, and current interaction methods like hand gestures or joysticks are cumbersome, limiting user experience and information access.
Innovation Solution
The system detects eyelid motion to regenerate objects with modified detail, performs actions based on eyelid motion identifiers, and uses gaze shift indicators and voice commands to enhance interaction in extended reality environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If hand gestures or joysticks are used for navigation, then interaction control is achieved, but user convenience and immersion are reduced
Solution Approach 1:
The patent replaces mechanical interaction devices (hand gestures, joysticks) with an optical/biological detection system that monitors eyelid motion and gaze direction. This substitution eliminates the need for external control devices, allowing users to interact naturally through their own physiological movements, thereby improving ease of operation and maintaining immersion.
2Measurement precision
If pupil monitoring is used to determine gaze, then field of view detection is attempted, but reliability is reduced due to lack of user control
Solution Approach 1:
The patent shifts from monitoring pupil diameter (which users cannot control) to monitoring eyelid motion parameters. By detecting changes in eyelid position and motion patterns, the system achieves reliable gaze indication that users can intentionally control, thereby improving both measurement precision and reliability of field of view detection.
3Adaptability or versatility
If multiple objects are present in field of view, then environment richness is improved, but object identification difficulty increases
Solution Approach 1:
The patent introduces eyelid motion as an intermediary control mechanism that bridges the user's intent and the selection of objects in the field of view. By detecting specific eyelid motion patterns (such as prolonged closure or specific movement sequences), the system determines which object the user intends to interact with, thereby resolving the ambiguity that arises when multiple objects are present.
4Measurement precision
If detailed rendering of distant objects is provided, then viewing clarity is improved, but system resource consumption increases
Solution Approach 1:
The patent applies local quality by rendering distant objects with high detail only when the system detects that they are within the user's field of view through eyelid motion analysis. When objects are not the focus of attention, they are rendered at lower detail levels. This dynamic adjustment of rendering quality based on detected gaze direction optimizes the balance between viewing clarity and system resource consumption.
Data Source
AI summary
Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and an eye motion is detected. Based on the detecting, it is determined whether the object is in a field of view for at least a predetermined period of time, and in response to determining that the object is in the field of view for at least the predetermined period of time, one or more items related to the object are generated for display in the extended virtual reality environment.