Eye Motion Detection for Extended Reality Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current extended reality (XR) systems face challenges in detecting eye motion and determining user focus within the XR environment, leading to cumbersome interaction methods and limited information access, particularly for users with impaired vision.
Innovation Solution
The system detects eyelid motion and gaze shifts to regenerate objects with modified detail levels, perform actions based on eyelid motion identifiers, and provide opacity-based indicators for navigation, allowing users to interact with XR environments using eye movements and voice commands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If hand gestures or joystick are used to navigate XR environment, then user can interact with the environment, but the interaction becomes cumbersome and inconvenient
Solution Approach 1:
The patent replaces mechanical control systems (hand gestures, joysticks) with an optical-based eye tracking system. Sensors detect eye movements and pupil responses to determine user gaze and intent, eliminating the need for physical controllers and making interaction more natural and convenient.
Solution Approach 2:
The system uses the user's own physiological responses (eye movements, pupil dilation) as the control mechanism. The user's natural eye behavior serves as the input method, eliminating the need for external control devices and making the system more intuitive.
2Measurement precision
If pupil dilation and constriction are monitored to determine gaze, then field of view can be ascertained, but the method is unreliable since user cannot control pupil
Solution Approach 1:
The patent divides the eye tracking system into multiple independent measurement components: eyelid position detection, pupil center identification, and pupil diameter measurement. By combining these segmented measurements, the system achieves reliable gaze determination that overcomes the limitations of using any single metric alone.
Solution Approach 2:
The system introduces eyelid position as an intermediary measurement that correlates with pupil behavior. By monitoring the relationship between eyelid movement and pupil response, the system can distinguish between voluntary gaze shifts and involuntary pupil changes, improving reliability.
3Adaptability or versatility
If multiple objects are in user's field of view, then environment is rich and immersive, but it is difficult to determine which object user desires to interact with
Solution Approach 1:
The patent applies different levels of detail rendering to different objects in the field of view based on their distance from the user's gaze point. Objects closer to the center of gaze receive higher detail rendering, while peripheral objects use lower detail models, optimizing performance while maintaining immersion.
Solution Approach 2:
The system uses visual indicators (such as highlighting or color changes) to show which object is currently selected or being focused on. This provides clear feedback to the user about system state and facilitates intuitive object selection in complex environments.
Data Source
AI summary
Systems and methods are described for extended reality environment interaction. An extended reality environment including a first object is generated for display, and the first object is identified in a field of view based on received input from one or more sensors. An eyelid motion is detected based on the received input, and in response to detecting the eyelid motion, the first object is regenerated for display with a modified level of detail.