XR Headset Eye-Reflection Input Detection for Controller-Free Scrolling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
XR headsets lacking handheld controllers face challenges in providing user input due to resource constraints, especially in 'lite' systems that cannot perform significant image processing to identify hand movements, complicating tasks like content scrolling.
Innovation Solution
The XR headset captures reflections of illumination from a user's eye to detect movement, determining direction and magnitude of headset pose changes relative to the eye, allowing input detection without physical sensors, suitable for resource-constrained devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If handheld controllers are used for user input, then input functionality is provided, but device complexity and resource consumption increase
Solution Approach 1:
The patent extracts the input detection functionality from external handheld controllers and relocates it to the XR headset itself by utilizing the existing eye tracking imaging sensors. This eliminates the need for additional controllers while maintaining input capability, directly resolving the contradiction between input functionality and device complexity
Solution Approach 2:
The patent makes the eye tracking imaging sensors serve multiple functions: their original purpose for eye tracking and a new function for detecting headset movement and gesture input. This multi-functionality provides comprehensive input capability without adding dedicated hardware, resolving the contradiction between input functionality and resource consumption
2Measurement precision
If significant image processing is performed to identify hand movements, then input detection accuracy improves, but processing resource consumption increases
Solution Approach 1:
The patent uses the existing eye reflection patterns as a proxy or copy of headset movement information. Instead of performing complex image processing to infer movement from hand gestures, the system captures reflection position changes that directly correspond to headset pose changes, achieving accurate movement detection with minimal processing
Solution Approach 2:
The patent replaces complex mechanical/image processing-based gesture recognition with an optical measurement approach. By measuring reflection position changes in the imaging sensor data, the system directly obtains movement information without requiring significant image processing, resolving the contradiction between detection accuracy and processing resource consumption
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method enables efficient user input detection using less processing resources, suitable for various XR headsets, including 'lite' models, by analyzing eye reflections to determine scrolling directions and speeds.
Implementation Method 1
capturing reflections of illumination from an eye of a user wearing an XR headset
Data Source
AI summary
A method includes capturing reflections of illumination from an eye of a user wearing an extended reality (XR) headset. The method also includes detecting movement of the XR headset based on changes in positions of the reflections of the illumination from the user's eye, where the movement changes a pose of the XR headset relative to the user's eye. The method further includes determining a direction based on the detected movement and causing content presented on at least one display of the XR headset to change based on the determined direction.