HMD Gaze Tracking Calibration for Contact Lens Shift Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current HMD devices with gaze tracking systems fail to accurately track user gaze due to excessive contact lens shift, resulting in inaccurate gaze tracking and performance degradation.
Innovation Solution
Implement a method to detect and compensate for excessive contact lens shift in a head-mounted display device that includes a gaze tracking system that implements a gaze tracking system that implements a contact lens shift detection system, capable of detecting when the user is wearing an excessively shifting contact lens and generating a notification or activating compensation mechanisms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If contact lens is worn for comfort and convenience, then ease of operation is improved, but gaze tracking accuracy deteriorates due to excessive lens shift
Solution Approach 1:
The system performs preliminary detection during the user enrollment process to identify contact lens wear and characterize lens shift patterns before actual gaze tracking begins. This advance detection allows the system to prepare compensation parameters in advance, ensuring both contact lens comfort and accurate gaze tracking during operation.
Solution Approach 2:
The system continuously monitors eye images during gaze tracking and compares the cornea center position with the eye center position to detect lens shift in real-time. This feedback mechanism allows dynamic adjustment of gaze tracking calculations to compensate for contact lens shift, maintaining accuracy while the user wears contacts for comfort.
2Adaptability or versatility
If gaze tracking system is implemented for enhanced functionality, then adaptability is improved, but reliability deteriorates when contact lens shift occurs
Solution Approach 1:
During the enrollment phase, the system performs preliminary analysis of eye images to detect contact lens presence and characterize shift patterns. This advance preparation creates a baseline model that accounts for individual user characteristics and lens properties, ensuring reliable gaze tracking from the start of actual operation.
Solution Approach 2:
The system implements continuous monitoring during gaze tracking by analyzing eye images and detecting cornea center shifts relative to the eye center. This real-time feedback enables dynamic compensation that maintains reliable gaze tracking even when contact lenses shift during use, preserving system adaptability while ensuring reliability.
3Device complexity
If standard eye center detection method is used for simplicity, then device complexity is reduced, but measurement precision deteriorates due to contact lens interference
Solution Approach 1:
The system segments the eye image analysis into two distinct center detection methods: one based on overall eye features (eyelids, iris, pupil) and another based specifically on cornea shape. By separating these detection tasks, the system can apply the appropriate method for each purpose without significantly increasing complexity, while improving accuracy by accounting for contact lens effects on cornea appearance.
Solution Approach 2:
The system introduces an intermediary analysis step that detects the cornea center position as a separate entity from the overall eye center. This intermediary measurement serves as an indicator of contact lens shift, allowing the system to compensate for lens effects without fundamentally changing the overall detection architecture, thus maintaining simplicity while improving precision.
Data Source
AI summary
Systems and methods are disclosed to enable detection of excessive contact lens shift in a head-mounted display (HMD) device that implement gaze tracking for the user. In embodiments, during a user enrollment process to calibrate the gaze tracking system, the HMD device analyzes key frames of the eye to estimate a first center location of the eye based on detected eye features such as the pupil, the iris, or the limbus, and a second center location of the eye based on the shape of the detected cornea. Shift vectors are generated based on the two center locations for individual key frames. If the standard deviation of the vectors' magnitudes exceeds a specified threshold, excessive lens shift is detected. In response to detection of excessive contact lens shift, the HMD device may generate a notification to the user or activate compensation mechanisms.