HMD Transparent Display Gaze Tracking and Color Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional head-mounted display devices have limited accuracy in determining gaze directions due to off-axis illumination and sensing, especially in augmented and mixed reality configurations, and fail to effectively address color deficiencies for users.
Innovation Solution
The head-mounted display device incorporates one or more lenses, transparent displays, a mirror, infrared light sources, and sensors to accurately determine gaze direction and provide color-corrected augmented reality content by reflecting infrared light and transmitting visible light, using organic light emitting diode displays and processors to align rendered images with real images based on the user's color profile.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If eye tracking sensors are located away from the optical axis due to limited space, then the device can be configured for augmented reality operations, but the accuracy in determining gaze directions deteriorates due to off-axis illumination and sensing
Solution Approach 1:
The patent positions the eye tracking sensor on the optical axis rather than off-axis, utilizing the vertical dimension (above or below the optical axis) to resolve the spatial conflict. This allows the sensor to be located at a position that enables on-axis illumination and sensing, thereby maintaining measurement precision while still accommodating the augmented reality configuration through careful spatial arrangement of other components.
2Adaptability or versatility
If the transparent display provides color-corrected images for color deficient users, then the user experience for color deficient users improves, but the device complexity increases due to additional processing requirements
Solution Approach 1:
The patent applies color correction selectively to regions of the displayed image that correspond to areas where the user's gaze is directed. Rather than processing the entire image for color correction, the system identifies specific regions containing colors that the user cannot distinguish and applies correction only to those regions. This localized approach maintains adaptability for color deficient users while significantly reducing the overall processing complexity compared to full-image processing.
Solution Approach 2:
The patent dynamically adjusts color parameters (hue, saturation, brightness) of specific regions in the displayed image based on the user's color deficiency type and gaze direction. By changing only the necessary color parameters in relevant regions rather than processing the entire image, the system achieves effective color correction while minimizing device complexity and processing overhead.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enhances gaze direction accuracy and provides effective color correction for users with color deficiencies, improving the overall augmented and virtual reality experience by accurately overlaying rendered images with real-world visuals.
Implementation Method 1
The one or more infrared light sources emit infrared light and the infrared light emitted by the one or more infrared light sources is reflected by the mirror toward the one or more transparent displays
Implementation Method 2
provide images, rendered based at least on the augmented reality contents and a color profile of the wearer for overlap with real images
Implementation Method 3
The one or more sensors detect infrared light reflected from the one or more eyes of the wearer for determining a gaze direction of the one or more eyes of the wearer
Implementation Method 4
one or more lenses, one or more transparent displays coupled with the one or more lenses for projecting light toward one or more eyes of the wearer through the one or more lenses
Data Source
AI summary
A head-mounted display device includes a transparent display for projecting light toward an eye so that images, rendered based at least on the augmented reality contents and a color profile of the wearer, for overlap with real images. The device also includes an infrared light source and a mirror configured to reflect the infrared light and transmit a portion of visible light corresponding to the real images. The device further includes a sensor configured to detect infrared light reflected from the eye for determining a gaze direction of the eye. The infrared light reflected from the eye is transmitted through the transparent display and reflected by the mirror toward the sensor.