Eye-Tracking Display Layout for Foveated AR/VR Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable devices such as HMDs and AR glasses suffer from screen quality deterioration due to eye tracking processes, and accurate eye movement tracking is difficult to achieve with existing technologies.
Innovation Solution
A display device with a transparent layer, light source, display panel, and reflective member, utilizing near-infrared light for eye tracking, and a processor that employs a learning algorithm to enhance eye tracking accuracy by determining spatial coordinates of the pupil center and adjusting resolution based on the user's gaze direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If sensor pixels are used to track eye movement, then eye tracking function is enabled, but screen quality deteriorates due to sensor pixels sensing reflected light
Solution Approach 1:
The display panel is segmented into two distinct types of pixels: normal pixels for display and sensor pixels for eye tracking. This segmentation allows each pixel type to perform its dedicated function without interfering with the other, resolving the conflict between enabling eye tracking and maintaining screen quality
Solution Approach 2:
The eye tracking sensing function is extracted from the display function by using separate sensor pixels that only sense reflected light and do not emit display light. This extraction eliminates the interference between display and sensing operations, preventing screen quality deterioration while maintaining eye tracking capability
2Measurement precision
If resolution is increased to 2000 PPI for accurate eye tracking, then eye tracking accuracy improves, but device complexity and manufacturing difficulty increase
Solution Approach 1:
Different regions of the display panel have different qualities: the central vision area uses high-resolution normal pixels for display, while the peripheral area uses sensor pixels for eye tracking. This local differentiation optimizes performance for each function without requiring the entire screen to operate at maximum resolution, reducing overall device complexity
Solution Approach 2:
The display dynamically adjusts which pixels are active based on the user's gaze direction. When tracking the pupil center, sensor pixels in the gaze direction are activated for high-precision measurement, while other areas use normal display pixels. This dynamic activation reduces the effective complexity at any given moment while maintaining 2000 PPI accuracy when needed
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Prevents screen quality deterioration and provides high-quality AR and VR experiences with increased eye tracking accuracy by dynamically adjusting resolution in central and peripheral vision areas.
Implementation Method 1
The light source emits near-infrared light
Implementation Method 2
The reflective member reflects display light emitted from the display panel toward the transparent layer
Implementation Method 3
sensor pixels including photodiodes... receiving the near-infrared light reflected by an eye of a user through the sensor pixels
Data Source
AI summary
A display device include a lens, a light source, a display panel including normal pixels and sensor pixels numbering less than the normal pixels to display an image, a reflective member reflecting display light emitted from the display panel toward the lens, and a processor. The processor controls the light source to emit near-infrared light, receive the near-infrared light reflected by a user's eye, converts information input to the sensor pixels into image data, generates eye feature models similar to the image data using a learning algorithm, determines an eye feature model most similar to an eye area of the image data among the generated eye feature models, tracks movement of a pupil center based on the determined eye feature model, and displays the image in high-resolution in a central vision area and the image in low-resolution in a peripheral vision area, using spatial coordinates of the tracked pupil center.