Gaze-Adaptive Display Resolution Enhancement via Light Steering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays (HMDs) suffer from pixelation-related artifacts due to insufficient pixel density and the presence of interstitial dark areas, leading to reduced image resolution and the 'screen door' effect, which are not adequately addressed by existing technologies.
Innovation Solution
A gaze-adaptive system that uses an eye-tracking device and a segmented resolution enhancing device (SRED) to dynamically shift and enhance the effective image resolution in the gaze direction, overcoming pixel density limitations and compensating for defective pixels by selectively updating pixel data and using light steering switches to create mutually offset images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the pixel density of the electronic display is increased to improve image resolution, then the native resolution of the display is improved, but the device complexity and manufacturing difficulty increase
Solution Approach 1:
The patent introduces an optical block with light steering switches as an intermediary between the electronic display and the user's eye. This mediator dynamically redirects light from display pixels to create mutually offset images, effectively doubling the perceived resolution without physically increasing the pixel density of the display itself.
Solution Approach 2:
The system employs dynamically controllable light steering switches that can change their light steering state in real-time based on gaze tracking data. This dynamic behavior allows the same physical display to adaptively provide different effective resolutions in different visual fields, resolving the contradiction between fixed pixel density and variable resolution requirements.
2Object-affected harmful factors
If the pixel density is increased to reduce the screen door effect, then the visual artifact is reduced, but the manufacturing precision and cost increase
Solution Approach 1:
The optical block creates copies of the displayed image by generating mutually offset images through light steering. These optical copies fill in the gaps between physical pixels, effectively eliminating the screen door effect without requiring higher physical pixel density or more precise manufacturing.
3Measurement precision
If gaze tracking and dynamic image shifting are implemented to enhance resolution, then the perceived image resolution is improved, but the device complexity and computational requirements increase
Solution Approach 1:
The system applies resolution enhancement selectively only in the user's gaze direction rather than uniformly across the entire display. The optical block contains multiple independently controllable light steering switches that are activated only for pixels within the user's foveal vision, reducing overall system complexity while maintaining high perceived resolution where needed.
Solution Approach 2:
The system incorporates gaze tracking that provides real-time feedback about the user's viewing direction. This feedback loop allows the control system to dynamically adjust which light steering switches are activated and how images are shifted, optimizing the resolution enhancement while minimizing unnecessary computational and hardware complexity.
4Stability of the object's composition
If the light steering switches operate at high speed to maintain image stability, then the image stability is improved, but the energy consumption increases
Solution Approach 1:
The light steering switches operate periodically at the display's refresh rate rather than continuously. By synchronizing the image shifting with the display refresh cycle and using temporal multiplexing to present multiple offset images sequentially, the system maintains stable perceived images while minimizing energy consumption through periodic rather than continuous operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system significantly improves perceived image resolution by effectively increasing pixel density in the gaze direction, reducing pixelation artifacts, and compensating for defective pixels, thereby enhancing the overall image quality and user experience.
Implementation Method 1
a light steering switch configured to switchably steer light from a corresponding area of the pixel array to form a locally offset image
Implementation Method 2
A first liquid crystal layer is disposed in the optical path of image light from the pixel array and is switchable between a first polarization state and a second polarization state in response to an applied voltage
Implementation Method 3
A second liquid crystal layer is disposed in the optical path of image light from the pixel array and is switchable between a first birefringent state and a second non-birefringent state in response to an applied voltage
Data Source
AI summary
A display apparatus includes a pixelated display, an eye tracking system, and a segmented resolution enhancing device coupled to the eye tracking system and operable to selectively enhance effective image resolution for the electronic display in the gaze direction. The segmented resolution enhancing device may include a polarization switch in series with a polarization gratings, at least one of which is segmented, for shifting image pixels in the gaze direction between offset positions while displaying a frame.