Pan-Warping Sub-frames for High Frame Rate Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Portable displays face challenges in balancing power efficiency with display quality, often sacrificing brightness, resolution, or frame rate, which affects user experience, especially in applications like artificial reality where high-quality rendering is crucial.
Innovation Solution
The display operates by pulsing images at a high frame rate, up-sampling to 10 kHz to generate dozens of sub-frames, allowing for reduced brightness of light-emitting sources while maintaining perceived image sharpness and color fidelity, and adjusts sub-frames based on user head or eye movements to correct for misalignment and non-uniformities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If the display operates at a lower frame rate to reduce power consumption, then power efficiency is improved, but display quality and user experience deteriorate
Solution Approach 1:
The display divides each frame into multiple sub-frames (e.g., 10-20 sub-frames per frame) and displays them sequentially at a high sub-frame rate (e.g., 10 kHz). This segmentation allows the system to use lower brightness per sub-frame while maintaining perceived image quality through temporal integration by the human eye, thereby reducing power consumption while preserving display quality.
Solution Approach 2:
The display uses periodic pulsed illumination at high frequency to present multiple sub-frames in rapid succession. This periodic action exploits the persistence of vision effect, where the human eye integrates the rapidly displayed sub-frames into a single perceived image, enabling power-efficient operation without sacrificing perceived brightness or quality.
2Productivity
If the display uses higher brightness to maintain image quality, then display quality is improved, but power consumption increases
Solution Approach 1:
By segmenting each frame into multiple sub-frames displayed in rapid succession, the system can use lower brightness for each individual sub-frame while the cumulative effect over time provides sufficient perceived brightness. This reduces peak power consumption while maintaining image quality.
Solution Approach 2:
The display maintains continuous visual output by rapidly cycling through multiple sub-frames, ensuring that the light-emitting sources are active for a sufficient cumulative duration within each frame period. This continuity preserves perceived brightness and image quality while allowing lower instantaneous brightness levels, reducing power consumption.
3Productivity
If the display uses expensive high-precision components to eliminate visual artifacts, then image quality is improved, but device cost increases
Solution Approach 1:
The system changes the temporal parameters of display operation by increasing the sub-frame rate to very high frequencies (e.g., 10 kHz) and adjusting the duty cycle of light-emitting sources. This parameter change allows the use of lower-precision, lower-cost components while maintaining image quality through software-based correction techniques applied to each sub-frame.
Solution Approach 2:
The display dynamically adjusts the content and timing of individual sub-frames to compensate for potential visual artifacts. By warping and modifying sub-frames based on predicted eye movement and display characteristics, the system corrects image quality issues through dynamic processing rather than relying on expensive static hardware solutions.
4Productivity
If the display increases frame rate to eliminate visual artifacts from eye movement, then image quality is improved, but power consumption and device complexity increase
Solution Approach 1:
The display segments each frame into multiple sub-frames that can be independently processed and adjusted. This segmentation enables targeted corrections for eye movement artifacts in specific sub-frames without requiring complete re-rendering of entire frames, reducing computational complexity while maintaining image quality.
Solution Approach 2:
The system performs preliminary warping and modification of sub-frames based on predicted eye movement patterns before display. By pre-correcting potential artifacts in the sub-frame generation stage, the system eliminates visual issues without requiring complex real-time tracking and correction hardware, reducing device complexity.
Data Source
AI summary
In an embodiment, a method includes accessing a first rendered frame generated at a first frame rate. The method includes generating, based on the first rendered frame, one or more sub-frames at a second frame rate that is higher than the first frame rate. A first sub-frame of the one or more sub-frames is generated by determining a displacement measure associated with an anticipated movement of an optics component of a display system and applying, based on the displacement measure, one or more transformations to the first rendered frame to generate the first sub-frame. The first sub-frame is to be perceived by a user using the optics component of the display system. The method includes outputting the one or more sub-frames for display at the second frame rate. The one or more sub-frames are perceived by the user using the optics component of the display system.