Wearable Display Image Scaling with ROI Timing Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable display devices, such as XR glasses, face excessive power consumption and degraded performance due to the generation of foveated images, which require mixing images of different resolutions, leading to high graphics data throughput by the GPU.
Innovation Solution
A display device with a processor and timing controller that generates sync signals to control the transmission timing of region of interest (ROI) and background images separately, using a scaler to mix these images efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If foveated image is generated by mixing high-resolution gaze area image and low-resolution background area image, then image quality in region of interest is improved, but power consumption increases and graphics data throughput exceeds reference value
Solution Approach 1:
The display device divides the image into multiple regions including a first region (gaze area), second region (background area), and third region (transition area). Each region is processed and transmitted separately with appropriate resolution, allowing high quality where needed while reducing overall power consumption and data throughput requirements.
2Measurement precision
If foveated image is generated by mixing high-resolution gaze area image and low-resolution background area image, then image quality in region of interest is improved, but graphics data throughput greater than or equal to reference value is generated
Solution Approach 1:
The patent applies different quality levels to different regions of the display. The first region (gaze area) receives high-resolution data, the second region (background area) receives low-resolution data, and the third region (transition area) receives intermediate resolution data. This local quality differentiation maintains image quality where needed while reducing overall graphics data throughput.
3Measurement precision
If images of different resolutions are mixed to generate foveated image, then visual focus on region of interest is improved, but device performance is degraded
Solution Approach 1:
The display device segments the image into multiple regions with different resolution requirements and processes them separately. This segmentation allows the system to maintain high visual focus quality in the gaze area while avoiding the performance degradation associated with processing and mixing entire high-resolution images.
Solution Approach 2:
The patent generates sync signals in advance based on the input timing of background image data and ROI image data. This preliminary timing synchronization ensures that images of different resolutions can be transmitted and displayed without performance degradation, as the timing is prepared beforehand rather than computed in real-time during mixing.
Data Source
AI summary
A display device includes a memory, a timing controller including a scaler, and a processor, wherein the processor is configured to generate, via the scaler, a first sync signal based on an input timing of at least one piece of background image data, generate, via the scaler, a second sync signal based on an input timing of at least one piece of region of interest (ROI) image data, transmit, to the scaler, the at least one piece of background image data output from the memory during a first period according to the first sync signal, and transmit, to the scaler, the at least one piece of ROI image data output from the memory during a second period according to the second sync signal.