Foveated Video Display System with Multi-Resolution Image Synthesis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video display systems that use foveated rendering require high data transmission rates to maintain high resolution and frame rates, especially for head-mounted displays, which can be bandwidth-intensive.
Innovation Solution
A video display system that generates and transmits multiple unsynthesized images with different resolutions, allowing the display device to synthesize them for display, reducing the overall data transmission required and enabling high-resolution region-of-interest rendering at a lower data rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the display device displays video at high resolution and high frame rate, then the video quality is improved, but the data transmission amount increases
Solution Approach 1:
The patent divides the display area into multiple regions with different resolutions. The region of interest (where the user is looking) is rendered at high resolution, while other regions are rendered at lower resolutions. This segmentation allows the system to maintain high video quality in critical areas while reducing the overall data transmission amount.
Solution Approach 2:
The patent applies different quality levels to different parts of the video content based on user gaze direction. The foveal region (center of gaze) receives high-resolution rendering, while peripheral regions receive lower-resolution rendering. This local quality approach ensures that computational resources are concentrated where the user actually looks, improving perceived video quality without proportionally increasing data transmission.
2Manufacturing precision
If the image processing device renders the entire image at high resolution, then the video quality is improved, but the processing load increases
Solution Approach 1:
The image processing device segments the rendering process by identifying the region of interest and rendering only that region at high resolution. Other regions are rendered at lower resolutions or not rendered at all. This segmentation dramatically reduces the processing load while maintaining high video quality in the important region of interest.
Solution Approach 2:
The patent applies partial action by rendering only the necessary portion of the image at high resolution (the region of interest) rather than rendering the entire image at high resolution. This partial rendering approach reduces computational requirements and processing load while still providing high-quality video where the user is actually looking.
3Speed
If the display device displays video at high frame rate, then the smoothness of video is improved, but the data transmission rate requirement increases
Solution Approach 1:
The patent segments the video data transmission by sending different resolution data for different regions of the display. This allows the system to transmit video at high frame rates because the total data amount is reduced through regional resolution differentiation, making high frame rate transmission feasible with available bandwidth.
Data Source
AI summary
A video display system that includes a display device and an image processing device. The display device is mounted on the head of a user for use. The image processing device generates a plurality of unsynthesized images having different resolutions that are to be used for display by the display device, and transmits the generated unsynthesized images to the display device. The display device receives the unsynthesized images transmitted from the image processing device, and displays a display image that is obtained by synthesizing the unsynthesized images.