XR Display Foveated Rendering Bandwidth Reduction
Solution Overview
Problem
Current Extended Reality (XR) display apparatuses face increased bandwidth demands due to high pixel counts and frame rates, necessitating a reduction in display data transmission while maintaining image quality, particularly in foveated rendering where peripheral regions are rendered at lower resolutions than the fovea region.
Innovation Solution
The display apparatus divides the screen into two regions, one with high resolution (fovea region) and another with lower resolution (peripheral region), alternating frames between high and low resolution updates to reduce bandwidth requirements and circuit complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the number of pixels and frame rate are increased to improve image quality and rendering performance, then the display quality is improved, but the bandwidth for transmitting display data increases
Solution Approach 1:
The display screen is divided into multiple regions (first region and second region) with different resolution requirements. The first region (fovea) maintains high resolution while the second region (peripheral) uses lower resolution, segmenting the data transmission requirement to reduce overall bandwidth while preserving image quality where needed.
Solution Approach 2:
Different regions of the display are assigned different quality levels. The first region receives high-resolution data for detailed foveal rendering, while the second region receives low-resolution data for peripheral display, applying local quality optimization to balance image quality and bandwidth consumption.
2Quantity of substance
If low-resolution pixel data is thinned out to compress display data and reduce bandwidth, then the bandwidth is reduced, but the image processing load and circuit complexity increase
Solution Approach 1:
The display is segmented into multiple regions with different resolution requirements, allowing the system to transmit and process data differently for each region. This segmentation enables bandwidth reduction in peripheral regions while maintaining high resolution in the fovea, balancing circuit complexity with performance requirements.
Solution Approach 2:
The system dynamically switches between displaying the first region at high resolution and the second region at low resolution based on the current frame. This dynamic resolution adjustment allows the system to adapt bandwidth consumption and processing load to actual display needs, reducing overall circuit complexity compared to maintaining uniform high resolution.
3Productivity
If foveated rendering is implemented to reduce image processing load, then the processing load is reduced, but the visual perception quality in peripheral regions deteriorates
Solution Approach 1:
The system applies different quality levels to different regions: high resolution for the fovea where visual perception is most sensitive, and low resolution for peripheral regions where the human visual system is less sensitive. This local quality differentiation reduces overall processing load while maintaining acceptable visual perception quality in the critical foveal region.
Solution Approach 2:
The system changes the resolution parameter dynamically based on the display region. By adjusting the resolution parameter from high to low depending on whether the region is foveal or peripheral, the system optimizes the balance between image processing load and visual perception quality according to human visual characteristics.
Data Source
AI summary
An apparatus comprising a display in which a plurality of pixels are arranged in an array, and a generator configured to, in a first frame, generate first data corresponding to a first region of the display to display a first image in the first region of the display and, in a second frame, generate second data corresponding to a second region of the display, which includes the first region and is larger than the first region, to display a second image in the second region of the display is provided. A region of the second region is defined as a third region, a resolution of the first image and a resolution of at least the third region in the second image are different from each other.