Early Sub-Pixel Rendering for VR Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional VR and AR display systems require significant computing resources and bandwidth to render and transmit high-resolution imagery, especially in HMD devices, due to uniform pixel density across the display panel, which limits power efficiency and flexibility in distributing foveation processes and sub-pixel rendering.
Innovation Solution
Implementing a dual-path foveated graphics pipeline that logically segments the image into a foveal region and peripheral regions, allowing for distinct processing and transmission paths, and performing early sub-pixel rendering in the non-RGB pixel format to reduce computational load and bandwidth requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional full-resolution rendering is used, then image quality is maintained, but computing resources and power consumption increase significantly
Solution Approach 1:
The patent applies local quality by differentiating rendering resolution based on spatial location - the foveal region (center of gaze) is rendered at full resolution while peripheral regions are rendered at lower resolution. This resolves the contradiction by maintaining high image quality where the user actually looks while reducing computing resources in peripheral areas where lower visual acuity makes full resolution unnecessary.
Solution Approach 2:
The patent segments the display image into multiple regions (foveal region and peripheral regions) with different resolution requirements. By dividing the image into zones that can be processed differently, the system maintains overall image quality in critical areas while reducing computational load in less critical areas, thus balancing image quality with computing resource usage.
2Productivity
If conventional foveal rendering is implemented, then computational load is reduced, but bandwidth requirements and power consumption for data transmission remain high
Solution Approach 1:
The patent changes the pixel format parameter from conventional RGB to non-RGB formats (such as BGRG, GB RG, or other sub-pixel arrangements). This parameter change reduces the amount of data that needs to be transmitted - for example, a BGRG format can represent the same visual information with fewer bits per pixel compared to full RGB. This resolves the contradiction by maintaining computational efficiency while reducing bandwidth requirements through format optimization.
3Adaptability or versatility
If uniform pixel density across the entire display panel is used, then the display can provide images from any area, but computing resources and bandwidth requirements increase
Solution Approach 1:
The patent applies local quality by assigning different pixel densities to different regions of the display - the foveal region uses the full native pixel density of the display panel while peripheral regions use lower effective pixel density through downsampling or lower-resolution rendering. This resolves the contradiction by providing full display flexibility and image quality where needed (fovea) while reducing computing resources and bandwidth for peripheral areas where lower density suffices.
Data Source
AI summary
A display system includes a display device and a graphics processing unit (GPU) coupled via at least one physical layer. The display device includes a pixel array having a non-red-green-blue (non-RGB) pixel format. The GPU is configured to render an image in the non-RGB pixel format and provide the rendered image for transmission to the pixel array via the at least one physical layer.