Gaze-Based Image Rendering for VR Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-resolution image display in virtual reality is hindered by bandwidth limitations, causing tearing effects due to the large volume of image data that cannot be effectively transmitted from the graphic processing unit (GPU) to the display panel at high scanning rates.
Innovation Solution
A method that processes image data by determining a high-definition region centered on the viewer's gaze point, rendering a first subset of data for this region and a second subset of data for the peripheral area at a reduced resolution, and transmitting both subsets to the display panel, thereby reducing the overall data bandwidth required.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If high-resolution image data is transmitted from GPU to display panel, then image quality is improved, but transmission bandwidth requirement increases causing tearing effect
Solution Approach 1:
The patent divides the display panel into multiple regions based on viewer gaze position, with a central high-definition region and peripheral low-definition regions. This spatial segmentation allows different resolution levels to be transmitted simultaneously, reducing overall bandwidth while maintaining high quality where needed.
Solution Approach 2:
The patent applies different image quality levels to different spatial locations: high resolution (first resolution) is applied to the central region corresponding to viewer gaze, while lower resolution (second resolution) is applied to peripheral regions. This local quality differentiation reduces total data volume while preserving critical image quality.
2Manufacturing precision
If full-resolution image data is transmitted, then display quality is maintained, but transmission time increases reducing scanning rate
Solution Approach 1:
By segmenting the image data into high-definition central region data and low-definition peripheral region data, the patent enables parallel transmission and processing, reducing total transmission time and allowing higher scanning rates while maintaining perceived display quality.
Solution Approach 2:
The patent transmits only the necessary high-resolution data for the central viewing region rather than full-resolution data for the entire panel. This partial action approach reduces transmission time and increases scanning rate while maintaining adequate display quality for the most important viewing area.
3Quantity of substance
If gaze-tracking based region determination is implemented, then bandwidth efficiency is improved, but system complexity increases
Solution Approach 1:
The patent incorporates gaze tracking feedback to dynamically determine the central high-definition region and adjust the rendering and transmission strategy accordingly. This feedback mechanism enables adaptive bandwidth usage while managing complexity through automated gaze-based region identification.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A method for processing image data with reduced transmission bandwidth is provided. The method includes receiving a first set of data for image in a first resolution and receiving a center coordinate. The method further includes determining a high-definition region including an area and a boundary centered on the center coordinate. Additionally, the method includes rendering the first set of data based on the center coordinate and the area of the high-definition region to obtain a first subset of data. Furthermore, the method includes rendering a set of data compressed from the first set of data to obtain a second subset of data beyond the boundary. Moreover, the method includes transmitting a second set of image data to the display panel combining the first subset of data for display image in the first resolution and the second subset of data to display image in the second resolution.