Variable Resolution Graphics Processing for VR Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current graphics processing technologies face inefficiencies when performing variable resolution rendering, particularly in reducing the rendering burden on graphics processing units (GPUs) while maintaining visual acceptability, especially in applications like virtual reality displays with severe pin-cushion distortion.
Innovation Solution
A method for operating a graphics processor that involves dividing the render output into regions, obtaining a desired resolution profile for each region, scaling graphics geometry accordingly, and selecting a subregion to render, allowing for efficient and flexible graphics processing by reducing the processing burden and accommodating different resolutions based on the region's requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the entire frame is rendered at the highest required resolution, then visual quality is improved, but the rendering burden on the GPU increases
Solution Approach 1:
The frame is divided into multiple regions (e.g., foveal region and peripheral regions) that are rendered at different resolutions. The foveal region corresponding to the user's fixation point is rendered at high resolution, while peripheral regions are rendered at lower resolutions, thereby reducing the overall rendering burden while maintaining visual quality in critical areas.
Solution Approach 2:
Different regions of the frame are assigned different quality levels based on their importance to the user's visual perception. The foveal region receives high-quality rendering with fine detail, while peripheral regions receive lower-quality rendering with coarser detail, matching the human visual system's varying sensitivity across the visual field.
2Productivity
If variable resolution rendering is implemented, then the rendering burden is reduced, but the complexity of the graphics processing increases
Solution Approach 1:
The rendering system dynamically adjusts the resolution of different frame regions based on real-time fixation point information from eye tracking or head tracking data. The graphics processor selectively applies different rendering resolutions to different regions, with the boundaries and resolution levels being dynamically determined based on user gaze behavior and scene importance.
3Productivity
If peripheral areas are rendered at lower resolution, then the rendering burden is reduced, but visual acceptability may deteriorate
Solution Approach 1:
The system uses feedback from eye tracking or head tracking systems to identify the user's fixation point and dynamically adjust which regions are rendered at high versus low resolution. This feedback loop ensures that the high-resolution foveal region always corresponds to where the user is actually looking, while peripheral regions are appropriately downsampled, maintaining visual acceptability based on real-time user behavior.
Data Source
AI summary
A graphics processor performs graphics processing in respect of a region of a render output. The graphics processing comprises obtaining a scaling factor corresponding to a desired resolution for the region. The graphics processing further comprises, in accordance with the desired resolution, obtaining scaled graphics geometry to be rendered for the region and selecting a subregion of the region to be rendered in respect of the region. The selected subregion is then rendered using the scaled graphics geometry, thereby providing a subregion of data elements rendered in accordance with the desired resolution. The graphics processor can provide efficient and flexible graphics processing when performing variable resolution rendering.