Eye-Tracked Foveated Rendering for GPU Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies face challenges in achieving high-definition display while managing limited GPU bandwidth and rendering capabilities, leading to increased processing pressure and costs.
Innovation Solution
An image processing method that determines a fixation region and a non-fixation region based on user pupil coordinates, rendering the fixation region at high resolution and the non-fixation region at low resolution, and stitching the images for display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the image is rendered at full resolution, then the display quality is improved, but the processing pressure of the GPU and bandwidth transmission increases
Solution Approach 1:
The display screen is divided into multiple pixel regions, and each pixel region is further divided into multiple sub-pixel regions. This segmentation allows different processing strategies to be applied to different regions, reducing the overall processing pressure while maintaining display quality in critical areas.
Solution Approach 2:
Different pixel regions are assigned different resolution levels based on their importance. The first pixel regions (where objects are located) are rendered at high resolution, while the second pixel regions (background areas) are rendered at low resolution. This local quality differentiation reduces GPU processing pressure and bandwidth usage while maintaining high-definition display quality in critical areas.
2Manufacturing precision
If the image is rendered at full resolution to meet user requirements for high-definition content, then the display effect is improved, but the frame rate decreases due to limited rendering capability
Solution Approach 1:
The patent applies different resolution levels to different pixel regions based on their importance. Critical areas (first pixel regions) are rendered at high resolution to maintain display effect, while less critical areas (second pixel regions) are rendered at low resolution to increase processing speed and achieve higher frame rates.
Solution Approach 2:
Instead of rendering the entire image at full resolution, the patent renders only the necessary portions (first pixel regions containing objects) at high resolution, while using low resolution for the remaining areas. This partial action approach maintains display quality where needed while improving overall frame rate.
3Manufacturing precision
If high resolution rendering is applied to the entire display, then the image quality is improved, but the bandwidth transmission capability is exceeded
Solution Approach 1:
The patent implements local quality differentiation by rendering first pixel regions at high resolution and second pixel regions at low resolution. This approach maintains high image quality in critical areas while significantly reducing the total data transmission volume and bandwidth usage.
Solution Approach 2:
The display is segmented into multiple pixel regions with different resolution requirements. By segmenting the rendering task, the patent reduces the total bandwidth required for transmission while maintaining high image quality in important regions.
Data Source
AI summary
An image processing method is applied to an electronic device having a display and includes: obtaining pupil coordinates of a user at a current moment; determining a fixation region and a non-fixation region corresponding to the display at the current moment according to the pupil coordinates; rendering an image corresponding to the fixation region according to a first resolution, and rendering an image corresponding to the non-fixation region according to a second resolution, the first resolution being greater than the second resolution; stitching an image corresponding to the fixation region after the rendering and an image corresponding to the non-fixation region after the rendering; and displaying a stitched image on the display.