Variable Rate Shading for Occlusion-Aware Image Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing variable rate shading (VRS) solutions in graphics processing units (GPUs) are limited in identifying regions that can be shaded at a low rate, leading to suboptimal performance improvement and increased computing costs, especially with increasing screen resolution and refresh rates.
Innovation Solution
An image rendering method that identifies and distinguishes occlusion regions from non-occlusion regions within an image, applying different shading rates to each to optimize rendering performance without deteriorating image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If uniform high-rate shading is applied to the entire image, then image quality is maintained, but computing costs and power consumption increase significantly
Solution Approach 1:
The patent applies different shading rates to different regions of the image based on their importance. Important regions (non-occlusion regions) use high shading rates to maintain quality, while less important regions (occlusion regions) use low shading rates to reduce computing costs. This local differentiation resolves the contradiction between maintaining overall image quality and reducing total computing energy consumption.
Solution Approach 2:
The patent segments the image into occlusion regions and non-occlusion regions, applying different shading strategies to each segment. This segmentation allows the system to allocate computing resources efficiently, maintaining high quality where needed while reducing computation in less critical areas, thus resolving the energy-quality tradeoff.
2Productivity
If variable rate shading is applied to the entire image, then rendering performance improves, but image quality may deteriorate in important regions
Solution Approach 1:
The patent ensures that important regions (non-occlusion regions) maintain high shading rates to preserve image quality, while only applying low shading rates to less important occlusion regions. This selective application of variable rate shading improves overall rendering performance without sacrificing quality in critical areas.
Solution Approach 2:
By segmenting the image into occlusion and non-occlusion regions, the patent applies variable rate shading selectively. Non-occlusion regions use high shading rates to maintain quality, while occlusion regions use low shading rates to boost performance, thus resolving the contradiction between performance improvement and quality preservation.
3Device complexity
If simple region identification is used in VRS, then device complexity is reduced, but performance improvement is limited
Solution Approach 1:
The patent uses the existing depth buffer and occlusion query mechanisms that are already part of standard graphics rendering pipelines to identify occlusion regions. This self-service approach leverages existing system resources without adding significant complexity, while still achieving effective region identification for performance optimization.
Solution Approach 2:
The patent utilizes multi-functional existing graphics rendering components (depth buffer, occlusion queries) for the additional purpose of identifying VRS regions. This universal use of existing components avoids adding dedicated complex identification hardware, maintaining device simplicity while enabling effective performance improvement.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
An image rendering method based on variable rate shading and an electronic device are provided. The method includes: determining an occlusion region and a non-occlusion region in a to-be-displayed image of a first application (S310), where the occlusion region is an occluded region in the to-be-displayed image, and the non-occlusion region is a region that is not occluded in the to-be-displayed image; and rendering the to-be-displayed image based on variable rate shading, to generate a display image of the first application, where the occlusion region is rendered based on at least a first shading rate, the non-occlusion region is rendered based on at least a second shading rate, and the first shading rate is less than the second shading rate (S320). According to the method in embodiments of this application, the occlusion region of the application is identified and variable rate shading is performed, to reduce computing amounts for rendering without deteriorating user experience. This improves rendering performance and reduces display power consumption.