Density Driven Variable Rate Shading for GPU Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current graphics processing systems face challenges in automatically selecting quality levels for variable rate shading that maximize work savings while minimizing perceivable image degradation, particularly in regions of high geometric complexity, where users are likely to focus.

Innovation Solution

The system configures a density map based on visibility information for primitives, mapping density data to different shading rates for various areas of a frame, allowing for optimized shading rates that balance visual fidelity and power/performance across different portions of the graphics processing pipeline.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If uniform high-quality shading is applied to the entire frame, then visual fidelity is maintained, but power consumption and processing workload increase

Engineering Contradiction:
Improvevisual fidelityVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies different shading rates to different spatial regions of the frame based on geometric complexity. High-shading-rate regions are applied to areas with high geometric complexity where visual fidelity is critical, while low-shading-rate regions are applied to areas with low geometric complexity where visual degradation is less noticeable. This local differentiation resolves the contradiction by maintaining visual fidelity only where necessary while reducing power consumption in other regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the frame into multiple regions based on geometric complexity analysis. By dividing the frame into high-complexity and low-complexity regions, the system can apply appropriate shading rates to each segment, avoiding uniform high-quality shading across the entire frame and thereby reducing overall power consumption while maintaining visual fidelity in critical areas.

Inventive Principle:
Principle #1Segmentation

2Use of energy by moving object

If variable rate shading with automatic quality selection is implemented, then power consumption is reduced, but visual quality may degrade in regions of high geometric complexity

Engineering Contradiction:
Improvepower consumptionVSAvoidvisual quality
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The system automatically detects regions of high geometric complexity and applies high shading rates specifically to those regions, while applying lower shading rates to regions with low geometric complexity. This ensures that visual quality is maintained in areas where users are likely to focus (high geometric complexity regions) while achieving power savings in areas where visual degradation is less perceptible.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements automatic quality level selection based on geometric complexity analysis. The system uses feedback from the geometric complexity assessment to dynamically adjust shading rates in different regions, ensuring that visual quality is automatically optimized without manual intervention. This feedback mechanism prevents excessive quality degradation while maximizing power savings.

Inventive Principle:
Principle #23Feedback

3Productivity

If shading rate is reduced to maximize work savings, then power consumption decreases, but image degradation becomes more noticeable

Engineering Contradiction:
Improvework savingsVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies high shading rates (maximizing work savings) to regions with low geometric complexity where image degradation is less noticeable, while applying lower shading rates (maintaining image quality) to regions with high geometric complexity. This local differentiation allows the system to maximize overall work savings while preventing noticeable image degradation in critical regions.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240037690A1Density driven variable rate shading
Publication Date: 2024.02.01 QUALCOMM INC
  • US20240037690A1 patent drawing
  • US20240037690A1 patent drawing
  • US20240037690A1 patent drawing

AI summary

Aspects presented herein relate to methods and devices for graphics processing including an apparatus, e.g., a GPU or a CPU. The apparatus may obtain visibility information for a set of primitives in at least one frame associated with the graphics processing, where the at least one frame includes a plurality of bins, such that at least one bin of the plurality of bins includes at least one primitive of the set of primitives. The apparatus may also configure a density map based on the visibility information for the set of primitives, where the density map includes density data associated with an amount of the set of primitives in each of the plurality of bins. Further, the apparatus may map the density data for each of the plurality of bins to a shading rate for each of the plurality of bins.