Depth Analyzer Shading Rate Controller for GPU Load Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern graphics processing units (GPUs) face significant strain due to the increasing complexity of computer graphics, leading to performance bottlenecks, especially on mobile devices, where resources are scarce, and existing solutions to reduce GPU load often compromise graphic quality or fail to achieve substantial performance gains.

Innovation Solution

Implementing a system that programmatically controls shading rates in graphics processing using a depth analyzer and shading rate controller to apply variable rate shading (VRS) differentially across regions of a screen, reducing GPU load without sacrificing quality, by calculating depth thresholds and modifying graphics commands in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If variable rate shading is applied to reduce GPU load, then GPU loading is reduced and power is conserved, but graphic quality may be compromised

Engineering Contradiction:
ImproveGPU loadingVSAvoidgraphic quality
Core Design Contradiction:
Use of energy by moving objectVSManufacturing precision

Solution Approach 1:

The patent applies different shading rates to different regions of the screen based on depth information. Foreground objects receive higher shading rates for quality, while background objects receive lower shading rates to reduce GPU load. This local differentiation resolves the contradiction by applying quality where needed and reducing computation where it can be sacrificed.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the screen into multiple depth regions using depth thresholds. By dividing the scene into foreground and background regions based on depth information, the system can apply different processing rates to each segment, optimizing the balance between graphic quality and GPU loading reduction.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If manual developer intervention is used to control shading rates, then shading rate control is precise, but device complexity and development time increase

Engineering Contradiction:
Improveshading rate control precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements automatic shading rate control where the system analyzes depth information and autonomously determines appropriate shading rates without developer intervention. The depth analyzer and shading rate controller work together to automatically adjust shading rates based on scene characteristics, eliminating the need for manual configuration while maintaining precise control.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses depth information as feedback to automatically adjust shading rates. The depth analyzer provides real-time information about scene depth distribution, which the shading rate controller uses to dynamically adjust shading rates, creating a closed-loop system that adapts to changing graphical scenarios without manual input.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If uniform shading rates are applied across the entire screen, then graphic quality is maintained, but GPU loading increases significantly

Engineering Contradiction:
Improvegraphic qualityVSAvoidGPU loading
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

Instead of applying uniform shading rates across the entire screen, the patent implements local quality by adjusting shading rates according to the depth and importance of different regions. Critical areas with foreground objects receive high shading rates for quality, while less critical background areas receive reduced shading rates to lower overall GPU loading.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent transitions from static uniform shading rates to dynamic adaptive shading rates that change based on real-time depth analysis. The system continuously monitors scene characteristics and adjusts shading rates dynamically, allowing the GPU loading to be optimized according to the current graphical scenario rather than using a fixed approach.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12118653B2Depth analyzer and shading rate controller
Publication Date: 2024.10.15 MEDIATEK INC
  • US12118653B2 patent drawing
  • US12118653B2 patent drawing
  • US12118653B2 patent drawing

AI summary

A system, method, and computer program product are provided for reducing GPU load by programmatically controlling shading rates in computer graphics. GPU load may be reduced by applying different shading rates to different screen regions. By reading the depth buffer of previous frames and performing image processing, thresholds may be calculated that control the shading rates. The approach may be run on any platform that supports VRS hardware and primitive- or image-based VRS. The approach may be applied on a graphics driver installed on a client device, in a firmware layer between hardware and a driver, in a software layer between a driver and an application, or in hardware on the client device. The approach is flexible and adaptable and calculates and sets the variable rate shading based on the graphics generated by an application without requiring the application developer to manually set variable rate shading.