Variable Rate Shading via Temporal Frequency Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current graphics processing technologies lack a dynamic mechanism for variable rate shading that effectively adapts to temporal changes in image frames, leading to inefficient rendering of high and low frequency details.

Innovation Solution

A graphics processing unit (GPU) performs a transformation pass to associate current pixels with previous pixels, analyzing fragments for frequency detail thresholds to determine and apply variable shading rates, allowing for adaptive shading rates based on characteristics from previous frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If uniform high shading rate is applied to all pixels, then image quality is improved, but processing efficiency deteriorates

Engineering Contradiction:

Improveimage qualityVSAvoidprocessing efficiency

Core Design Contradiction:

Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies different shading rates to different spatial regions based on local frequency characteristics. High frequency regions (edges, detailed areas) receive higher shading rates for quality, while low frequency regions (smooth areas) receive lower shading rates for efficiency, resolving the contradiction between uniform quality and processing efficiency

Inventive Principle:

Principle #3Local quality

2Productivity

If variable rate shading is applied, then processing efficiency is improved, but adaptability to temporal changes deteriorates

Engineering Contradiction:

Improveprocessing efficiencyVSAvoidadaptability to temporal changes

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent performs frequency analysis on the previous frame before rendering the current frame, pre-determining which regions require high shading rates. This preliminary action allows the system to adapt to temporal changes efficiently by preparing shading rate maps in advance based on historical frequency characteristics

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses frequency analysis results from previous frames as feedback to adjust shading rates in the current frame. By continuously analyzing temporal changes in frequency characteristics and adjusting shading rates accordingly, the system maintains adaptability while improving processing efficiency

Inventive Principle:

Principle #23Feedback

3Manufacturing precision

If high shading rate is applied to all areas, then rendering precision is improved, but use of energy deteriorates

Engineering Contradiction:

Improverendering precisionVSAvoiduse of energy

Core Design Contradiction:

Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies high shading rates only to local regions with high frequency details that require precision, while using lower shading rates in smooth regions. This localized approach maintains rendering precision where needed while significantly reducing overall energy consumption

Inventive Principle:

Principle #3Local quality

Data Source

PatentUS10388063B2Variable rate shading based on temporal reprojection

Publication Date: 2019.08.20 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Methods and devices for performing variable rate shading in graphics processing are described. A transformation pass can be performed over a current frame associate a current pixel in a current frame with a previous pixel in a previous frame. A previous fragment, including the previous pixel, in the previous frame can be analyzed to determine whether the previous fragment includes one or more areas of frequency detail achieving a threshold. A variable shading rate to apply to a current fragment including the current pixel can be determined based on analyzing the previous fragment.