Adaptive Pixel Shading Granularity in Graphics Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current graphics processing technologies face challenges in improving the realism of rendered images without excessive power consumption and frame rate reduction, particularly due to redundant pixel shading calculations and uneven visual characteristics across images.

Innovation Solution

A method is introduced where pixel shading operations are performed at variable granularities, with coarse shading units handling low-frequency effects on a subset of pixels and fine shading units handling high-frequency effects on each pixel, optimizing the pixel shading subsystem to reduce redundant operations and adapt to image resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If the resolution of the rendered 2-D image is increased to improve realism and reduce visual artifacts, then the ability to accurately portray effects and smooth edges is improved, but the pixel shading subsystem performs redundant calculations, leading to increased power consumption and decreased rendering frame rate

Engineering Contradiction:
Improveimage realismVSAvoidrendering frame rate
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent applies local quality by differentiating shading operations based on spatial location and visual importance. Coarse shading is performed on pixels in regions with uniform visual characteristics where high precision is not needed, while fine shading is performed on pixels in regions requiring higher accuracy. This selective approach maintains image realism in critical areas while reducing redundant calculations in less critical areas, thereby improving rendering frame rate without sacrificing overall image quality.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If the resolution of the rendered 2-D image is increased to improve realism, then the ability to smooth edges and portray effects is improved, but power consumption increases due to additional pixel shading calculations

Engineering Contradiction:
Improveimage realismVSAvoidpower consumption
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent reduces power consumption by applying local quality principles to shading operations. Instead of uniformly performing fine shading on all pixels at high resolution, the system performs coarse shading on pixels in regions with uniform visual characteristics and only performs fine shading on pixels where high precision is actually needed. This selective shading approach significantly reduces the total number of shading calculations, thereby lowering power consumption while maintaining image realism in visually critical regions.

Inventive Principle:
Principle #3Local quality

3Ease of operation

If uniform shading operations are applied across the entire image, then simplicity of implementation is maintained, but redundant calculations are performed in regions with uniform visual characteristics, reducing processing efficiency

Engineering Contradiction:
Improveshading operation simplicityVSAvoidprocessing efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent applies segmentation by dividing the image processing into distinct shading passes: a first pixel shading operation that performs coarse shading on all pixels, and a second pixel shading operation that performs fine shading only on selected pixels. This segmentation allows the system to maintain simplicity in the overall shading framework while improving processing efficiency by selectively applying detailed shading only where necessary, rather than uniformly processing all pixels.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10733794B2Adaptive shading in a graphics processing pipeline
Publication Date: 2020.08.04 NVIDIA CORP
  • US10733794B2 patent drawing
  • US10733794B2 patent drawing
  • US10733794B2 patent drawing

AI summary

One embodiment of the present invention includes a parallel processing unit (PPU) that performs pixel shading at variable granularities. For effects that vary at a low frequency across a pixel block, a coarse shading unit performs the associated shading operations on a subset of the pixels in the pixel block. By contrast, for effects that vary at a high frequency across the pixel block, fine shading units perform the associated shading operations on each pixel in the pixel block. Because the PPU implements coarse shading units and fine shading units, the PPU may tune the shading rate per-effect based on the frequency of variation across each pixel group. By contrast, conventional PPUs typically compute all effects per-pixel, performing redundant shading operations for low frequency effects. Consequently, to produce similar image quality, the PPU consumes less power and increases the rendering frame rate compared to a conventional PPU.