Variable-Precision Shading for Fragment Shader Power Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The fragment shader in a raster graphics pipeline consumes most of the power and can be a bottleneck, reducing the efficiency of graphics processing, and existing methods struggle to balance precision and performance without compromising image quality.

Innovation Solution

Implementing a method that groups pixels into variable-precision groups and uses a low-precision fragment shader (LPFS) for most pixels where possible, while switching to a higher-precision fragment shader (RPFS) only when necessary, determined by comparing the output of a pilot pixel processed by both shaders and an error threshold.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If lower precision calculations are used in fragment shader, then power consumption is reduced and performance is improved, but image quality deteriorates

Engineering Contradiction:
Improvepower consumptionVSAvoidimage quality
Core Design Contradiction:
Use of energy by moving objectVSMeasurement precision

Solution Approach 1:

The patent applies local quality by dividing pixels into different quality groups: pilot pixels are processed with high precision to ensure accurate error detection, while non-pilot pixels use low precision processing. This localized approach to precision allows the system to reduce overall power consumption while maintaining image quality in critical areas where errors would be most noticeable.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by applying high precision processing only to pilot pixels (a small subset of pixels) rather than all pixels. The error calculation is performed partially on representative samples, and this partial result is then extrapolated to determine the processing mode for the entire pixel group, reducing total computational power while maintaining quality control.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If higher precision fragment shader is used for all pixels, then image quality is maintained, but power consumption increases and performance decreases

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system applies different processing qualities to different pixels based on their role: pilot pixels receive high precision processing for accurate error detection, while non-pilot pixels receive low precision processing for efficiency. This localized quality differentiation maintains image quality where needed while maximizing processing efficiency elsewhere.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

High precision processing is applied partially only to pilot pixels rather than all pixels. The error detection is performed on a partial sample set, and the results are extrapolated to control the processing of the entire pixel group, achieving quality assurance with minimal computational overhead.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If low precision fragment shader is used for all pixels, then power consumption is reduced and performance is improved, but image fidelity is significantly reduced

Engineering Contradiction:
Improveprocessing speedVSAvoidimage fidelity
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary high precision processing on pilot pixels before processing non-pilot pixels. This preliminary action establishes accurate reference values and error thresholds that guide the subsequent low precision processing, ensuring that image fidelity is maintained despite the use of low precision operations for the majority of pixels.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from pilot pixel processing to control the processing of non-pilot pixels. The error calculations and quality assessments derived from pilot pixels provide feedback that determines whether low precision processing is acceptable for the overall pixel group, thereby maintaining image fidelity while enabling efficient low precision processing.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11935175B2Apparatus, method, and computer-readable medium for image processing using variable-precision shading
Publication Date: 2024.03.19 HUAWEI TECH CO LTD
  • US11935175B2 patent drawing
  • US11935175B2 patent drawing
  • US11935175B2 patent drawing

AI summary

There is described a method of shading a group of pixels in a fragment shader in a raster graphics pipeline. At least one first pilot pixel of the group of pixels is shaded under a first precision. At least one second pilot pixel of the group of pixels is shaded under a second precision. An error value representing a difference between the first and second pilot pixels is calculated. At least one other pixel of the group of pixels is shaded under the first precision if the error value is greater than an error threshold. The at least one other pixel is shaded under the second precision if the error value is smaller than the error threshold.