GPU Power Management via Dynamic Voltage Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Real-time rendering applications face challenges in managing power consumption to minimize latency and prevent missed frames, particularly in power or thermally constrained platforms, where high clock rates can lead to overheating and reduced performance.

Innovation Solution

A system with a software driver and power management unit dynamically adjusts the performance settings of processing elements, such as GPUs, based on queue occupancy and time remaining until the next video synchronization signal, using dynamic voltage and frequency scaling to balance power consumption and rendering task completion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the processing unit runs at the highest clock rate to minimize latency and guarantee timely frame rendering, then the rendering speed and frame completion time are improved, but the power consumption and heat generation increase, which can cause overheating and thermal throttling

Engineering Contradiction:
Improverendering speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system dynamically adjusts the clock rate of the processing unit based on real-time monitoring of queue occupancy and frame timing. Instead of running at a fixed highest clock rate, the system adapts the performance level to match actual workload demands, allowing high performance when needed while reducing power consumption during lighter loads or when thermal thresholds are approached

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters (clock rate, power state) based on monitored conditions such as queue depth, frame timing, and thermal state. By adjusting these parameters dynamically rather than maintaining a fixed high state, the system achieves timely frame rendering when necessary while minimizing power consumption and heat generation during other periods

Inventive Principle:
Principle #35Parameter changes

2Temperature

If the processing unit reduces clock rate to avoid overheating and thermal throttling, then power consumption and thermal management are improved, but rendering latency increases and frames may be missed

Engineering Contradiction:
Improvethermal managementVSAvoidrendering latency
Core Design Contradiction:
TemperatureVSLoss of time

Solution Approach 1:

The system performs preliminary actions by monitoring queue occupancy and frame timing in advance to predict when rendering bottlenecks or thermal issues may occur. By detecting early signs of potential problems (such as queue depth indicating upcoming workload or timing analysis showing tight deadlines), the system can proactively adjust clock rates to prevent both overheating and missed frames before they occur

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements continuous feedback loops that monitor rendering progress, queue state, and thermal conditions, then adjust clock rates accordingly. This closed-loop control ensures that the processing unit responds to actual system state rather than operating at fixed rates, allowing the system to maintain timely frame completion while managing thermal constraints through real-time adaptation

Inventive Principle:
Principle #23Feedback

3Reliability

If the processing unit completes frame execution early to allow timely use of the frame, then frame timing reliability is improved, but power consumption increases and may lead to unnecessary energy usage

Engineering Contradiction:
Improveframe timing reliabilityVSAvoidenergy waste
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The system applies partial action by adjusting the clock rate to match the actual workload requirements rather than always running at maximum capacity. When queue occupancy is low or frame timing allows, the system uses reduced clock rates (partial action) sufficient to meet timing requirements without the excessive energy consumption of sustained maximum performance, thereby maintaining reliability while reducing energy waste

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach ensures timely completion of rendering tasks while minimizing power consumption, reducing the risk of missed frames and improving user experience by adaptively managing performance settings in response to changing workload and time constraints.

Implementation Method 1

using dynamic voltage and frequency scaling to balance power consumption and rendering task completion

Methodology Applied
Scientific EffectDynamic voltage and frequency scaling:

Data Source

PatentUS11954792B2Real-time GPU rendering with performance guaranteed power management
Publication Date: 2024.04.09 ATI TECHNOLOGIES ULC
  • US11954792B2 patent drawing
  • US11954792B2 patent drawing
  • US11954792B2 patent drawing

AI summary

Systems, apparatuses, and methods for performing real-time video rendering with performance guaranteed power management are disclosed. A system includes at least a software driver, a power management unit, and a plurality of processing elements for performing rendering tasks. The system receives inputs which correspond to rendering tasks which need to be performed. The software driver monitors the inputs that are received and the number of rendering tasks to which they correspond. The software driver also monitors the amount of time remaining until the next video synchronization signal. The software driver determines which performance setting will minimize power consumption while still allowing enough time to finish the rendering tasks for the current frame before the next video synchronization signal. Then, the software driver causes the power management unit to provide this performance setting to the plurality of processing elements as they perform the rendering tasks for the current frame.