On-Chip ADC Overcurrent Control for GPU Power Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current GPU power management systems face challenges in efficiently handling overcurrent situations, leading to potential shutdowns and performance losses, particularly due to the reactive nature of conventional dynamic voltage/frequency scaling (DVFS) techniques which can result in power exceeding thermal limits, causing board power supplies to disconnect the GPU.

Innovation Solution

The implementation of an on-chip analog-to-digital converter (ADC) based overcurrent control system that enables rapid detection and response to overcurrent events, allowing for adaptive voltage and frequency adjustments to prevent power exceeding thermal limits, thereby maintaining performance and reliability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If dynamic voltage/frequency scaling (DVFS) is used to increase computing speed, then processing performance is improved, but power consumption exceeds thermal limits causing shutdowns

Engineering Contradiction:
Improveprocessing speedVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSPower

Solution Approach 1:

The patent implements preliminary action by using an on-chip ADC to continuously monitor current draw before overcurrent conditions occur. The system proactively detects impending overcurrent events and preemptively adjusts voltage/frequency settings to prevent shutdowns, rather than reactively responding after the board power supply already disconnected the GPU.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies feedback by creating a closed-loop control system where the on-chip ADC continuously measures current consumption and feeds this information back to the power management unit. This real-time feedback enables dynamic adjustment of voltage and frequency to maintain operation within thermal limits while maximizing performance.

Inventive Principle:
Principle #23Feedback

2Loss of time

If conventional reactive DVFS is used to manage power, then response time is improved, but detection precision is insufficient leading to late intervention

Engineering Contradiction:
Improveresponse timeVSAvoidovercurrent detection precision
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The patent replaces the external board-level power supply monitoring mechanism with an on-chip ADC-based detection system. This substitution enables much faster and more precise current measurement directly at the GPU, eliminating the delay inherent in external monitoring and allowing sub-millisecond response times to overcurrent conditions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The on-chip ADC acts as an intermediary between the power consumption sources and the power management control logic. It provides precise current measurements that enable the power management unit to make informed decisions about voltage/frequency adjustments, bridging the gap between raw power consumption and controlled response.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution provides faster detection and response to overcurrent events, reducing the risk of GPU shutdowns and ensuring continued operation by dynamically managing voltage and frequency, thus enhancing power management efficiency and reliability.

Implementation Method 1

The implementation of an on-chip analog-to-digital converter (ADC) based overcurrent control system that enables rapid detection and response to overcurrent events

Methodology Applied
Scientific EffectAnalog-to-digital conversion:

Implementation Method 2

some GPUs rely on a technique known as dynamic voltage/frequency scaling (DVFS), to scale voltage and frequency of the core clocks based on the available power budget allocated to the GPU

Methodology Applied
Scientific EffectDynamic voltage/frequency scaling:

Data Source

PatentUS10852811B2Voltage/frequency scaling for overcurrent protection with on-chip ADC
Publication Date: 2020.12.01 NVIDIA CORP
  • US10852811B2 patent drawing
  • US10852811B2 patent drawing
  • US10852811B2 patent drawing

AI summary

An integrated circuit such as, for example a graphics processing unit (GPU), having an on-chip analog to digital converter (ADC) for use in overcurrent protection of the chip is described, where the overcurrent protection response times are substantially faster than techniques with external ADC. A system-on-chip (SoC) includes the integrated circuit and a multiplexer arranged externally to the chip having the ADC, where the multiplexer provides the ADC with a data stream of sampling information from a plurality of power sources. Methods for overcurrent protection using an on-chip ADC are also described.