Datacenter Power Balancing via Dynamic Frequency Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In datacenter power management, the imbalance in power consumption among computing units within a rack leads to reduced overall performance per watt, as power-hungry units disrupt the balance, necessitating efficient frequency adjustment to optimize power distribution.

Innovation Solution

A system and method where a controller reads fused power coefficients for each computing unit to determine an optimal operating frequency, iteratively adjusting frequencies across baseboards to ensure power consumption stays within predetermined budgets, thereby optimizing performance and reducing costs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If power consumption is split among computing units with predetermined power budgets, then individual units can operate independently, but power-hungry units reduce overall performance per watt

Engineering Contradiction:
Improveindependent operation of computing unitsVSAvoidperformance per watt
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The patent implements dynamic frequency adjustment for each computing unit based on real-time power consumption measurements. The controller continuously monitors power usage and adjusts operating frequencies to balance power distribution across all units, transforming the static power budget allocation into a dynamic system that adapts to actual consumption patterns, thereby maximizing overall performance per watt while maintaining independent operation capability

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operating parameter (frequency) of computing units to optimize power consumption. By reading fused power coefficients and adjusting frequencies based on measured power consumption, the system modifies operational parameters to ensure power-starry units operate at reduced frequencies, balancing the power distribution and improving aggregate performance per watt without compromising individual unit functionality

Inventive Principle:
Principle #35Parameter changes

2Productivity

If operating frequency is increased to improve performance, then computing speed increases, but power consumption increases

Engineering Contradiction:
Improvecomputing speedVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent utilizes parameter changes by adjusting operating frequencies based on power consumption measurements and fused coefficients. The controller dynamically modifies the frequency parameter for each computing unit to achieve optimal performance per watt, allowing high-performance operation when power is available and reduced frequency when power consumption approaches budget limits

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system implements feedback control by measuring actual power consumption, comparing it against the power budget, and adjusting frequencies accordingly. The controller continuously monitors power usage and uses this feedback to make real-time frequency adjustments, creating a closed-loop system that optimizes the relationship between computing speed and power consumption

Inventive Principle:
Principle #23Feedback

3Loss of energy

If frequency is adjusted to balance power consumption, then overall efficiency improves, but system complexity increases

Engineering Contradiction:
Improveoverall efficiencyVSAvoidfrequency control mechanism
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent applies self-service by having each computing unit's frequency automatically adjusted based on its own power consumption characteristics and fused coefficients. The system uses pre-characterized power coefficients stored in fuse elements to determine appropriate frequency adjustments, enabling autonomous optimization without requiring complex external control logic for each unit, thus improving efficiency while limiting complexity growth

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11971774B2Programmable power balancing in a datacenter
Publication Date: 2024.04.30 NVIDIA CORP
  • US11971774B2 patent drawing
  • US11971774B2 patent drawing
  • US11971774B2 patent drawing

AI summary

A datacenter power management system and method is disclosed. A plurality of computing units are enabled to operate at a second frequency, higher than a first frequency, in response to determining from respective power coefficients for these computing units, that a power level at this higher frequency remains below a power budget.