CPU Power Budget Distribution via Ring Topology Token Pool

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current power management systems in multi-CPU computer systems face challenges in efficiently distributing power among CPU cores and CPUs, leading to potential overheating and inefficiencies due to inadequate power allocation and distribution mechanisms.

Innovation Solution

A power management system employing a ring topology with a distributed token passing mechanism, where a token pool allocates and reallocates power tokens among frequency domains based on workload demands, ensuring that each domain operates within a predetermined power budget while optimizing performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a fixed power budget is allocated to each CPU core without dynamic reallocation, then power consumption is controlled within limits, but system performance is reduced due to inability to adapt to varying workload demands

Engineering Contradiction:
Improvesystem performanceVSAvoidpower consumption efficiency
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent implements dynamic power budget reallocation among CPU cores based on actual workload demands. The power management system continuously monitors workload characteristics and adjusts power budgets in real-time, transforming the static power allocation into a dynamic system that adapts to changing conditions, thereby improving both performance and energy efficiency

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms where workload monitoring information is fed back to the power management controller, which then adjusts power budget allocations accordingly. This closed-loop control enables the system to respond to actual performance needs and optimize power distribution based on measured workload characteristics

Inventive Principle:
Principle #23Feedback

2Productivity

If power is reallocated dynamically among CPU cores based on workload, then system performance is optimized, but system complexity increases due to real-time monitoring and control mechanisms

Engineering Contradiction:
Improveworkload-optimized performanceVSAvoidpower management system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent enables CPU cores to self-regulate their power consumption by incorporating workload monitoring and power adjustment capabilities directly at the core level. Each core can autonomously determine its power needs based on workload characteristics and adjust its own power budget, reducing the need for complex centralized control mechanisms

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The power management system is segmented into independent control units associated with each CPU core, allowing distributed power management rather than centralized control. This segmentation reduces the complexity of the overall control system by localizing decision-making to where the workload actually occurs

Inventive Principle:
Principle #1Segmentation

3Power

If on-chip controller throttles CPU frequency to maintain power budget, then power consumption is controlled, but processing speed is reduced

Engineering Contradiction:
Improvepower budget complianceVSAvoidCPU operating frequency
Core Design Contradiction:
PowerVSSpeed

Solution Approach 1:

The system dynamically adjusts power budgets at the CPU core level based on workload characteristics, allowing frequency throttling to be applied selectively rather than uniformly. This enables the system to maintain higher frequencies for cores handling time-critical workloads while applying throttling only where appropriate, optimizing the balance between power consumption and processing speed

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4189521B1Power budget distribution in computer system
Publication Date: 2024.11.27 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • EP4189521B1 patent drawingFigure 1
  • EP4189521B1 patent drawingFigure 2~3
  • EP4189521B1 patent drawingFigure 4A

AI summary

A method of power distribution in a computer system associates a number of tokens with a plurality of frequency domains (for example, cores) of a central processing unit (CPU) computer chip. The number of tokens allotted to the CPU is based on the CPU power budget. Cores are organized as a ring topology. A token pool traverses the ring, picks up excess tokens from cores having excess tokens, and gives the tokens to cores that need additional tokens. Tokens acquired by a core allows the core to increase operating frequency by an increment represented by the tokens. Consequently, power usage is weighted toward heavily loaded cores and away from lightly loaded cores. Overall power usage of the CPU remains within a power budget. The method budgets power optimally to sustain turbo frequencies for longer durations by not allowing control units to increase frequency in absence of any useful high frequency benefiting workload.