Parallel Core Power Management via Message Subdivision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-performance computing systems face significant power consumption issues due to synchronization points where tasks must wait for data exchange between different processing cores, leading to inefficient energy use as cores continue to consume energy in spin loops.

Innovation Solution

Implementing a power management agent that transitions processing cores into lower power states at synchronization points, using techniques like dynamic voltage frequency scaling, and subdividing messages to reduce power churn and improve processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If tasks execute in parallel on multiple cores with synchronization points, then processing speed is improved, but power consumption increases due to spin loops at synchronization points

Engineering Contradiction:
Improveprocessing speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by having cores proactively signal their arrival at synchronization points before actually needing to wait. This allows the power management agent to anticipate waiting periods and transition cores to low-power states in advance, rather than waiting for the spin loop to begin. The signaling mechanism enables proactive power management that prevents unnecessary energy consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the power state of processing cores based on their execution status and synchronization needs. The power management agent continuously monitors core states and transitions them between active and low-power states as conditions change. This dynamic adaptation allows the system to optimize power consumption in real-time while maintaining parallel processing performance when needed.

Inventive Principle:
Principle #15Dynamics

2Reliability

If cores wait in spin loops at synchronization points, then task synchronization is maintained, but energy efficiency deteriorates

Engineering Contradiction:
Improvetask synchronizationVSAvoidenergy efficiency
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The power management agent acts as an intermediary between the processing cores and the power management infrastructure. It receives signals from cores about their synchronization status and coordinates power state transitions accordingly. This intermediary mechanism ensures that synchronization reliability is maintained while enabling energy-efficient power management, as the agent mediates between the need for synchronization and the desire to reduce power consumption.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements a feedback mechanism where cores signal their arrival at synchronization points to the power management agent. This feedback enables the agent to make informed decisions about power state transitions, ensuring that cores remain synchronized while minimizing energy waste. The feedback loop allows the system to adapt power management decisions based on actual synchronization needs rather than using static waiting protocols.

Inventive Principle:
Principle #23Feedback

3Use of energy by moving object

If cores transition to lower power states before synchronization, then power consumption is reduced, but system complexity increases due to power management overhead

Engineering Contradiction:
Improvepower consumptionVSAvoidpower management overhead
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The power management agent performs multiple functions: it monitors core execution status, receives synchronization signals, determines optimal power state transitions, and coordinates with power management infrastructure. By consolidating these diverse functions into a single multi-functional agent, the system reduces overall complexity compared to having separate mechanisms for each function. The universal agent simplifies the architecture while achieving comprehensive power management.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11435809B2Method and apparatus to improve energy efficiency of parallel tasks
Publication Date: 2022.09.06 INTEL CORP
  • US11435809B2 patent drawing
  • US11435809B2 patent drawing
  • US11435809B2 patent drawing

AI summary

A system with improved power performance for tasks executed in parallel. A plurality of processing cores each to execute tasks. An inter-core messaging unit to conveys messages between the cores. A power management agent transitions a first core into a lower power state responsive to the first core waiting for a second core to complete a second task. In some embodiments long messages are subdivided to allow a receiving core to resume useful work sooner.