SIMD Load Balancing for Power Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional graphics processing systems waste power by keeping all SIMDs active, even when underutilized, leading to inefficiency and unpredictable current changes, which can cause severe instantaneous current changes (di/dt) affecting system reliability and performance.

Innovation Solution

Implement a load balancing per watt technique that monitors ALU and fetch instructions to assess current and future SIMD utilization, deactivating unneeded SIMDs to reduce power consumption and optimize workload distribution, thereby minimizing di/dt and improving performance per watt.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If all SIMDs are kept active to handle workload, then system performance is maintained, but power consumption increases due to underutilized SIMDs

Engineering Contradiction:

Improvesystem performanceVSAvoidpower consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies dynamics by making the SIMD activation state changeable rather than fixed. The system dynamically activates or deactivates SIMDs based on real-time workload assessment, transitioning from a static all-active configuration to a dynamic configuration that adapts to varying performance requirements and power consumption constraints.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the operational parameter of SIMD activation status from a fixed state to a variable state. By monitoring workload characteristics and adjusting the number of active SIMDs accordingly, the system optimizes the balance between performance and power consumption, activating only the necessary number of SIMDs for each workload condition.

Inventive Principle:

Principle #35Parameter changes

2Productivity

If workload is distributed across all SIMDs, then system performance is maintained, but unpredictable current changes occur causing severe di/dt effects

Engineering Contradiction:

Improvesystem performanceVSAvoidcurrent stability

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent applies preliminary action by assessing the upcoming workload before activating SIMDs. The system monitors workload characteristics in advance and proactively activates only the necessary number of SIMDs before the workload actually begins, preventing sudden current changes by avoiding the activation of excessive SIMDs simultaneously.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by continuously monitoring actual SIMD utilization and workload characteristics. This feedback mechanism allows the system to adjust the number of active SIMDs in real-time, preventing unpredictable current changes by ensuring that the number of active SIMDs matches the actual workload requirements.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS8736619B2Method and system for load optimization for power

Publication Date: 2014.05.27 ADVANCED MICRO DEVICES INC

AI summary

A method for managing work distribution in a processor including a plurality of instruction data modules, is provided. The method includes analyzing work units received by the processor and comparing the utilization level in each active module within the plurality with a first predetermined threshold. The work units are distributed across selected ones of the modules within the plurality based upon the analyzing and the comparing.