Accelerator Power Management via Interconnect Data Rate Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In computing environments without access to accelerator driver programs, such as cloud environments, power management of accelerators is difficult to achieve, leading to potential overloading and hazardous operations due to uncontrolled power consumption.
Innovation Solution
A method and system for power management of accelerators using interconnect configuration, where a processor receives a power management command, identifies a port associated with the accelerator, determines a target data transmission parameter based on a power budget, and controls data transmission parameters to manage power consumption without relying on accelerator driver programs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If driver programs are used to manage power limits of accelerators, then power management capability is improved, but system complexity and dependency increase
Solution Approach 1:
The interconnect serves as an intermediary device between the processor and accelerator, enabling power management functionality without requiring driver programs on the accelerator side. The interconnect intercepts and controls data transmissions to the accelerator, thereby indirectly managing power consumption through transmission rate control while avoiding direct complexity on the accelerator device.
2Productivity
If accelerators operate at high power for AI applications, then computing speed is improved, but power consumption increases
Solution Approach 1:
The system dynamically adjusts the data transmission rate to the accelerator based on power budget constraints. By making the transmission rate variable rather than fixed, the system can optimize the balance between computing speed and power consumption, allowing high speed when power is available and reducing speed when power constraints are active.
Solution Approach 2:
The invention changes the data transmission parameter (transmission rate) as a control variable to manage power consumption. By adjusting this parameter in response to power budget conditions, the system achieves power management without directly controlling accelerator power settings, thereby maintaining computing efficiency within power constraints.
3Productivity
If data transmission rate to accelerator is increased, then computing performance is improved, but power consumption increases
Solution Approach 1:
The system implements feedback control by monitoring power budget conditions and adjusting data transmission rates accordingly. The interconnect receives feedback about power constraints and dynamically modifies transmission parameters to maintain computing performance within acceptable power limits, creating a closed-loop control system for power management.
Data Source
AI summary
The present disclosure provides a system and a method for power management of accelerators using interconnect configuration. The method comprises receiving a power management command comprising a power budget and a designated accelerator, identifying a port associated with the designated accelerator from a plurality of ports of an interconnect, determining a target data transmission parameter for the designated accelerator according to the power budget, and controlling a data transmission parameter relative to the target data transmission parameter through the port associated with the designated accelerator. The present disclosure further provides a non-transitory computer-readable medium that stores a set of instructions that are executable by one or more processors of an apparatus to perform the method for power management of accelerators using interconnect configuration.