Workload Scheduler Voltage Control for ML Accelerator Idle Power
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing systems, particularly those with high-load conditions like machine learning (ML) ASICs, face inefficiencies in power management, leading to unnecessarily high idle power consumption due to the lack of direct voltage adjustment by the processor during idle states.
Innovation Solution
A computing system architecture that includes a processor, a voltage regulator, a board management controller, and a host machine, which collaboratively manage the supply voltage by differentiating between processor idle and active states, reducing the voltage during idle times to minimize power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Use of energy by moving object
If DVFS is implemented to reduce power consumption, then power efficiency is improved, but device complexity and cost increase due to dedicated communication interface and hardware/software support requirements
Solution Approach 1:
The patent introduces a workload scheduler as an intermediary component that monitors processor workload conditions and generates appropriate voltage setting commands. This mediator translates workload states into voltage adjustment instructions, enabling power management without requiring complex dedicated communication interfaces between the processor and voltage regulator, thus reducing system complexity while maintaining power efficiency
Solution Approach 2:
The voltage setting command mechanism is designed to serve multiple functions: it not only adjusts voltage for power savings during idle states but also maintains compatibility with existing processor operations. The same communication infrastructure supports both power management and normal processor control functions, eliminating the need for separate dedicated interfaces and reducing overall system complexity
2Productivity
If processor operates at maximum supply voltage continuously, then processing performance is maintained, but power consumption increases unnecessarily during idle states
Solution Approach 1:
The system dynamically adjusts the processor's supply voltage based on real-time workload conditions. The workload scheduler continuously monitors processor state and generates voltage setting commands that adapt the voltage level - maintaining maximum voltage during busy states for optimal performance and reducing voltage during idle states for power savings, creating a dynamic response to changing operational requirements
Solution Approach 2:
The patent changes the voltage parameter of the processor based on workload conditions. By monitoring processor activity and adjusting the supply voltage parameter accordingly - maintaining high voltage for performance-critical operations and reducing voltage during idle periods - the system optimizes the trade-off between processing performance and power consumption without compromising productivity when needed
3Ease of manufacture
If static voltage scaling is used to adjust voltage, then manufacturing simplicity is maintained, but adaptability to workload conditions is lost
Solution Approach 1:
The workload scheduler performs preliminary assessment of processor workload conditions and proactively generates voltage setting commands before actual voltage adjustment is needed. This advance planning allows the system to prepare appropriate voltage levels based on predicted workload states, enabling adaptive voltage scaling while maintaining simple manufacturing through use of existing communication infrastructure rather than requiring complex new hardware
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method and system for controlling a supply voltage provided to a processor by generating a voltage setting command by a workload scheduler; and responding to the voltage setting command by instructing a voltage regulator that provides the supply voltage, at a supply voltage level, to set the supply voltage level to one of at least an idle voltage level or an active voltage level that is higher than the idle voltage level.