AI Control Circuit for Compute Power State Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing computing systems face challenges in efficiently managing power states of compute resources due to high energy consumption during workload operations, and the energy cost of transitioning between power states can exceed the energy savings, making it beneficial to refrain from such transitions.
Innovation Solution
Implementing an apparatus with a control circuit that uses a model, such as a neural network, to generate control information based on activity information from compute resources, allowing for intelligent decision-making on power state transitions to optimize energy usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If compute resources transition between power states, then energy savings are achieved during idle periods, but the transition energy cost may exceed the savings
Solution Approach 1:
The system performs preliminary actions by collecting activity information and training a machine learning model to predict future compute resource usage patterns. This allows the system to anticipate when transitions will be beneficial before actually making them, avoiding premature or unnecessary power state transitions that would waste energy.
Solution Approach 2:
The system implements feedback by continuously monitoring actual compute resource activity and comparing it with predictions from the trained model. This feedback loop allows the system to refine its predictions and make more accurate decisions about when to transition power states, ensuring that transition energy costs are always justified by subsequent energy savings.
2Productivity
If a machine learning model is used to predict power state transitions, then energy management efficiency is improved, but system complexity increases
Solution Approach 1:
The system applies self-service by training the machine learning model using activity information collected from the compute resources themselves. The compute resources effectively teach the system about their own behavior patterns, eliminating the need for external complex training infrastructure and allowing the model to adapt automatically to changing workloads.
Solution Approach 2:
The patent employs lightweight, simplified machine learning models that can be trained and deployed with minimal computational overhead. These models use simple algorithms that require little training data and can be quickly updated, replacing the need for complex, resource-intensive prediction systems while maintaining effective energy management.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An apparatus may include at least one control circuit configured to receive activity information for one or more compute resources, and generate, using a model, based on the activity information, control information to control a power state of at least one of the one or more compute resources. The at least one control circuit may include a multiply-accumulate circuit. The at least one control circuit may include a neural processing unit. The model may include a neural network. The activity information may include first activity information, and the at least one control circuit may be further configured to collect second activity information for the one or more compute resources, and send the second activity information. The at least one control circuit may be further configured to receive, based on the sending the second activity information, one or more parameters for the model.