AI Control Circuit for Compute Power State Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computing systems face challenges in efficiently managing power states of compute resources due to high energy consumption during workload operations, and the energy cost of transitioning between power states can exceed the energy savings, making it beneficial to refrain from such transitions.

Innovation Solution

Implementing an apparatus with a control circuit that uses a model, such as a neural network, to generate control information based on activity information from compute resources, allowing for intelligent decision-making on power state transitions to optimize energy usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If compute resources transition between power states, then energy savings are achieved during idle periods, but the transition energy cost may exceed the savings

Engineering Contradiction:
Improveenergy savingsVSAvoidtransition energy cost
Core Design Contradiction:
Loss of energyVSUse of energy by stationary object

Solution Approach 1:

The system performs preliminary actions by collecting activity information and training a machine learning model to predict future compute resource usage patterns. This allows the system to anticipate when transitions will be beneficial before actually making them, avoiding premature or unnecessary power state transitions that would waste energy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by continuously monitoring actual compute resource activity and comparing it with predictions from the trained model. This feedback loop allows the system to refine its predictions and make more accurate decisions about when to transition power states, ensuring that transition energy costs are always justified by subsequent energy savings.

Inventive Principle:
Principle #23Feedback

2Productivity

If a machine learning model is used to predict power state transitions, then energy management efficiency is improved, but system complexity increases

Engineering Contradiction:
Improveenergy management efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system applies self-service by training the machine learning model using activity information collected from the compute resources themselves. The compute resources effectively teach the system about their own behavior patterns, eliminating the need for external complex training infrastructure and allowing the model to adapt automatically to changing workloads.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent employs lightweight, simplified machine learning models that can be trained and deployed with minimal computational overhead. These models use simple algorithms that require little training data and can be quickly updated, replacing the need for complex, resource-intensive prediction systems while maintaining effective energy management.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentEP4567561A1Systems, methods, and apparatus for controlling power states of compute resources with artificial intelligence
Publication Date: 2025.06.11 SAMSUNG ELECTRONICS CO LTD
  • EP4567561A1 patent drawingFigure 1
  • EP4567561A1 patent drawingFigure 2
  • EP4567561A1 patent drawingFigure 3

AI summary

An apparatus may include at least one control circuit configured to receive activity information for one or more compute resources, and generate, using a model, based on the activity information, control information to control a power state of at least one of the one or more compute resources. The at least one control circuit may include a multiply-accumulate circuit. The at least one control circuit may include a neural processing unit. The model may include a neural network. The activity information may include first activity information, and the at least one control circuit may be further configured to collect second activity information for the one or more compute resources, and send the second activity information. The at least one control circuit may be further configured to receive, based on the sending the second activity information, one or more parameters for the model.