Dynamic Sleep State Management for Power Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current power-gating techniques in computing systems face challenges in achieving optimal power management, as transitioning between active and sleep states consumes time and energy, leading to performance and energy overheads, especially when idle times are fragmented and short, potentially increasing overall power consumption if not adequately compensated by sufficient sleep durations.

Innovation Solution

A granular power management method that predicts optimal times to enter a powered-down state by analyzing past idle event duration characteristics, determining whether to immediately transition to a powered-down state based on an energy break-even point threshold, and dynamically adjusting the pre-flush latency to filter out short duration idle events and capture longer ones, thereby improving energy savings without significant performance loss.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If the system transitions to a full sleep state to reduce leakage power, then energy consumption is reduced, but time and energy are consumed for flushing caches and transitioning state, leading to performance overhead

Engineering Contradiction:
Improveleakage power consumptionVSAvoidtransition time and cache flush time
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The system performs preliminary actions by predicting future idle periods based on historical patterns before actually entering sleep state. The predictor identifies characteristics of past idle events and forecasts upcoming idle periods, allowing the system to prepare for optimal sleep transitions in advance, thus reducing the impact of transition overhead on performance.

Inventive Principle:
Principle #10Preliminary action

2Loss of energy

If the system enters sleep state frequently to capture short idle periods, then energy savings increase, but the frequency of transitions increases overhead and may actually increase total power consumption

Engineering Contradiction:
Improveleakage power consumptionVSAvoidtransition frequency management
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The system implements feedback by continuously monitoring actual idle event durations and comparing them with predicted values. The predictor analyzes characteristics of past idle events and uses this feedback to refine future predictions. This feedback mechanism allows the system to adapt to actual workload patterns and optimize sleep state transitions, avoiding unnecessary transitions that would increase overhead.

Inventive Principle:
Principle #23Feedback

3Productivity

If the system delays sleep state entry to avoid short idle events, then performance overhead is reduced, but energy savings from leakage power reduction are diminished

Engineering Contradiction:
Improvesystem performanceVSAvoidleakage power consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The predictor performs preliminary analysis of historical idle event patterns to forecast upcoming idle periods with sufficient duration. By predicting which idle events are likely to be long enough to justify sleep state transition, the system can proactively prepare for optimal sleep entries, balancing performance overhead against energy savings.

Inventive Principle:
Principle #10Preliminary action

4Loss of energy

If the system uses aggressive power-gating to capture all idle time, then energy savings maximize, but performance and energy overhead from transitions increase significantly

Engineering Contradiction:
Improveleakage power consumptionVSAvoidtransition energy overhead
Core Design Contradiction:
Loss of energyVSUse of energy by moving object

Solution Approach 1:

The predictor performs preliminary evaluation of upcoming idle events based on historical patterns before committing to sleep state transitions. By forecasting which idle events will be sufficiently long, the system avoids unnecessary transitions that would waste energy, thus reducing transition energy overhead while still capturing significant leakage power savings from well-timed sleep entries.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9921635B2Dynamic and adaptive sleep state management
Publication Date: 2018.03.20 ADVANCED MICRO DEVICES INC
  • US9921635B2 patent drawing
  • US9921635B2 patent drawing
  • US9921635B2 patent drawing

AI summary

An approach is described herein that includes a method for power management of a device. In one example, the method includes sampling duration characteristics for a plurality of past idle events for a predetermined interval of time and determining whether to transition a device to a powered-down state based on the sampled duration characteristics. In another example, the method includes determining whether an average idle time for a plurality of past idle events exceeds an energy break-even point threshold. If the average idle time for the plurality of past idle events exceeds the energy break-even point threshold, a device is immediately transitioned to a powered-down state upon receipt of a next idle event. If the average idle time for the plurality of past idle events does not exceed the energy break-even point threshold, transition of the device to the powered-down state is delayed.