Memory Power Management via Token Bucket Energy Credits

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Memory systems, such as solid-state drives (SSDs), face challenges in managing power consumption efficiently due to varying energy requirements for different operations, often leading to limitations in the number of operations that can be executed simultaneously, as they have a maximum power threshold.

Innovation Solution

A power management method using a token bucket system, where a variable credit value represents the available energy, and operations are only granted if the credit value exceeds a minimum requirement, with the credit value adjusted based on actual energy consumption, and configurations for optimal energy usage are selected to maintain average power within specified limits.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If memory operations are executed in parallel to improve performance, then productivity increases, but power consumption exceeds the maximum power threshold

Engineering Contradiction:
Improvenumber of operations executedVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSPower

Solution Approach 1:

The patent implements dynamic power management by adjusting the number of parallel memory operations based on real-time power conditions. The controller dynamically selects from multiple operation configurations (different numbers of parallel operations) and adjusts the operation count according to power consumption thresholds, enabling the system to optimize productivity while staying within power limits.

Inventive Principle:
Principle #15Dynamics

2Power

If the number of parallel operations is reduced to stay within power limits, then power consumption is controlled, but productivity decreases

Engineering Contradiction:
Improvepower consumptionVSAvoidnumber of operations executed
Core Design Contradiction:
PowerVSProductivity

Solution Approach 1:

The patent employs periodic evaluation of power consumption conditions and dynamically adjusts the number of parallel operations in response to changing power states. The controller periodically monitors power usage and adjusts the operation configuration accordingly, allowing the system to maximize productivity during periods when power availability permits while maintaining power control when limits are approached.

Inventive Principle:
Principle #19Periodic action

3Power

If a fixed power threshold is used to limit operations, then power consumption is controlled, but energy efficiency decreases due to safety margins

Engineering Contradiction:
Improvepower consumption controlVSAvoidenergy efficiency
Core Design Contradiction:
PowerVSLoss of energy

Solution Approach 1:

The patent implements a feedback mechanism that monitors actual power consumption and adjusts the number of parallel operations accordingly. Rather than using a fixed conservative threshold, the system continuously feedbacks on actual power usage and dynamically adjusts operation levels to closely track the maximum power threshold, thereby eliminating unnecessary safety margins and improving energy efficiency while maintaining power control.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9678558B2Memory system and method for power management for reducing a variable credit value by a computed consumed energy value for each corresponding updated cycle
Publication Date: 2017.06.13 SANDISK TECHNOLOGIES LLC
  • US9678558B2 patent drawing
  • US9678558B2 patent drawing
  • US9678558B2 patent drawing

AI summary

In one embodiment, a memory system is provided comprising at least one memory die, a sensor configured to sense an average amount of power consumed by the memory system over a time period, and a controller. The controller is configured to maintain a token bucket that indicates an amount of power currently available for memory operations in the at least one memory die and is further configured to reduce a number of tokens in the token bucket by an amount of power consumed over the time period as indicated by the average amount of power sensed by the sensor over the time period.