Credit-Based Memory Throttling for Power and Thermal Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Memory systems face challenges in efficiently adjusting performance based on usage conditions such as power consumption and temperature, leading to potential overheating and excessive power usage.

Innovation Solution

A memory system comprising a first nonvolatile memory, a first processor, and a second processor, where the first processor sets a credit assignment amount, and the second processor performs access calculations and notifies the first processor when the credit is exhausted, allowing the system to transition to a snooze mode to limit operations and adjust performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the memory system operates at high performance, then productivity is improved, but power consumption and temperature rise excessively

Engineering Contradiction:
Improvememory system performanceVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by using a credit-based throttling mechanism where the memory controller alternates between normal operation and snooze mode. Credits are consumed during high-performance operations and replenished during idle periods, creating a periodic cycle of active and inactive states that regulates power consumption while maintaining productivity

Inventive Principle:
Principle #19Periodic action

2Productivity

If the memory system operates at high performance, then productivity is improved, but temperature rises excessively

Engineering Contradiction:
Improvememory system performanceVSAvoidmemory system temperature
Core Design Contradiction:
ProductivityVSTemperature

Solution Approach 1:

The periodic credit-based throttling creates cycles of high-performance operation followed by snooze periods, allowing the memory system to dissipate heat during inactive phases while maintaining productivity during active phases. This periodic action prevents continuous overheating

Inventive Principle:
Principle #19Periodic action

3Use of energy by moving object

If the memory system limits operations to reduce power consumption, then power consumption is reduced, but productivity decreases

Engineering Contradiction:
Improvepower consumptionVSAvoidmemory system performance
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The patent applies dynamics by implementing a dynamic credit-based control mechanism that adjusts memory operation performance based on real-time conditions. The credit assignment amount and consumption rate dynamically regulate the transition between normal and snooze modes, allowing the system to optimize the balance between power consumption and productivity rather than operating in a fixed limited state

Inventive Principle:
Principle #15Dynamics

4Temperature

If the memory system limits operations to reduce temperature, then temperature is reduced, but productivity decreases

Engineering Contradiction:
Improvememory system temperatureVSAvoidmemory system performance
Core Design Contradiction:
TemperatureVSProductivity

Solution Approach 1:

The dynamic credit-based control mechanism adjusts the frequency and duration of snooze modes based on thermal conditions and workload requirements, enabling the system to maintain an optimal balance between temperature control and productivity rather than permanently limiting operations

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11693592B2Memory system
Publication Date: 2023.07.04 KIOXIA CORP
  • US11693592B2 patent drawing
  • US11693592B2 patent drawing
  • US11693592B2 patent drawing

AI summary

A memory system includes a first nonvolatile memory, a first processor, and a second processor. The first processor sets a first assignment amount. The second processor performs access to the first nonvolatile memory, calculates a consumed amount which is an amount according to an operation time of the first nonvolatile memory in the access, and transmits a notification to the first processor when the consumed amount reaches the first assignment amount.