Memory Subsystem Automatic Rate Control for Fluctuating Workloads

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory sub-systems face performance instability due to uneven balances between host system write rates and garbage collection processes, particularly under fluctuating workload conditions, leading to inadequate storage capacity and unstable performance.

Innovation Solution

Implementing automatic rate control through a time-based credit mechanism that determines and adjusts host and garbage collection rates based on identified workload conditions, ensuring a balanced flow of operations and maintaining stable performance across varying conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional memory sub-systems operate without automatic rate control, then the system can handle simple workload conditions, but performance becomes unstable under fluctuating workload conditions due to uneven balances between host system write rates and garbage collection processes

Engineering Contradiction:
Improveperformance stabilityVSAvoidadaptability to fluctuating workload conditions
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic rate control that automatically adjusts the garbage collection rate based on real-time workload conditions. The controller monitors host system write rates and dynamically modifies garbage collection parameters to maintain balanced operation, transforming the static garbage collection process into an adaptive system that responds to changing workload demands.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback mechanisms where the controller continuously monitors the balance between host write operations and garbage collection processes. Based on this feedback, the controller automatically adjusts garbage collection rates to prevent performance degradation, ensuring that garbage collection does not overwhelm the host system while maintaining sufficient free blocks available.

Inventive Principle:
Principle #23Feedback

2Quantity of substance

If the garbage collection process runs at high rate to maintain free storage capacity, then storage capacity availability is improved, but host system performance deteriorates due to excessive interrupt operations

Engineering Contradiction:
Improvefree storage capacityVSAvoidhost system write performance
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The patent dynamically changes garbage collection parameters including rate, priority, and scheduling based on host system conditions. When host write performance is high, the controller reduces garbage collection intensity; when free capacity becomes low, it increases garbage collection activity. This parameter adaptation resolves the contradiction by adjusting garbage collection behavior to match host system capabilities.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs partial garbage collection actions rather than exhaustive operations. Instead of continuously running garbage collection at maximum rate, the controller executes garbage collection at optimized partial rates that maintain sufficient free capacity without excessively interrupting host operations, achieving adequate free space with minimal performance impact.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If automatic rate control is implemented to balance host and garbage collection rates, then performance stability is improved, but device complexity increases due to additional control mechanisms

Engineering Contradiction:
Improveperformance stabilityVSAvoidcontrol mechanism complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The controller performs self-service by automatically monitoring its own operational state and adjusting garbage collection rates without external intervention. The system autonomously detects imbalances between host writes and garbage collection, and self-corrects by modifying its own scheduling parameters, reducing the need for complex external control infrastructure.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The controller integrates multiple functions into a single component: it manages host write operations, monitors free capacity levels, executes garbage collection, and performs rate control adjustments. This multi-functionality consolidates what could be separate complex systems into one unified controller, managing complexity while maintaining performance stability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11960740B2Implementing automatic rate control in a memory sub-system
Publication Date: 2024.04.16 MICRON TECHNOLOGY INC
  • US11960740B2 patent drawing
  • US11960740B2 patent drawing
  • US11960740B2 patent drawing

AI summary

A processing device in a memory system identifies a workload condition associated with a memory device. The processing device determines a host rate associated with the memory device based on the workload condition. The processing device detects a change in a condition of the memory device from a first state condition to a second state condition. The processing device determines, while the memory device is in the second state condition, an adjusted host rate, wherein the adjusted host rate is used to determine a credit consuming rate for a host operation.