Dynamic SLC Cache Management for Memory Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional memory devices face limitations in increasing memory density and reducing power consumption, as they rely on fixed configurations of single-level cell (SLC) and multi-level cell (MLC) settings, which do not adapt to varying device activity levels, leading to suboptimal performance and energy efficiency.

Innovation Solution

The implementation of a customizable SLC cache mechanism within memory devices, where the proportion of SLC to MLC cells can be dynamically adjusted based on usage patterns and activity thresholds, allowing data to be written directly to MLC storage when device activity is low to conserve power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the memory device uses a fixed configuration of SLC and MLC cells, then the device structure is simple and easy to manufacture, but the device cannot adapt to varying activity levels, resulting in suboptimal performance and energy efficiency

Engineering Contradiction:
Improveadaptability to varying device activity levelsVSAvoidcomplexity of dynamic reconfiguration mechanism
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a dynamic SLC cache size adjustment mechanism that automatically modifies the proportion of SLC cache relative to total memory capacity based on real-time device activity monitoring. The controller continuously tracks activity metrics and adjusts cache allocation dynamically, transforming a static memory configuration into an adaptive system that optimizes performance and energy efficiency according to actual usage patterns.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates a feedback loop where the controller monitors device activity levels and uses this information to adjust the SLC cache size accordingly. When activity exceeds a threshold, the cache size is increased to improve performance; when activity is low, the cache size is reduced to conserve energy. This closed-loop control mechanism enables the memory device to self-optimize based on actual operating conditions.

Inventive Principle:
Principle #23Feedback

2Speed

If the proportion of SLC cache is increased to maintain high-speed performance, then write speed is improved, but power consumption increases

Engineering Contradiction:
Improvewrite speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent dynamically adjusts the SLC cache proportion based on monitored device activity levels. When write activity exceeds a predetermined threshold, the system increases the SLC cache size to maintain high-speed performance. When activity is below the threshold, the system reduces the cache size to minimize power consumption. This dynamic adjustment allows the device to optimize the speed-power trade-off in real-time according to actual usage demands.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameter of cache size based on activity conditions. By modifying the proportion of SLC cache dynamically rather than maintaining a fixed configuration, the device can adapt its performance and power characteristics to match actual workload requirements, achieving high speed when needed and low power consumption when activity is minimal.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If the memory device uses MLC configuration for all cells, then storage capacity is maximized, but write speed and performance decrease

Engineering Contradiction:
Improvestorage capacityVSAvoidwrite speed
Core Design Contradiction:
Quantity of substanceVSSpeed

Solution Approach 1:

The patent segments the memory device into two distinct regions: an SLC cache pool with high-speed write capability and an MLC storage pool with high storage capacity. The controller intelligently directs write operations to the appropriate pool based on activity levels and cache availability. This segmentation allows the device to simultaneously achieve high speed for active data and high capacity for overall storage, resolving the contradiction between speed and capacity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The SLC cache acts as an intermediary buffer between the host and the MLC storage pool. When write activity is high, data is first written to the fast SLC cache, which then gradually transfers data to the MLC storage pool in the background. This intermediary mechanism allows the device to maintain high write speeds for active operations while ultimately achieving high storage capacity through the MLC pool, effectively bridging the speed-capacity gap.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11635899B2SLC cache management
Publication Date: 2023.04.25 MICRON TECHNOLOGY INC
  • US11635899B2 patent drawing
  • US11635899B2 patent drawing
  • US11635899B2 patent drawing

AI summary

Disclosed in some examples are memory devices which feature customizable Single Level Cell (SLC) and Multiple Level Cell (MLC) configurations. The SLC memory cells serve as a high-speed cache providing SLC level performance with the storage capacity of a memory device with MLC memory cells. The proportion of cells configured as MLC vs the proportion that are configured as SLC storage may be configurable, and in some examples, the proportion may change during usage based upon configurable rules based upon memory device metrics. In some examples, when the device activity is below an activity threshold, the memory device may skip the SLC cache and place the data directly into the MLC storage to reduce power consumption.