Memory Reclaim Subgroup Reordering for Stable Host IOPS

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory systems face inefficiencies in garbage collection due to non-uniform distribution of valid data, leading to increased spare memory space requirements, reduced bandwidth, and instability in host Input/Output Operations Per Second (IOPS) performance.

Innovation Solution

The solution involves reordering reclaim sub-groups within a memory device to evenly distribute valid data, minimizing spare memory space requirements and stabilizing host IOPS by ensuring uniform bandwidth consumption during garbage collection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If valid data is clumped together in reclaim groups during garbage collection, then the garbage collection process can be simplified, but spare memory space requirements increase and host IOPS performance becomes unstable

Engineering Contradiction:
Improvegarbage collection process complexityVSAvoidspare memory space requirement
Core Design Contradiction:
Device complexityVSQuantity of substance

Solution Approach 1:

The patent divides reclaim groups into multiple reclaim sub-groups and processes them in an interleaved manner rather than as a single clumped unit. This segmentation allows valid data to be distributed across different physical locations in the memory device, reducing the concentration of valid data in any single area and thereby reducing spare memory space requirements during garbage collection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic reordering of reclaim sub-groups based on the distribution of valid data. The system adjusts the processing sequence of reclaim sub-groups adaptively, switching between different reordering strategies depending on the validity distribution pattern detected, which optimizes both spare memory space usage and host IOPS stability.

Inventive Principle:
Principle #15Dynamics

2Device complexity

If valid data is clumped together in reclaim groups, then garbage collection can be performed more simply, but bandwidth is reduced and host IOPS performance deteriorates

Engineering Contradiction:
Improvegarbage collection process complexityVSAvoidhost IOPS performance
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

By segmenting reclaim groups into multiple sub-groups and processing them interleaved, the system maintains multiple data streams during garbage collection. This prevents bandwidth bottlenecks that would occur with clumped processing, thereby maintaining higher host IOPS performance while keeping the garbage collection process manageable through systematic organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs periodic switching between different reclaim sub-groups during garbage collection processing. This periodic action ensures that bandwidth is distributed evenly across different data regions, preventing any single region from becoming a bottleneck and thereby maintaining stable host IOPS performance throughout the garbage collection process.

Inventive Principle:
Principle #19Periodic action

3Quantity of substance

If valid data is not evenly distributed in reclaim groups, then less spare memory space is needed, but garbage collection becomes more complex and harder to manage

Engineering Contradiction:
Improvespare memory space requirementVSAvoidgarbage collection process complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The system dynamically detects the validity distribution pattern in reclaim groups and adaptively selects reordering strategies. When valid data is found to be non-uniformly distributed, the system applies appropriate reordering algorithms to optimize processing, thereby managing the increased complexity through intelligent, condition-based control rather than fixed complex procedures.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback mechanisms that monitor the distribution of valid data during garbage collection operations. Based on this feedback, the system adjusts the processing order of reclaim sub-groups in real-time, optimizing both spare memory space usage and process manageability by responding to actual data conditions rather than following predetermined complex sequences.

Inventive Principle:
Principle #23Feedback

4Device complexity

If valid data is clumped in reclaim groups, then initial garbage collection setup is simpler, but bandwidth consumption becomes non-uniform and system performance destabilizes

Engineering Contradiction:
Improvegarbage collection setup complexityVSAvoidbandwidth consumption uniformity
Core Design Contradiction:
Device complexityVSStability of the object's composition

Solution Approach 1:

The patent segments reclaim groups into multiple sub-groups that are processed in an interleaved fashion. This segmentation inherently distributes bandwidth consumption across multiple data regions, preventing the non-uniform bandwidth patterns that arise from clumped processing, while maintaining relatively simple setup through systematic organization of the segments.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250291720A1Validity distribution for performance uniformity
Publication Date: 2025.09.18 SK HYNIX NAND PRODUCT SOLUTIONS CORP
  • US20250291720A1 patent drawing
  • US20250291720A1 patent drawing
  • US20250291720A1 patent drawing

AI summary

A method and controller for operating a memory system in communication with a host. The method and controller logically arrange a sequence of reclaim sub-groups within a memory device. The method and controller process the reclaim sub-groups according to the sequence to control the memory device to perform garbage collection on the reclaim sub-groups in the memory device. In the sequence, the reclaim sub-groups are processed during the garbage collection such that at least one re-ordered data sequence in the sequence of the reclaim sub-groups being processed has re-ordered valid data that is not clumped.