Elastic Buffer with Scoreboard for Ordered Garbage Collection Writes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory sub-systems experience performance loss and increased latency due to out-of-order writing during garbage collection procedures, which disrupt the sequential nature of data operations.

Innovation Solution

Implementing an elastic buffer with a scoreboard data structure to delay and reorder write commands during garbage collection, ensuring data is written in the same order as it is read, thereby optimizing bandwidth utilization and improving read, write, and erase speeds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If write commands are issued immediately during garbage collection, then processing speed appears fast, but data is written out of order causing performance loss and increased latency

Engineering Contradiction:
Improvewrite speedVSAvoidlatency
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The scoreboard data structure pre-allocates buffer spaces and establishes the correct write order before actual write operations begin. By preparing the buffer allocation and order sequencing in advance (reading data first and recording the sequence), the system avoids the need to reorder data during the write phase, thus eliminating latency while maintaining write speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The elastic buffer acts as an intermediary between the read operation and the write operation. It temporarily stores read data in the correct sequence and releases it for writing in the proper order, decoupling the read and write operations. This mediator buffer resolves the contradiction by ensuring writes occur in order without blocking the fast read operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of time

If an elastic buffer with scoreboard is implemented to maintain write order, then latency is reduced, but device complexity increases

Engineering Contradiction:
ImprovelatencyVSAvoidbuffer management complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The scoreboard data structure is self-managing, automatically tracking buffer allocations and write sequences without requiring external intervention or complex control logic. Each buffer entry records its own state and sequence information, allowing the system to maintain ordered writes through simple, automated bookkeeping rather than complex management mechanisms.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If data is buffered and reordered before writing, then write order is maintained, but processing time increases

Engineering Contradiction:
Improvewrite order accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSDuration of action of moving object

Solution Approach 1:

The system performs the sequencing action during the read phase rather than during the write phase. By recording the correct write order while reading data (preliminary action), the actual write operation can proceed immediately without additional reordering delays, thus maintaining write order accuracy without increasing processing time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250231708A1Elastic buffer for media management of a memory sub-system
Publication Date: 2025.07.17 MICRON TECHNOLOGY INC
  • US20250231708A1 patent drawing
  • US20250231708A1 patent drawing
  • US20250231708A1 patent drawing

AI summary

Methods, systems, and devices for an elastic buffer for a media management operation are described. A plurality of entries associated with a media management operation for a memory sub-system are stored. A first set of one or more write commands associated with the media management operation are buffered using the plurality of entries based on a second set of one or more write commands associated with a host write procedure. The first set of one or more write commands associated with the media management operation are issued based on the plurality of entries and a completion of the second set of one or more write commands associated with the host write procedure.