Memory Write Queue Handling to Preserve Sequentiality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory systems experience increased write amplification and reduced data performance due to the loss of sequentiality in data access requests caused by multicore hardware processors, leading to inefficient garbage collection operations.

Innovation Solution

Process write requests on a memory system based on queue identifiers associated with the requests, using an inline approach to park and coalesce sequential write requests and an offline approach to organize data migration during garbage collection based on common queue identifiers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional memory systems process write requests without queue identifier-based sequentiality maintenance, then device complexity is reduced, but write amplification increases and data performance deteriorates

Engineering Contradiction:
Improvedata performanceVSAvoidqueue identifier processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments write requests into different queues based on queue identifiers (QIDs), allowing each queue to maintain sequentiality independently. This segmentation enables the system to preserve sequential access patterns for each queue while processing requests from multiple queues in parallel, thereby improving data performance without requiring complete sequential processing of all requests.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by pre-establishing queue identifiers and their associated sequentiality constraints before write requests arrive. The system pre-organizes write requests into queues based on their QIDs, enabling efficient sequential processing without requiring complex real-time analysis during request processing.

Inventive Principle:
Principle #10Preliminary action

2Loss of energy

If write requests are processed to maintain sequentiality using queue identifiers, then write amplification is reduced, but garbage collection overhead increases

Engineering Contradiction:
Improvewrite amplificationVSAvoidgarbage collection overhead
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The patent performs preliminary actions during normal write request processing by maintaining queue identifier-based sequentiality and organizing data migration during garbage collection. By pre-establishing the sequential order of writes and using queue identifiers to track data locations, the system can perform more efficient garbage collection operations that require less overhead.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses queue identifiers as feedback mechanisms to track the sequentiality of write requests and the locations of migrated data. This feedback information is used by the garbage collection process to optimize its operations, reducing the time and resources required for garbage collection by leveraging the sequentiality information already maintained during normal operation.

Inventive Principle:
Principle #23Feedback

3Productivity

If sequentiality is maintained in data access requests through queue identifiers, then data performance is improved, but device complexity increases

Engineering Contradiction:
Improvedata performanceVSAvoidrequest processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the request processing system into multiple queues, each associated with a unique queue identifier. This segmentation allows the system to maintain sequentiality within each queue independently, simplifying the processing logic for each queue while enabling parallel processing across multiple queues. The complexity is distributed rather than concentrated in a single sequential processing path.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20260037170A1Processing write requests based on queue identifier
Publication Date: 2026.02.05 MICRON TECHNOLOGY INC
  • US20260037170A1 patent drawing
  • US20260037170A1 patent drawing
  • US20260037170A1 patent drawing

AI summary

Various embodiments provide for processing write requests on a memory system based on queue identifiers associated with the write requests. In particular, input data streams can be received and stored by submission queues of a memory system, and write requests in the input data streams can be separated and processed based on queue identifiers associated with the submission queues using an inline approach for writing data on the memory system, an offline approach for writing data on the memory system, or both.