Memory Sub-System Write Merging for Sequential Stream Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory sub-systems face inefficiencies due to increased write amplification and latency when using larger translation units for non-volatile memory devices, leading to reduced performance, lifespan, and reliability.

Innovation Solution

A memory sub-system controller merges write command data with sequential write stream data using a read look-ahead operation to pre-fetch and buffer data, forming merged data equal to the translation unit size, thereby reducing unnecessary write operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If larger translation units are used for non-volatile memory devices, then data access efficiency is improved, but write amplification increases and latency increases

Engineering Contradiction:
Improvedata access efficiencyVSAvoidwrite amplification
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system performs read look-ahead operations to pre-fetch data before it is needed for write operations. By anticipating future write commands and preparing data in advance, the system reduces the need for additional write amplification while maintaining efficient data access with larger translation units.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary buffer that receives pre-fetched data from read look-ahead operations and merges it with write command data. This buffer acts as a mediator between the host system and non-volatile memory, allowing efficient data transfer without increasing write amplification.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If larger translation units are used for non-volatile memory devices, then data access efficiency is improved, but latency increases

Engineering Contradiction:
Improvedata access efficiencyVSAvoidlatency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

By performing read look-ahead operations that pre-fetch data before it is needed, the system eliminates waiting time during write operations. The data is already prepared in the buffer when write commands arrive, significantly reducing latency despite using larger translation units.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous data flow by merging pre-fetched data with write commands in a seamless manner. The buffer continuously receives and merges data, ensuring that write operations proceed without interruption or waiting, thus maintaining high productivity while reducing latency.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If larger translation units are used for non-volatile memory devices, then data access efficiency is improved, but device lifespan decreases

Engineering Contradiction:
Improvedata access efficiencyVSAvoiddevice lifespan
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system converts the potential harm of increased write amplification into a benefit by using read look-ahead operations to pre-fetch data. This approach reduces the number of actual write operations to the non-volatile memory device, thereby extending device lifespan while maintaining efficient data access through larger translation units.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The intermediary buffer serves as a protective layer between the host system and the non-volatile memory device. By merging pre-fetched data with write commands in the buffer, the system reduces the frequency and intensity of direct write operations to the memory device, extending its operational lifespan while maintaining high data access efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20250355596A1Memory sub-system for merging write command data with sequential write stream data
Publication Date: 2025.11.20 MICRON TECHNOLOGY INC
  • US20250355596A1 patent drawing
  • US20250355596A1 patent drawing
  • US20250355596A1 patent drawing

AI summary

Various aspects of the present disclosure relate to a memory sub-system for merging sequential write stream data. A processor associated with the memory sub-system may receive a write command that indicates to write data to a memory device, where a size of the data is smaller than a translation unit size. The processor may determine that the write command is associated with a sequential write stream. The processor may generate a read command that indicates to read other data associated with the sequential write stream from the memory device. The processor may execute a read operation associated with the read command to read the other data from the memory device. The processor may merge the data and the other data to form merged data. The processor may execute a program operation to write the merged data to the memory device.