Memory Subsystem Program Resume Delay for Read Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory sub-systems experience increased read operation latency and reduced throughput due to longer program times in mixed write and read workload environments, where read operations are forced to wait for in-progress program operations to complete, negatively impacting Quality of Service (QoS) metrics.

Innovation Solution

Implementing a program suspend operation to pause in-progress write operations in response to read requests, allowing immediate servicing of read operations and establishing a program suspend delay period to optimize operational efficiency and meet QoS targets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the memory sub-system waits for program operations to complete before servicing read operations, then program operation integrity is maintained, but read operation latency increases

Engineering Contradiction:
Improveprogram operation integrityVSAvoidread operation latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by checking whether a program operation has completed before allowing a read operation to proceed. This is implemented through the delay period mechanism that proactively prevents read operations from being issued during ongoing program operations, thereby maintaining data integrity while managing read latency through controlled timing

Inventive Principle:
Principle #10Preliminary action

2Reliability

If read operations are queued during program operations, then data integrity is preserved, but throughput decreases

Engineering Contradiction:
Improvedata integrityVSAvoidthroughput
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies dynamics by making the read operation handling adaptive based on the program operation status. The system dynamically adjusts between immediate read servicing and queuing reads during program operations, with the delay period providing a controlled transition mechanism that optimizes throughput while preserving data integrity

Inventive Principle:
Principle #15Dynamics

3Loss of time

If program suspend operations are implemented to service read requests immediately, then read latency is reduced, but system complexity increases

Engineering Contradiction:
Improveread latencyVSAvoidoperation management complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent applies periodic action through the implementation of a delay period that is triggered by program resume operations. This periodic mechanism systematically prevents new program operations from being initiated for a specified duration, providing a structured and manageable approach to reducing read latency while controlling system complexity through predictable timing intervals

Inventive Principle:
Principle #19Periodic action

4Productivity

If a delay period is established after program resume operations, then re-suspension efficiency is improved, but program operation completion time increases

Engineering Contradiction:
Improvere-suspension efficiencyVSAvoidprogram operation completion time
Core Design Contradiction:
ProductivityVSDuration of action of moving object

Solution Approach 1:

The patent applies partial action by implementing a delay period that is selectively applied only after program resume operations, not after all program operations. This targeted approach optimizes re-suspension efficiency by preventing unnecessary delays in cases where no read operations are pending, while still providing the efficiency benefits when reads are queued, thereby balancing re-suspension optimization with overall program completion time

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11507317B2Establishing a delay period associated with a program resume operation of a memory subsystem
Publication Date: 2022.11.22 MICRON TECHNOLOGY INC
  • US11507317B2 patent drawing
  • US11507317B2 patent drawing
  • US11507317B2 patent drawing

AI summary

A program operation is executed on a memory sub-system. In response to receiving a request to execute a read operation, executing a first program suspend operation to suspend the program operation. In response to a completion of the read operation, a program resume operation is executed to resume execution of the program operation. A delay period is established following execution of the program resume operation during which execution of the program operation is completed. A second program suspend operation is executed following the delay period.