Memory Controller Dynamic Correlation for I/O Throughput

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory systems face inefficiencies in data input/output performance due to operational complexity and performance degradation, particularly in handling multiple memory dies, which affects stability and lifespan, and requires unnecessary correlation operations that increase overhead.

Innovation Solution

A memory system with a controller that dynamically determines whether to perform correlation operations based on pending credits and operation states of memory dies, allowing for interleaving data operations across multiple memory dies without address limitations, thereby optimizing resource usage and reducing overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If correlation operations are performed on all read requests to enable interleaving across memory dies, then data input/output performance is improved, but operational overhead and complexity increase

Engineering Contradiction:
Improvedata input/output performanceVSAvoidoperational complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system dynamically determines whether to perform correlation operations based on pending credit values and current operation states of memory dies. This dynamic approach allows the system to adaptively enable or disable correlation operations, optimizing I/O performance when conditions are favorable while reducing overhead when they are not, thus resolving the contradiction between improved productivity and reduced device complexity.

Inventive Principle:
Principle #15Dynamics

2Productivity

If correlation operations are performed on all read requests, then interleaving efficiency is improved, but overhead and processing time increase

Engineering Contradiction:
Improveinterleaving efficiencyVSAvoidprocessing time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs correlation operations only on selected read requests rather than all requests. By using pending credit values to identify suitable candidates for correlation operations, the system applies partial action - performing the beneficial interleaving operation only where and when it will be effective, thereby improving interleaving efficiency without incurring the full overhead of universal correlation processing.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If memory systems use address limitation structures for interleaving operations, then operational stability is improved, but adaptability and resource utilization decrease

Engineering Contradiction:
Improveoperational stabilityVSAvoidresource utilization
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system dynamically selects read requests for correlation operations based on pending credit values and current memory die states, rather than using fixed address limitation structures. This dynamic selection mechanism provides adaptability to different operating conditions and memory configurations, improving resource utilization while maintaining operational stability through controlled correlation operations.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11468926B2Apparatus and method for improving input/output throughput of memory system
Publication Date: 2022.10.11 SK HYNIX INC
  • US11468926B2 patent drawing
  • US11468926B2 patent drawing
  • US11468926B2 patent drawing

AI summary

A memory system includes: a plurality of memory dies, and a controller selects a second read request, including at least a portion of a plurality of first read requests, so that the memory dies interleave and output data corresponding to the first read requests, and performs a correlation operation for the selected second read request, when the second read request is selected, the controller determines whether the correlation operation is performed or not before a time at which the second read request is selected, determines whether the correlation operation is successful or not, determines a pending credit in response to an operation state of the memory dies at the time at which the second read request is selected, and determines whether to perform the correlation operation or not for the second read request that is selected at the time at which the second read request is selected based on the pending credit.