Memory Controller Dynamic Address Limitation for I/O Throughput

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory systems face challenges in improving data input/output performance and operational efficiency due to limitations in addressing and storage strategies, leading to performance degradation and increased overhead in handling multiple memory dies.

Innovation Solution

A memory system that employs a controller to dynamically manage read requests through interleaving operations across multiple memory dies, using a correlation operation based on the number of requests and channel configurations, without relying on strict address limitations, thereby optimizing data distribution and reducing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If strict address limitations are imposed on memory dies, then data access control is simplified, but data input/output throughput decreases and operational efficiency deteriorates

Engineering Contradiction:
Improvedata input/output throughputVSAvoidaddress management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic address limitation values that are adjusted based on the number of active memory dies and channel configurations. Instead of using fixed address limitations, the system dynamically modifies the address limitation value to optimize data distribution across memory dies, thereby improving I/O throughput while maintaining manageable complexity through adaptive control.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the address limitation parameter based on operational conditions. The address limitation value is modified according to the number of memory dies and channel assignments, allowing the system to adapt to different configurations and maximize throughput without requiring complex static addressing schemes.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If multiple memory dies are used to increase storage capacity, then data storage capability is improved, but operational overhead increases and performance degrades

Engineering Contradiction:
Improvestorage capacityVSAvoidoperational overhead
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent segments data distribution across multiple memory dies using channel assignments and dynamic address limitations. Each memory die is assigned specific channels and address ranges, allowing independent management of each die while maintaining overall system efficiency. This segmentation reduces operational overhead by enabling parallel operations without requiring complex coordination between all dies.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The controller implements a universal address limitation mechanism that works across different numbers of memory dies and channel configurations. The same dynamic address limitation algorithm adapts to various system configurations, providing a multi-functional solution that handles different storage capacities without requiring different management approaches, thereby reducing operational overhead.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If interleaving operations are implemented across memory dies, then data distribution is optimized, but control complexity and resource usage increase

Engineering Contradiction:
Improvedata distribution efficiencyVSAvoidresource usage
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent implements periodic interleaving operations where data is distributed across memory dies in a systematic periodic pattern based on channel assignments. The address limitation value is adjusted periodically according to the interleaving depth and number of dies, optimizing data distribution while using simple periodic logic that consumes minimal computational resources.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11487678B2Apparatus and method for improving input/output throughput of a memory system
Publication Date: 2022.11.01 SK HYNIX INC
  • US11487678B2 patent drawing
  • US11487678B2 patent drawing
  • US11487678B2 patent drawing

AI summary

A memory system includes a plurality of memory dies and a controller coupled with the plurality of memory dies via a plurality of channels. The controller is configured to perform a correlation operation on at least some read requests among a plurality of read requests inputted from an external device so that the plurality of memory dies outputs plural pieces of data corresponding to the plurality of read requests via the plurality of channels in an interleaving way. The controller is configured to determine when to perform the correlation operation based on the number of the plurality of read requests.