Memory Controller Map Caching via Command Segment Queuing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory controllers face inefficiencies in map caching, leading to suboptimal performance in processing command segments and address mapping, which affects the overall speed and efficiency of memory operations.

Innovation Solution

A memory controller architecture that includes a host interface controller, a first queue, a second queue, and a cache memory, where command segments are generated, stored, and transferred between queues, with target map segments being cached in the cache memory to improve caching performance and reduce latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If map segments are cached in the cache memory, then memory operation speed is improved, but device complexity increases due to additional cache management components

Engineering Contradiction:
Improvememory operation speedVSAvoiddevice complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent implements a nested cache structure where the cache memory is integrated within the memory controller, and map segments are nested within the cache memory. This hierarchical nesting allows fast access to frequently used map segments while maintaining a compact overall structure that doesn't excessively increase device complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent employs preliminary caching of map segments in the cache memory before they are needed for memory operations. By pre-loading and maintaining map segments in the cache, the system prepares address translation data in advance, enabling faster memory operations without requiring complex real-time translation mechanisms.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If cache memory is used to store map segments, then productivity is improved, but loss of time occurs due to cache management overhead

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidcache management overhead time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The cache memory is designed to automatically manage map segments through self-service mechanisms. The cache controller autonomously handles loading, storing, and managing map segments in the cache memory without requiring extensive external control or manual intervention, thereby reducing the time lost to management overhead while maintaining high processing efficiency.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11436148B2Memory controller and method of operating the same
Publication Date: 2022.09.06 SK HYNIX INC
  • US11436148B2 patent drawing
  • US11436148B2 patent drawing
  • US11436148B2 patent drawing

AI summary

A memory controller may include a host interface controller, a first queue, a second queue, and a cache memory. The host interface controller may be configured to generate, based on a request received from a host, one or more command segments corresponding to the request. The first queue may be configured to store the one or more command segments. The second queue may be configured to store a target command segment from among the one or more command segments. The memory controller caches a target map segment corresponding to the target command segment into the cache memory in response to the target command segment being transferred from the first queue to the second queue.