Memory Controller Map Cache Hit Miss Parallel Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory systems take a long time to determine the processing order of requests and read map data necessary for processing, leading to inefficiencies in handling multiple requests.

Innovation Solution

A memory system and controller that differentiate between hit and miss requests based on a map cache, allowing for parallel processing of map data read operations for miss requests and user data read operations for hit requests, optimizing the use of multiple planes and memory cell arrays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If conventional memory systems process requests sequentially to determine processing order and read map data, then processing accuracy is maintained, but processing time increases significantly

Engineering Contradiction:
Improverequest processing timeVSAvoidparallel processing control complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent segments requests into two distinct categories: hit requests (where map data exists in cache) and miss requests (where map data must be read from memory device). This segmentation enables different processing paths - hit requests can proceed immediately while miss requests trigger parallel map data read operations, thereby reducing overall processing time without excessive complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a map cache that pre-loads and stores map data segments in the memory controller before they are actually needed for request processing. This preliminary action allows the system to quickly determine hit/miss status and enables parallel processing of map data reads for miss requests, significantly reducing the time spent on determining processing order

Inventive Principle:
Principle #10Preliminary action

2Productivity

If the system performs parallel map data read operations for miss requests, then processing speed increases, but the complexity of managing multiple planes and operations increases

Engineering Contradiction:
Improverequest processing throughputVSAvoidparallel operation management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent utilizes the plane dimension of the memory device to enable parallel operations. By distributing map data across multiple planes and performing read operations on different planes simultaneously for miss requests, the system increases processing throughput while managing complexity through spatial distribution rather than temporal sequencing

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Speed

If the system caches map segments in the memory controller, then map data access speed improves, but the memory controller's memory resources are consumed

Engineering Contradiction:
Improvemap data access speedVSAvoidmemory controller memory resources
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent implements a map cache with a specific capacity (e.g., 64 KB) within the memory controller that selectively stores frequently accessed map data segments. This local caching provides fast access for hit requests while the system manages the trade-off by only caching a portion of total map data, thus improving speed for common cases while limiting resource consumption

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11137942B2Memory system, memory controller, and method of operating a memory system for determining a number of hit and miss requests about map segments in a map cache and determining whether or not to perform data read operation in parallel
Publication Date: 2021.10.05 MIMIRIP LLC
  • US11137942B2 patent drawing
  • US11137942B2 patent drawing
  • US11137942B2 patent drawing

AI summary

Embodiments of the present disclosure relate to a memory system, a memory controller, and an operation method. The embodiments receive a plurality of requests for a memory device, determine the number of hit requests and the number of miss requests with respect to the plurality of received requests, and determine whether or not to perform all or some of map data read operations for the respective miss requests in parallel and whether or not to perform all or some of user data read operations for the respective hit requests in parallel, thereby minimizing the time required for processing the plurality of requests.