Primary Secondary Cache Segmentation for Memory Address Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Memory systems face challenges in achieving a high cache hit rate to ensure high-speed responses to hosts, particularly due to the slower access times of secondary cache memory compared to primary cache memory and nonvolatile memory, which affects performance during data access and garbage collection processes.

Innovation Solution

A memory system configuration that includes a nonvolatile memory, a primary cache memory, and a secondary cache memory, where logical-to-physical address conversion information is stored in the primary cache memory for fast access and in the secondary cache memory for garbage collection processes, using a control circuit for address conversion and managing cache data based on LRU methods to optimize cache hit rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If logical-to-physical address conversion information is stored in secondary cache memory for garbage collection processes, then the system can manage wide-area access data, but the access time increases compared to primary cache memory

Engineering Contradiction:
Improvecapability to manage wide-area access dataVSAvoidaccess time
Core Design Contradiction:
Adaptability or versatilityVSSpeed

Solution Approach 1:

The patent segments the cache memory into two distinct parts: primary cache memory for fast access during data access processes, and secondary cache memory for garbage collection processes. This segmentation allows each cache to be optimized for its specific function, with the primary cache providing fast access for frequently used address conversion information and the secondary cache handling less time-sensitive garbage collection operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an address conversion buffer as an intermediary component between the primary cache memory and the secondary cache memory. This buffer temporarily stores address conversion information, allowing the system to manage data flow efficiently between the two cache levels and reduce the impact of secondary cache access times on overall system performance.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If address conversion information is stored in primary cache memory for fast access, then the cache hit rate improves for data access, but the cache memory capacity is reduced for other uses

Engineering Contradiction:
Improvedata access speedVSAvoidcache memory capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

By dividing the cache memory into primary and secondary segments with distinct functions, the system can allocate appropriate capacity to each segment based on its specific requirements. The primary cache memory can be sized optimally for fast data access operations, while the secondary cache memory provides additional capacity for garbage collection without compromising the speed-optimized primary cache.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If a single cache memory is used for both data access and garbage collection, then the device complexity is reduced, but the cache hit rate decreases due to slower access times

Engineering Contradiction:
Improvecache memory structureVSAvoidcache hit rate
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent implements segmentation of the cache memory system into primary and secondary cache memories, each dedicated to specific operations. This segmentation resolves the contradiction by allowing the primary cache to maintain high hit rates for data access operations while the secondary cache handles garbage collection, thereby achieving both operational efficiency and acceptable system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The address conversion buffer serves multiple functions: it acts as a temporary storage for address conversion information, bridges the primary and secondary cache memories, and helps manage the flow of data between different cache levels. This multi-functionality reduces the need for additional complex control mechanisms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12164420B2Memory system and storage device
Publication Date: 2024.12.10 KIOXIA CORP
  • US12164420B2 patent drawing
  • US12164420B2 patent drawing
  • US12164420B2 patent drawing

AI summary

A memory system of an embodiment includes a nonvolatile memory, a primary cache memory, a secondary cache memory, and a processor. The processor performs address conversion by using logical-to-physical address conversion information relating to data to be addressed in the nonvolatile memory. Based on whether first processing is performed on the nonvolatile memory or second processing is performed on the nonvolatile memory, the processor controls to store whether the logical-to-physical address conversion information relating to the first processing to be in the primary cache memory as cache data or logical-to-physical address conversion information relating to the second processing to be in the secondary cache memory as cache data.