Cache Metadata Management via Segmented Storage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cache metadata management techniques face challenges in efficiently storing and retrieving data due to high latency and bandwidth consumption, particularly when the size of metadata exceeds the storage capacity of the array, and storing metadata within the cache increases latency and bandwidth usage.

Innovation Solution

The solution involves splitting the storage of metadata between the cache and an array, where dirty information is stored in the cache and validity information is stored in the array, reducing cache latency and bandwidth consumption by minimizing read operations during retrieval and using masked write operations to update metadata.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If metadata is stored in a separate array, then cache retrieval speed is improved, but array storage capacity is exceeded when metadata size is large

Engineering Contradiction:
Improvecache retrieval speedVSAvoidarray storage capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent segments metadata into two distinct parts: validity information (stored in the array) and dirty information (stored in the cache). This segmentation allows the system to optimize storage for each type of metadata separately, enabling the array to store validity bits efficiently while the cache handles dirty information, thereby resolving the capacity limitation without compromising retrieval speed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimensional organization by storing validity information in one dimension (array) and dirty information in another dimension (cache). This dimensional separation transforms the storage architecture from a single-location metadata storage to a distributed two-location system, effectively increasing the overall storage capacity available for metadata while maintaining fast access paths.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If metadata is stored within the cache, then array resources are conserved, but cache latency increases and bandwidth consumption increases

Engineering Contradiction:
Improvearray resourcesVSAvoidcache latency
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

By segmenting metadata storage between the array (validity information) and cache (dirty information), the system avoids the penalty of reading entire metadata from the cache during retrieval operations. The validity check can be performed independently in the array, preventing cache latency from increasing despite conserving array resources.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses validity information stored in the array as an intermediary mechanism to quickly determine whether cache data is valid before initiating cache access. This intermediary validity check prevents unnecessary cache reads, thereby conserving array resources while avoiding the latency penalty of storing all metadata in the cache.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If metadata size exceeds array capacity, then storage flexibility is reduced, but system complexity increases with alternative solutions

Engineering Contradiction:
Improvestorage flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing metadata into validity information (array-stored) and dirty information (cache-stored), creating a scalable architecture that adapts to different metadata sizes. This segmentation provides storage flexibility because each segment can be independently sized and managed, while the overall system complexity remains manageable due to the clear separation of concerns and well-defined access patterns for each segment.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11630781B2Cache metadata management
Publication Date: 2023.04.18 MICRON TECHNOLOGY INC
  • US11630781B2 patent drawing
  • US11630781B2 patent drawing
  • US11630781B2 patent drawing

AI summary

Methods, systems, and devices for cache metadata management in a memory subsystem are described. The memory subsystem may include an interface controller coupled with a non-volatile memory and a volatile memory. The interface controller may use metadata, such as validity information and dirty information, to operate the volatile memory as cache. The interface controller may store the dirty information in the volatile memory and may store the validity information in an array in the interface controller.