Dual Cache Mapping for Lower-Latency Logical Address Reads

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data storage systems face inefficiencies in cache management, leading to increased I/O latency and performance penalties due to cache misses and the overhead of maintaining mapping cache coherency, especially in log-structured systems where write operations invalidate mapping cache entries, causing additional latency.

Innovation Solution

Implement a dual-cache system comprising a data cache and a mapping cache, where the mapping cache is accessed before the data cache, and stale entries are not evicted during write operations, using a hash table with descriptors for efficient mapping and validation, reducing the need for additional overhead processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a single cache is used to store both data and mapping information, then cache capacity is maximized, but cache performance deteriorates due to false evictions where mapping entries are evicted along with data entries

Engineering Contradiction:
Improvecache capacityVSAvoidcache hit accuracy
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent divides the cache into two separate caches: a data cache for storing data entries and a mapping cache for storing mapping entries. This segmentation prevents false evictions by independently managing the lifecycle of data and mapping information, ensuring that evicting one type does not affect the other.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a cache manager as an intermediary component that coordinates between the data cache and mapping cache. The cache manager handles allocation, eviction, and validation operations, ensuring proper synchronization and preventing conflicts between the two caches while maintaining efficient access patterns.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If mapping cache entries are invalidated during write operations to maintain coherency, then data consistency is improved, but I/O latency increases due to additional validation overhead

Engineering Contradiction:
Improvedata consistencyVSAvoidI/O latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts the validation logic from the critical I/O path by implementing asynchronous validation mechanisms. Validation operations are performed separately from the main data access path, allowing write operations to complete without waiting for full validation while still ensuring data consistency through background verification processes.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary validation by maintaining version counters and checksums that are updated alongside data writes. This allows for rapid validation of mapping cache entries without requiring full data verification, reducing the time penalty for maintaining cache coherency during write operations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12530292B2Caching techniques using a mapping cache and a data cache
Publication Date: 2026.01.20 DELL PROD LP
  • US12530292B2 patent drawing
  • US12530292B2 patent drawing
  • US12530292B2 patent drawing

AI summary

Caching techniques can include: receiving, from a host, a read I/O operation requesting to read current content of a logical address; determining whether a data cache includes a data cache entry corresponding to the logical address; responsive to determining the data cache includes the data cache entry corresponding to the logical address, performing data cache hit processing to service the read I/O operation using the data cache entry; responsive to determining the data cache does not include the data cache entry corresponding to the logical address, performing data cache miss processing including: determining whether a mapping cache includes a descriptor corresponding to the logical address; and responsive to determining the mapping cache includes the descriptor corresponding to the logical address, performing mapping cache hit processing to service the read I/O operation using the descriptor of the mapping cache.