Storage System Cache Management via Dual Replacement Lists

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current storage systems face inefficiencies in cache management, particularly in reducing the promotion counts of data from storage devices to caches and improving cache hit rates, especially in scenarios with burst access to infrequently used data or cyclic access patterns.

Innovation Solution

A method and device for managing a storage system that involves determining the storage position of target data, identifying elements from replacement lists based on access counts and frequencies, and updating their positions to prioritize high-frequency accessed cache pages, thereby reducing unnecessary data promotion and enhancing cache utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional cache replacement policies are used, then cache management is simple, but the hit rate is low and promotion counts are high

Engineering Contradiction:
Improvecache hit rateVSAvoidcache management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The replacement list is segmented into multiple sub-lists (first replacement list for data in storage device, second replacement list for cache pages) with different management strategies. Each sub-list tracks specific metrics (access counts for storage device data, access frequencies for cache pages) enabling differentiated replacement decisions that improve hit rate without overwhelming complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The cache management system dynamically adjusts replacement priorities based on real-time access patterns. Elements are promoted from first to second replacement list when accessed, and positions within lists are dynamically updated based on access frequency, creating an adaptive system that improves hit rate while maintaining manageable complexity through automated dynamic adjustment

Inventive Principle:
Principle #15Dynamics

2Reliability

If data is frequently promoted from storage device to cache, then cache hit rate increases, but promotion counts increase and system efficiency decreases

Engineering Contradiction:
Improvecache hit rateVSAvoidsystem efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-tracking access counts for data in the storage device before promotion occurs. The first replacement list maintains counting elements that record access frequencies in advance, allowing the system to predict which data is likely to be accessed and prioritize its promotion only when beneficial, reducing unnecessary promotions while maintaining high hit rate

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where access patterns are continuously monitored and used to adjust replacement decisions. The replacement lists provide feedback about which data elements are being accessed frequently, enabling the system to learn from past access patterns and make informed promotion decisions that maximize hit rate while minimizing unnecessary data movement

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11288210B2Method, device and computer program product for managing storage system
Publication Date: 2022.03.29 EMC IP HLDG CO LLC
  • US11288210B2 patent drawing
  • US11288210B2 patent drawing
  • US11288210B2 patent drawing

AI summary

Techniques manage a storage system. In accordance with such techniques, an access request for target data is received; a storage position of the target data is determined, the storage position indicating one of a storage device and a cache; a target element corresponding to the target data is determined from a first replacement list and a second replacement list associated with the first replacement list based on the storage position, the first replacement list including at least a counting element, the counting element indicating an access count of data in the storage device, the second replacement list including a low-frequency access element, the low-frequency access element indicating a cache page with a low access frequency in the cache; and a position of the target element in a replacement list where the target element exist is updated. Therefore, the overall performance of the storage system can be improved.