Cache Memory Ghost List Write-Back Timing Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cache memory systems face challenges in determining the optimal timing for write-back operations, leading to potential discarding of updated data instead of unused data, which lowers cache hit rates and can reduce the lifespan of storage devices like SSDs due to frequent write-backs.

Innovation Solution

The implementation of a Ghost list in conjunction with a cache replacement policy like ARC, where the number of consecutive Dirty pages is counted, and if entries from the Ghost list are more frequently accessed than those from the normal list, the Dirty page is written back, optimizing the write-back timing to improve cache hit rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If write-back operations are performed frequently to maintain cache hit rates, then cache performance is improved, but storage device lifespan is reduced due to excessive write operations

Engineering Contradiction:
Improvecache hit rateVSAvoidstorage device lifespan
Core Design Contradiction:
ReliabilityVSDuration of action of stationary object

Solution Approach 1:

The system monitors access patterns to evicted data in the Ghost list and uses this feedback to dynamically adjust write-back timing. When accessed data is found in the Ghost list, the system triggers a write-back operation, creating a closed-loop control system that optimizes write timing based on actual usage patterns rather than fixed intervals.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The Ghost list pre-stores metadata about evicted data before actual eviction occurs. This preliminary tracking allows the system to quickly determine whether accessed data should trigger a write-back, enabling proactive write-back decisions before data is completely discarded, thus balancing cache performance with storage device protection.

Inventive Principle:
Principle #10Preliminary action

2Duration of action of stationary object

If write-back operations are delayed to extend storage device lifespan, then storage device lifespan is improved, but cache hit rate decreases due to loss of updated data

Engineering Contradiction:
Improvestorage device lifespanVSAvoidcache hit rate
Core Design Contradiction:
Duration of action of stationary objectVSReliability

Solution Approach 1:

The system continuously monitors access patterns and uses this feedback to determine the optimal write-back timing. By tracking whether evicted data is subsequently accessed, the system can delay write-backs when unnecessary while triggering them when needed, thus extending storage device lifespan without sacrificing cache hit rate.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The write-back policy is made dynamic through the Ghost list mechanism. Instead of fixed timing, the system adapts write-back decisions based on real-time access patterns. This dynamic approach allows the system to extend storage device lifespan by delaying writes when safe, while maintaining cache hit rate by triggering writes when accessed data is detected.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If simple cache replacement policies are used to reduce complexity, then device complexity is reduced, but cache performance deteriorates due to suboptimal eviction decisions

Engineering Contradiction:
Improvecache replacement mechanism complexityVSAvoidcache hit rate
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The Ghost list acts as an intermediary structure between the cache and storage device. It stores metadata about evicted data without requiring complex replacement algorithms in the main cache. This intermediary mechanism enables sophisticated write-back decisions based on access patterns while keeping the core cache replacement logic relatively simple.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The cache system is segmented into the main cache, the Ghost list for tracking evicted data, and the storage device. This segmentation allows each component to have specialized functionality: the main cache handles active data, the Ghost list tracks evicted data patterns, and the storage device provides persistent storage. This segmentation enables improved cache performance without proportionally increasing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10296466B2Information processing device, method of controlling a cache memory, and storage medium
Publication Date: 2019.05.21 FUJITSU LTD
  • US10296466B2 patent drawing
  • US10296466B2 patent drawing
  • US10296466B2 patent drawing

AI summary

A device includes: a cache memory configured to store a first list and a second list, and a processor. The first list includes one or more entries that include any one of data pieces in a storage device and information indicating a location of the data piece on the storage device, and the second list includes one or more entries that include information indicating a location of an already discarded data piece on the storage device, the already discarded data piece having been included in an entry that has been evicted from the first list. The processor counts a count number of entries including data pieces updated and being consecutive from an eviction target entry when updating data piece of an entry in the first list, and writes data of a target entry in the storage device and discards the data from the cache memory based on a certain rule.