Transient and Prolonged Cache Lists for Track Demotion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cache management systems face challenges in retaining frequently accessed tracks in cache due to evictions caused by read-intensive processes, which degrade I/O performance and pollute the cache with tracks intended for single reads.

Innovation Solution

The implementation of a transient cache list and a prolonged cache list, where tracks are managed based on a demotion hint within a track access request, allowing frequently accessed tracks to remain in cache longer while less frequently accessed tracks are demoted more quickly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If tracks are staged into cache for read-intensive processes, then cache space is utilized for data staging, but frequently accessed tracks are evicted from cache degrading I/O performance

Engineering Contradiction:
Improvecache space utilizationVSAvoidI/O performance
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The cache is segmented into two distinct lists: a prolonged cache list for tracks likely to be frequently accessed and a transient cache list for tracks from read-intensive processes. This segmentation allows the system to differentiate between tracks that should be retained and those that can be quickly evicted, preventing frequent access tracks from being evicted while still utilizing cache space for read-intensive operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different eviction policies are applied to different parts of the cache based on the track's characteristics and access patterns. Tracks in the prolonged cache list receive preferential treatment with slower eviction rates, while tracks in the transient cache list are subject to faster eviction. This local quality approach ensures that frequently accessed tracks maintain high availability while cache space is efficiently utilized.

Inventive Principle:
Principle #3Local quality

2Productivity

If read-intensive processes stage data from storage to cache, then data is made available for processing, but cache is polluted with tracks intended for single reads

Engineering Contradiction:
Improvedata processing rateVSAvoidcache pollution
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The cache is divided into prolonged and transient lists, where the transient cache list specifically accommodates tracks from read-intensive processes. This segmentation isolates potentially polluting tracks into a dedicated area that can be quickly cleared, preventing them from contaminating the prolonged cache list where frequently accessed tracks are stored.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Tracks from read-intensive processes are extracted and placed in the transient cache list, separating them from the main prolonged cache list. This extraction allows the system to handle and evict these tracks independently through faster eviction policies, effectively removing the harmful pollution effect while maintaining productivity benefits.

Inventive Principle:
Principle #2Taking out (Extraction)

3Loss of time

If frequently accessed tracks are retained in cache, then read latency is reduced, but cache space is consumed by tracks that may not be needed

Engineering Contradiction:
Improveread latencyVSAvoidcache space availability
Core Design Contradiction:
Loss of timeVSQuantity of substance

Solution Approach 1:

The cache is segmented into prolonged and transient lists, allowing frequently accessed tracks to be retained in the prolonged list with reduced eviction pressure, while cache space is maintained through faster eviction from the transient list. This segmentation resolves the contradiction by protecting important tracks while still enabling space management.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically manages track retention based on access patterns and cache state. Tracks are demoted from prolonged to transient lists based on usage criteria, and eviction rates are dynamically adjusted between the two lists. This dynamic approach allows frequent access tracks to be retained when needed while freeing space through controlled demotion and eviction from the transient list.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12235775B2Using a transient cache list and prolonged cache list to manage tracks in cache based on a demotion hint with a track access request
Publication Date: 2025.02.25 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12235775B2 patent drawing
  • US12235775B2 patent drawing
  • US12235775B2 patent drawing

AI summary

Provided are a computer program product, system, and method for using a transient cache list and prolonged cache list to manage tracks in cache based on a demotion hint with a track access request. A track is staged into the cache in response to a request for the track. A determination is made as to whether the request provides a demotion hint. The track is indicated in a transient cache list in response to determining that the request provides the demotion hint. The track is indicated in a prolonged cache list in response to determining that the request does not provide the demotion hint. The track is demoted from the cache in response to the request for the track comprising a read request, returning the track to the read request, and the track is indicated in the transient cache list.