Cache Eviction Using Compression Block Age

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing cache systems in data processing systems, such as graphics processing systems, face inefficiencies in cache eviction policies, particularly when caching compressed data. This can lead to redundant compression operations and increased processing requirements.

Innovation Solution

Implementing a cache eviction policy that takes into account the age of compression blocks when selecting cache entries for eviction. This approach prioritizes evicting cache entries associated with older compression blocks, reducing the likelihood of triggering compression operations before processing is complete.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If data is cached in decompressed form to reduce memory transfer, then processing speed is improved, but redundant compression operations occur when cache entries are evicted

Engineering Contradiction:
Improveprocessing speedVSAvoidprocessing resources
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent tracks the age of compression blocks before eviction occurs. By maintaining age information and using it to guide eviction decisions, the system performs preliminary assessment to avoid triggering redundant compression operations, thus preserving processing resources while maintaining fast access to decompressed data.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If cache entries are evicted based on standard policies, then cache management is simple, but redundant compression operations are triggered

Engineering Contradiction:
Improvecache management complexityVSAvoidcompression operation efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent implements a feedback mechanism where the age of compression blocks is tracked and fed back into the eviction decision process. This feedback loop allows the cache management system to adapt its eviction choices based on compression block age, reducing redundant compression operations while maintaining manageable system complexity.

Inventive Principle:
Principle #23Feedback

3Productivity

If older cache entries are evicted preferentially, then cache utilization is improved, but processing of active compression blocks may be interrupted

Engineering Contradiction:
Improvecache utilization efficiencyVSAvoidprocessing continuity
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

By continuously tracking compression block age and using this information in eviction decisions, the system achieves better cache utilization while maintaining processing continuity. The feedback mechanism ensures that eviction decisions are made with knowledge of the current compression block state, preventing interruptions to active processing.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12306764B2Cache systems with age-based eviction
Publication Date: 2025.05.20 ARM LTD
  • US12306764B2 patent drawing
  • US12306764B2 patent drawing
  • US12306764B2 patent drawing

AI summary

A method of operating a cache system is disclosed. When it is desired to evict a cache entry from the cache, a cache entry to evict from the cache is selected using an age of any compression block that the cache is caching data for, and the selected cache entry is evicted from the cache.