Fine-Grained Cache Eviction via Selective Data Element Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional caches lack fine-grained control over data eviction, leading to inefficient data management where important data is unnecessarily flushed, and existing fine-grained interfaces are either unavailable or insufficiently precise, especially when accessing data over a network.

Innovation Solution

Implementing a cache replacement algorithm that allows for selective and forceful eviction of target data from the cache, using deterministic algorithms like LRU or MRU, and employing detailed bookkeeping to optimize reads and writes, ensuring data persistence and security by evicting sensitive information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional cache eviction policies are used, then cache operation is simple, but fine-grained control over data eviction is lost and important data may be unnecessarily flushed

Engineering Contradiction:
Improvecontrol precision over cache evictionVSAvoidcache control mechanism complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The invention segments the cache eviction control into individual data element level, allowing each cache line or data element to be independently tracked and controlled. The bookkeeping mechanism divides the cache into manageable units with individual status flags (valid, dirty, accessed) that can be independently managed, enabling fine-grained eviction decisions without controlling the entire cache at once.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-establishing bookkeeping data structures and status flags for each cache element before eviction is needed. The cache control mechanism proactively tracks access patterns and data validity states in advance, allowing deterministic eviction decisions to be made quickly when needed without complex real-time analysis.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If fine-grained cache control interfaces are implemented, then precise control over data eviction is achieved, but the interfaces become unavailable or insufficient when accessing data over a network

Engineering Contradiction:
Improveeviction control precisionVSAvoidinterface availability across different access scenarios
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The cache replacement algorithm is designed to be universal and work with different access scenarios including network access. The bookkeeping mechanism and eviction policy operate at the cache hardware level regardless of how data is accessed (local or remote), making the fine-grained control interface available and effective across all access types without requiring separate interfaces.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The invention introduces an intermediary bookkeeping layer between the cache hardware and the access interface. This bookkeeping structure mediates between different access scenarios (including network access) and the cache eviction mechanism, translating various access patterns into unified eviction decisions and maintaining fine-grained control availability across all interfaces.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If deterministic cache replacement algorithms are used, then predictable eviction behavior is achieved, but more memory accesses are required to track and manage cache state

Engineering Contradiction:
Improveeviction behavior predictabilityVSAvoidmemory access efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The invention merges the deterministic eviction logic with the existing cache access operations. The bookkeeping updates and eviction decisions are combined with regular cache read/write operations, so that tracking cache state does not require separate memory accesses. The status flags and replacement algorithm operate in conjunction with normal cache traffic, improving efficiency while maintaining predictability.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11436158B2Fine-grained forced cache eviction
Publication Date: 2022.09.06 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11436158B2 patent drawing
  • US11436158B2 patent drawing
  • US11436158B2 patent drawing

AI summary

A computer-implemented method includes using a cache replacement algorithm to forcefully evict target data from a cache. Using the cache replacement algorithm includes selectively accessing data in the cache. A computer program product includes one or more computer readable storage media and program instructions collectively stored on the one or more computer readable storage media. The program instructions include program instructions to perform the foregoing method. A system includes a processor and logic integrated with the processor, executable by the processor, or integrated with and executable by the processor. The logic is configured to perform the foregoing method.