Reactive Cache Coherence Protocol for Distributed Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Proactive cache coherence management in distributed systems often leads to inefficient remediation efforts, as changes in one cache may result in invalidating data items that are never reused, causing unnecessary processing power consumption and network bandwidth usage.

Innovation Solution

Implementing a reactive cache coherence protocol where a destination endpoint checks cache coherence only upon receiving an indication of a cache hit and performs remediation only when a lack of coherence is detected, replacing the invalidated data item with the replacement data block that triggered the cache hit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If proactive cache coherence management is implemented to monitor and remediate changes in distributed caches, then cache coherence is maintained, but unnecessary processing power and network bandwidth are consumed when cached data items are never reused

Engineering Contradiction:
Improvecache coherenceVSAvoidprocessing power consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The system uses the cache hit indication as a trigger to initiate coherence checking only when needed. The cache itself serves to identify when coherence validation is necessary, rather than having a separate proactive monitoring mechanism continuously check all cached items. This self-triggering approach eliminates unnecessary coherence checks for unused cached data.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The cache coherence management system transitions from a static proactive model (continuous monitoring) to a dynamic reactive model (event-triggered checking). The system adapts its behavior based on actual cache usage patterns, activating coherence checks only when cache hits occur, thereby optimizing resource consumption based on real-time system state.

Inventive Principle:
Principle #15Dynamics

2Reliability

If proactive cache coherence management is implemented to monitor and remediate changes in distributed caches, then cache coherence is maintained, but network bandwidth is consumed for unnecessary remediation communications

Engineering Contradiction:
Improvecache coherenceVSAvoidnetwork bandwidth usage
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The cache hit indication serves as a self-triggering mechanism that activates coherence checking only when cached data is actually used. This eliminates the need for proactive network communications to announce or check coherence of unused cached items, reducing unnecessary network bandwidth consumption.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system dynamically adjusts its network communication behavior based on cache usage. Network bandwidth is consumed for coherence checks only when cache hits occur, rather than maintaining continuous proactive communication channels. This dynamic adaptation reduces overall network traffic while maintaining coherence when necessary.

Inventive Principle:
Principle #15Dynamics

3Productivity

If reactive remediation is performed only upon cache hit indication, then unnecessary remediation work is reduced, but cache coherence may be compromised if not checked properly

Engineering Contradiction:
Improvesystem efficiencyVSAvoidcache coherence
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system implements a feedback mechanism where the cache hit indication triggers a coherence check. This feedback loop ensures that whenever cached data is accessed, its coherence is validated against the source, maintaining reliability while avoiding checks on unused data. The feedback from cache usage directly controls the coherence verification process.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The coherence check is performed as a preliminary action immediately upon receiving a cache hit indication, before the cached data is used. This ensures that coherence is verified in advance of potential use, maintaining reliability while using a reactive trigger rather than continuous monitoring, thus improving productivity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11182295B2Coherence protocol for distributed caches
Publication Date: 2021.11.23 VMWARE INC
  • US11182295B2 patent drawing
  • US11182295B2 patent drawing
  • US11182295B2 patent drawing

AI summary

The disclosure provides for a reactive cache coherence protocol that has efficiencies over proactive approaches. Rather than proactively performing remediation when a data item is invalidated, a destination endpoint checks cache coherence upon receiving an indication of a cache hit, and based at least on detecting a lack of coherence, performs a reactive remediation process. For example, the incoherence may be fixed by replacing, as a cached data item, a data block indicated by the cache hit with a replacement data block that triggered the cache hit.