Chip Multiprocessor Cooperative Caching Eviction Rate Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High core-count chip multiprocessors experience network flooding due to cascading evictions and replacements in cooperative caching systems, leading to increased network traffic and instability.
Innovation Solution
The cooperative caching system in a chip multiprocessor is managed by monitoring the eviction rate of data blocks from private caches, with the system being disabled when the aggregate eviction rate exceeds a predetermined threshold to prevent network flooding, implemented in two phases: halting new data replication and converting caches to local-write only to stop the cascading cycle.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If cooperative caching is enabled in high core-count chip multiprocessors, then cache hit rate and performance are improved, but network flooding occurs due to cascading evictions and replacements
Solution Approach 1:
The patent implements a feedback mechanism by monitoring the eviction rate of data blocks from private caches. When the aggregate eviction rate exceeds a predetermined threshold, the system detects potential network flooding conditions and responds by disabling the cooperative caching system, thereby preventing harmful network flooding while maintaining performance benefits during normal operation
Solution Approach 2:
The cooperative caching system is designed to dynamically adjust its operation based on real-time eviction rate conditions. The system transitions between enabled and disabled states according to whether the aggregate eviction rate remains below or exceeds the threshold, allowing adaptive prevention of network flooding while preserving cache performance benefits during stable conditions
2Productivity
If data blocks are frequently evicted and replaced in cooperative caching, then cache utilization is maximized, but system stability deteriorates due to cascading evictions
Solution Approach 1:
The system takes preliminary anti-action by monitoring eviction rates and disabling the cooperative caching system before cascading evictions can fully develop. By detecting when the aggregate eviction rate exceeds the threshold, the system preemptively prevents the harmful cascading effect from occurring, thereby maintaining system stability while allowing normal cache operations to maximize utilization during stable conditions
Data Source
AI summary
Techniques described herein generally include methods and systems related to cooperatively caching data in a chip multiprocessor. Cooperatively caching of data in the chip multiprocessor is managed based on an eviction rate of data blocks from private caches associated with each individual processor core in the chip multiprocessor. The eviction rate of data blocks from each private cache in the cooperative caching system is monitored and used to determine an aggregate eviction rate for all private caches. When the aggregate eviction rate exceeds a predetermined value, for example the threshold beyond which network flooding can occur, the cooperative caching system for the chip multiprocessor is disabled, thereby avoiding network flooding of the chip multiprocessor.