Target-Chip Cache Selection for Shared Accelerator Prefetch
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing processor chips are limited to using their own accelerators, leading to potential interference with existing workloads when sharing accelerators with other chips, and there is a need for efficient data prefetching to minimize this interference.
Innovation Solution
Implementing a processor chip with multiple caches and an interconnect that includes cache-activity monitoring logic to select the least busy cache for prefetching data, allowing local control of data placement to reduce interference with existing workloads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is prefetched to a cache on the target chip, then accelerator sharing performance is improved, but interference with existing workloads increases
Solution Approach 1:
The patent applies local quality by making different caches have different functions based on their current workload status. The target chip dynamically identifies which cache is least busy and directs prefetch operations to that specific cache, rather than using a fixed cache allocation strategy. This allows the system to optimize accelerator sharing performance while minimizing interference with existing workloads by adapting cache usage to local conditions on the target chip.
2Adaptability or versatility
If multiple caches are used for prefetching, then data placement flexibility is improved, but system complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the cache resource into multiple independent caches that can be independently managed. The target chip monitors each cache's workload separately and selects the most appropriate cache for prefetch operations. This segmentation provides data placement flexibility while keeping the selection logic relatively simple - the system only needs to identify which cache is least busy rather than managing complex data placement across all caches simultaneously.
3Productivity
If external processor controls prefetching, then accelerator utilization is improved, but target chip control capability is reduced
Solution Approach 1:
The patent applies inversion by reversing the traditional control model. Instead of the external processor controlling where data should be prefetched, the target chip autonomously determines the optimal cache location for prefetch operations. The external processor simply initiates prefetch requests, and the target chip's cache-activity monitoring logic independently decides which cache to use. This maintains high accelerator utilization while restoring control capability to the target chip.
Data Source
AI summary
A processor chip includes hardware, multiple processor cores, multiple caches, and an accelerator. The processor chip is configured to receive a prefetch command from an external processor chip. The prefetch command is associated with a request for the external processor chip to utilize the accelerator. The hardware is configured to select one of the multiple caches for storing data that is to be prefetched to facilitate the requested utilization of the accelerator.


