Target-Chip Cache Selection for Shared Accelerator Prefetch

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing processor chips are limited to using their own accelerators, leading to potential interference with existing workloads when sharing accelerators with other chips, and there is a need for efficient data prefetching to minimize this interference.

Innovation Solution

Implementing a processor chip with multiple caches and an interconnect that includes cache-activity monitoring logic to select the least busy cache for prefetching data, allowing local control of data placement to reduce interference with existing workloads.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is prefetched to a cache on the target chip, then accelerator sharing performance is improved, but interference with existing workloads increases

Engineering Contradiction:
Improveaccelerator sharing performanceVSAvoidinterference with existing workloads
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by making different caches have different functions based on their current workload status. The target chip dynamically identifies which cache is least busy and directs prefetch operations to that specific cache, rather than using a fixed cache allocation strategy. This allows the system to optimize accelerator sharing performance while minimizing interference with existing workloads by adapting cache usage to local conditions on the target chip.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If multiple caches are used for prefetching, then data placement flexibility is improved, but system complexity increases

Engineering Contradiction:
Improvedata placement flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the cache resource into multiple independent caches that can be independently managed. The target chip monitors each cache's workload separately and selects the most appropriate cache for prefetch operations. This segmentation provides data placement flexibility while keeping the selection logic relatively simple - the system only needs to identify which cache is least busy rather than managing complex data placement across all caches simultaneously.

Inventive Principle:
Principle #1Segmentation

3Productivity

If external processor controls prefetching, then accelerator utilization is improved, but target chip control capability is reduced

Engineering Contradiction:
Improveaccelerator utilizationVSAvoidtarget chip control capability
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent applies inversion by reversing the traditional control model. Instead of the external processor controlling where data should be prefetched, the target chip autonomously determines the optimal cache location for prefetch operations. The external processor simply initiates prefetch requests, and the target chip's cache-activity monitoring logic independently decides which cache to use. This maintains high accelerator utilization while restoring control capability to the target chip.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS20260044452A1Target chip-controlled data prefetch for accelerator sharing
Publication Date: 2026.02.12 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20260044452A1 patent drawing
  • US20260044452A1 patent drawing
  • US20260044452A1 patent drawing

AI summary

A processor chip includes hardware, multiple processor cores, multiple caches, and an accelerator. The processor chip is configured to receive a prefetch command from an external processor chip. The prefetch command is associated with a request for the external processor chip to utilize the accelerator. The hardware is configured to select one of the multiple caches for storing data that is to be prefetched to facilitate the requested utilization of the accelerator.