Coherent Agent Mediator for Accelerator Memory Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In multi-core systems, hardware accelerators lack a coherent view of caches and storage locations, leading to redundant work and issues with data access, as they are not supported by existing coherency protocols, resulting in potential data corruption and inefficiencies.
Innovation Solution
Implementing a coherent agent that tracks and enforces coherency across multiple components, including hardware accelerators, using snooping requests and state information management to ensure that all processing components observe the same memory space and access data without risk of corruption, by providing unique or shared access based on the state of data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If hardware accelerators are added to improve system performance, then processing speed and productivity increase, but data coherency and reliability deteriorate because accelerators are not supported by existing coherency protocols
Solution Approach 1:
A coherent agent is introduced as an intermediary component that mediates between hardware accelerators and the coherency protocol. The coherent agent receives coherency requests from accelerators, translates them into appropriate actions, and ensures that accelerator operations maintain data coherency with the rest of the system, thereby enabling accelerators to participate in the coherency domain without requiring protocol modification
2Speed
If accelerators operate independently to maintain fast access speed, then processing efficiency improves, but redundant work increases because accelerators lack a coherent view of caches and storage locations
Solution Approach 1:
The coherent agent establishes a feedback mechanism where accelerators report their memory access operations to the coherent agent, which then monitors cache and storage states. Based on this feedback, the coherent agent can inform accelerators about data location and validity, allowing accelerators to avoid redundant work by operating with knowledge of the current coherent state while maintaining fast access speeds
Data Source
AI summary
The coherency of data can be maintained even for accelerators that may not directly support, or be part of, a coherency protocol or domain. A pair of agents can be utilized that include an application accelerator agent and a coherent agent. The coherent agent can support the coherency protocol and track coherency information for data in the coherency environment, to ensure coherent access to the data. The application accelerator agent can work with the coherent agent to obtain the data according to the coherency protocol, then perform operations on the data corresponding to a respective application or process. Such an approach enables an accelerator to function like a processor or processor core that otherwise supports the coherency protocol and is part of the coherency domain. A single coherent agent can be used to maintain coherency information for multiple other components or agents.