NOC Snoop Channel Data Forwarding Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In large-scale network-on-chip (NOC) systems, data transmission between peer caches is inefficient, leading to increased power consumption, delay, and reduced bus bandwidth utilization, which affects system performance and stability.
Innovation Solution
A data processing method that includes sending snoop information through a snoop channel to acknowledge data storage status among master devices, optimizing data forwarding based on congestion levels and transmission path lengths, and using cache coherent nodes to maintain data coherence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is transmitted through traditional cache coherence protocols in large-scale NOC systems, then data transmission can be maintained, but transmission efficiency decreases, power consumption increases, and delay increases
Solution Approach 1:
The system performs preliminary actions by sending snoop information to peer caches before actual data transmission to check if they have the required data. This advance checking allows the system to identify potential data sources in advance, enabling direct peer-to-peer data forwarding without going through the cache coherent node, thereby reducing transmission delay and improving efficiency
Solution Approach 2:
The patent introduces snoop information as an intermediary mechanism that mediates between the master device and peer caches. This intermediary carries data state information that enables peer caches to respond to data requests, facilitating efficient direct data forwarding while maintaining cache coherence through the cache coherent node when necessary
2Reliability
If traditional cache coherence protocols are used, then data coherence can be maintained, but power consumption increases
Solution Approach 1:
The patent extracts the data forwarding function from the traditional cache coherence protocol path. By separating the data forwarding operation from the coherence maintenance path, the system enables direct peer-to-peer data transmission for valid data requests, avoiding unnecessary power consumption through the cache coherent node while maintaining coherence through selective use of snoop responses
3Reliability
If data is forwarded through cache coherent nodes, then data coherence is maintained, but bus bandwidth utilization decreases
Solution Approach 1:
The patent segments the data transmission path into two types: direct peer-to-peer forwarding for valid data and cache coherent node routing for coherence maintenance. This segmentation allows bandwidth-intensive data transfers to occur directly between peers without occupying the cache coherent node bandwidth, while coherence maintenance operations continue through the structured path, effectively separating bulk data transfer from control operations
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
Embodiments of the present disclosure provide a data processing method and apparatus, electronic device and storage medium. The data processing method includes: in response to receiving a first read request from a first master device to read first data, sending first snoop information for acknowledging whether a second master device has stored the first data to the second master device through a snoop channel, wherein the first snoop information has a field indicating that the second master device needs to respond to whether the second master device has stored the first data with respect to the first snoop information. In the method, optimization of data forward is implemented by supporting a response message (e.g., ack) to the snoop information sent by the snoop channel, taking into account factors such as power consumption, delay, and network congestion during the data forward process, thereby improving performance and efficiency of the system.