Packet Arbitration in Co-Packaged ICs for Idle-Cycle Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing arbitration schemes in co-packaged integrated circuits do not maximize the use of bandwidth due to factors like minimum spacing requirements between command and data packets, leading to idle cycles and inefficient data transfer.
Innovation Solution
Implementing an arbitration circuit that selectively uses a Least Recently Granted (LRG) scheme when a previous cycle had a winning packet, and a non-LRG scheme when no packet was previously selected, along with lower-level arbitration circuits that apply weighted arbitration based on counter values and channel weights to optimize packet selection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If minimum spacing requirements are enforced between command and data packets, then packet transmission order is maintained, but bandwidth utilization decreases due to idle cycles
Solution Approach 1:
The arbitration circuit dynamically switches between LRG and non-LRG schemes based on real-time detection of frequency differences between local and remote buses. When frequency difference exceeds a threshold, the circuit transitions to non-LRG scheme to allow command packets to be transmitted immediately without waiting for minimum spacing, thereby eliminating idle cycles while maintaining proper packet ordering through the dynamic arbitration mechanism.
Solution Approach 2:
The system changes the arbitration parameter (scheme selection) based on the frequency difference condition. When the frequency difference between local and remote buses exceeds a predetermined threshold, the arbitration circuit switches from LRG to non-LRG scheme, allowing immediate packet transmission and optimizing bandwidth utilization under varying frequency conditions.
2Productivity
If LRG scheme is used to maximize bandwidth utilization, then idle cycles are reduced, but packet ordering may be compromised under certain frequency conditions
Solution Approach 1:
The arbitration circuit continuously monitors the frequency difference between local and remote buses and uses this feedback to determine which arbitration scheme to employ. When the frequency difference exceeds a threshold, the feedback mechanism triggers a switch to the non-LRG scheme, ensuring that packet ordering requirements are met while maximizing bandwidth utilization when frequency conditions allow LRG operation.
3Device complexity
If fixed arbitration scheme is used, then implementation is simple, but bandwidth utilization is not optimized under varying frequency conditions
Solution Approach 1:
Rather than using a fixed arbitration scheme, the circuit dynamically adapts its behavior based on detected frequency differences. The arbitration circuit incorporates frequency detection capability and automatically switches between LRG and non-LRG schemes, adding dynamic adaptability that optimizes bandwidth utilization without requiring overly complex manual configuration.
Data Source
AI summary
In an embodiment, a computer system comprises one or more co-packaged integrated circuits having a communication fabric that couples various agent circuits. The agent circuits transmit packets via the communication fabric, which can include command-data packets and command packets. In various embodiments, the communication fabric includes an arbitration circuit to arbitrate among packets to transmit on the fabric. The arbitration circuit may select a winning packet from one or more packets during an arbitration cycle based on a history of previously selected packets. The arbitration circuit may selectively implement, upon receiving a command packet and a command-data packet during a particular arbitration cycle and based on frequencies of particular buses of the communication fabric, one of at least two different arbitration schemes to select a winning packet for the arbitration cycle when an immediately preceding attribution cycle has no winning packet.