Switching Fabric Timing Control for Tile Data Exchange
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In processor architectures with multiple tiles, existing bulk synchronous parallel (BSP) computing protocols face challenges in ensuring time determinism and efficient data exchange between tiles, leading to suboptimal performance in machine intelligence applications where large graphs require parallel processing.
Innovation Solution
A computer system with a switching fabric and a supervisor thread that manages data exchange between tiles using time deterministic switching instructions, allowing for precise control over data packet transmission and reception, ensuring that data is exchanged at predetermined times without headers or destination identifiers, and utilizing a compiler to generate programs that optimize workload distribution across tiles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional BSP computing protocols are used for data exchange between tiles, then data exchange can be performed between tiles, but time determinism cannot be guaranteed and performance is suboptimal
Solution Approach 1:
The patent applies preliminary action by pre-configuring switching fabric connections and pre-synchronizing tiles before data exchange operations. The supervisor thread establishes switching paths in advance and coordinates tile operations to ensure time-deterministic data exchange, eliminating runtime negotiation overhead and ensuring predictable performance for machine intelligence workloads.
2Ease of operation
If headers and destination identifiers are included in data packets, then data routing between tiles is simplified, but transmission time increases and performance decreases
Solution Approach 1:
The patent extracts and removes headers and destination identifiers from data packets exchanged between tiles. The supervisor thread maintains external routing information and directs data flow, allowing tiles to exchange only pure data payloads. This eliminates redundant packet overhead and reduces transmission time while maintaining simplified routing through supervisor coordination.
3Reliability
If a supervisor thread is introduced to manage data exchange, then time deterministic guarantees can be achieved, but system complexity increases
Solution Approach 1:
The supervisor thread performs multiple functions including synchronization coordination, switching fabric control, data exchange management, and timing coordination. By consolidating these diverse control functions into a single multi-functional supervisor thread, the patent achieves time-deterministic guarantees without proportionally increasing system complexity, as the supervisor replaces multiple separate control mechanisms.
Data Source
AI summary
A computer program comprising a sequence of instructions for execution on a processing unit having instruction storage for holding the computer program, an execution unit for executing the computer program and data storage for holding data, the computer program comprising: a switch control instruction which when executed causes the processing unit to control switching circuitry to connect a set of connection wires of the processing unit to a switching fabric to receive a data packet at a predetermined received time, the switch control instruction comprising a delay control field which holds a value defining a delay between issuance of the instruction in the sequence of instructions and its execution by the execution unit.