CXL Switching Device for Synchronizing Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The synchronization process in high-bandwidth applications, such as large AI models, often leads to bottlenecks and congestion between devices, increasing computation latency due to the need for central data synchronization.
Innovation Solution
A Compute Express Link (CXL)-based system that includes multiple CXL processing devices performing matrix multiplication calculations and a CXL switching device that synchronizes output vector data by performing calculations based on interrupt signals and packets, providing synchronized data to the processing devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data synchronization is performed through a central device, then data consistency across devices is achieved, but computation latency increases due to bottlenecks and congestion
Solution Approach 1:
The patent segments the centralized synchronization function into distributed synchronization operations performed by individual processing devices. Each device independently synchronizes its local cache with other devices' caches, eliminating the single-point bottleneck and reducing computation latency while maintaining data consistency through distributed coordination.
Solution Approach 2:
The patent introduces a new dimension of operation by enabling peer-to-peer synchronization between processing devices rather than strictly hierarchical synchronization through a central device. This adds direct communication paths between devices, creating multiple synchronization routes and reducing congestion on any single path.
2Ease of operation
If data is transmitted through a central device for synchronization, then centralized control is maintained, but congestion occurs between devices
Solution Approach 1:
The patent segments the data transmission paths by enabling direct peer-to-peer communication between processing devices for synchronization operations. This distributes the transmission load across multiple independent paths rather than concentrating all traffic through a central device, eliminating congestion while maintaining coordinated control through the switching device.
Solution Approach 2:
The patent uses the switching device as an intelligent intermediary that enables direct peer-to-peer synchronization between processing devices without requiring data to physically traverse through a central processing device. The switching device mediates the synchronization process by routing data directly between source and destination devices, maintaining centralized coordination while improving transmission efficiency.
Data Source
AI summary
Various example embodiments may include methods of operating a network device, non-transitory computer readable media including computer readable instructions for operating a network device, systems including a network device, and/or a compute express link (CXL) switching device for synchronizing data. A CXL-based system includes a plurality of CXL processing devices configured to perform matrix multiplication calculation based on input vector data and a partial matrix, and output at least one interrupt signal and at least one packet based on results of the matrix multiplication calculation, the at least one packet including output vector data and characteristic data associated with the output vector data, and a CXL switching device configured to, synchronize the output vector data, the synchronizing including performing a calculation operation on the output vector data based on the interrupt signal and the packet, and provide the synchronized vector data to the plurality of CXL processing devices.