Programmable Multicast Protocol for Ring-Topology AI Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computing systems face inefficiencies in multicast data transfer in ring-topology based artificial intelligence systems, particularly in high-performance computing environments where simultaneous communication across multiple cores is needed, leading to bandwidth issues and increased energy consumption.
Innovation Solution
The implementation of a programmable multicast protocol that allows data to be sent to disjointed cores in various modes, including sending data on either a clockwise or counter-clockwise multicast ring, replicating data on both rings, or restricting replication, to optimize data transfer and reduce bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multicast data is sent to multiple cores in a ring topology, then communication coverage is improved, but bandwidth consumption increases
Solution Approach 1:
The patent segments the ring topology into two separate multicast rings (first multicast ring and second multicast ring). Instead of sending data through the entire ring to reach all destinations, the system divides the ring and sends data through appropriate segments, reducing the total distance data must travel and thereby reducing bandwidth consumption while maintaining communication coverage.
Solution Approach 2:
The patent applies local quality by allowing different multicast modes (first, second, and third modes) to be selected based on specific communication needs. Each mode optimizes data transmission for different scenarios: unidirectional transmission, bidirectional transmission, or replication, enabling the system to adapt locally to different communication requirements and reduce overall bandwidth consumption.
2Reliability
If multicast data traverses the full ring to reach all cores, then data delivery completeness is improved, but transmission time increases
Solution Approach 1:
By segmenting the ring into two separate multicast rings, the patent enables data to reach all destination cores through shorter paths. The first multicast ring handles data transmission in one direction while the second multicast ring handles transmission in the opposite direction, ensuring complete data delivery without requiring traversal of the entire ring circumference.
Solution Approach 2:
The patent establishes preliminary action by pre-configuring multiple multicast modes and selecting the appropriate mode before data transmission begins. This allows the system to proactively choose the optimal transmission path (unidirectional, bidirectional, or replication mode) based on the destination cores, thereby minimizing transmission time while ensuring complete data delivery.
3Speed
If data is replicated and sent on both multicast rings, then data transfer speed is improved, but bandwidth usage increases
Solution Approach 1:
The patent applies dynamics by making the multicast mode selectable and adaptable based on communication requirements. The system can dynamically switch between first multicast mode (unidirectional), second multicast mode (bidirectional), and third multicast mode (replication) depending on the specific data transfer needs, allowing optimization of both speed and bandwidth usage for different scenarios.
Solution Approach 2:
The patent changes parameters by introducing multiple multicast modes with different transmission characteristics. By adjusting the multicast mode parameter, the system can optimize data transfer speed when replication is needed (third mode) or reduce bandwidth usage when unidirectional transmission suffices (first mode), providing flexible parameter-based optimization.
Data Source
AI summary
Embodiments for providing enhanced multicast data transfer for ring topology based artificial intelligence systems are disclosed. Multicast data is sent to a plurality of disjointed cores in a multicast group according to a first multicast mode, a second multicast mode, or a third multicast mode, where the first multicast mode sends a first half the multicast data on first multicast ring and a second half on a second multicast ring, the second multicast mode sends the multicast data on either the first multicast ring or the second multicast ring, and the third multicast mode replicates the multicast data and sends the multicast data to both the first multicast ring and the second multicast ring.