Network Multicasting with Alternate Directives to Reduce Congestion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing network communication technologies face challenges in efficiently multicasting communications to multiple targets while managing network congestion and maintaining data order, particularly in systems with complex interconnectivity like GPU-to-GPU links.

Innovation Solution

The implementation of switching circuitry that selects alternate sets of directives for multicasting transactions, utilizing a routing data structure to manage internal switches and outbound switches, and employing interconnect conductors to reduce serialization costs and ensure data order, thereby optimizing communication pathways.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional multicasting is used to send communications to multiple targets, then the source device only needs to send the communication once, but the number of rounds required to transmit data increases and network congestion occurs

Engineering Contradiction:
Improvemulticasting efficiencyVSAvoidnumber of transmission rounds
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent segments the multicasting process into multiple stages: (1) The source device sends the communication once to the routing device, (2) The routing device creates multiple copies and distributes them to different outbound switches, (3) Each outbound switch independently forwards to multiple targets. This segmentation allows parallel transmission across multiple paths, reducing the total number of sequential rounds needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension of parallelism by utilizing multiple outbound switches and interconnect conductors simultaneously. Instead of sequential one-to-many transmission, the system creates a many-to-many parallel transmission structure where multiple routing paths operate concurrently, effectively adding spatial parallelism to the multicasting process.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If multiple copies of the communication are sent to multiple targets, then multicasting reaches multiple targets efficiently, but network congestion and load distribution issues arise

Engineering Contradiction:
Improvemulticasting reachabilityVSAvoidnetwork congestion
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent applies local quality by assigning different outbound switches to different subsets of targets based on network conditions and load characteristics. Each outbound switch handles specific target groups with optimized transmission parameters, allowing local adaptation to network congestion patterns and enabling differentiated quality of service across different target segments.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The routing device monitors network conditions and dynamically adjusts the distribution of communication copies across different outbound switches. By implementing feedback mechanisms that track network load and congestion levels, the system can reallocate transmission paths in real-time, preventing congestion buildup and optimizing load distribution across the network infrastructure.

Inventive Principle:
Principle #23Feedback

3Speed

If complex interconnect systems like GPU-to-GPU links are used, then communication pathways are optimized, but maintaining data order becomes more difficult

Engineering Contradiction:
Improvecommunication speedVSAvoiddata order
Core Design Contradiction:
SpeedVSStability of the object's composition

Solution Approach 1:

The patent implements preliminary action by establishing dedicated interconnect conductors and routing paths before data transmission begins. The system pre-configures the multicasting topology, assigns target groups to specific outbound switches, and prepares transmission queues in advance. This preliminary setup ensures that even with complex parallel pathways, data packets maintain their intended order through pre-established routing rules and sequence management structures.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP4213459B1Network multicasting using alternate sets of directives
Publication Date: 2025.07.02 NVIDIA CORP
  • EP4213459B1 patent drawingFigure 1
  • EP4213459B1 patent drawingFigure 2
  • EP4213459B1 patent drawingFigure 3

AI summary

Apparatuses, systems, and techniques to multicast a transaction to a group of targets. In at least one embodiment, a set is selected from alternate sets of directives associated with the group of targets, and the transaction is transmitted to the group of targets in accordance with the selected set.