GPU Ethernet Switching Interconnect for Server Bandwidth Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The low bandwidth of PCIe buses and direct interconnections between GPUs limits data transmission efficiency and can lead to congestion, hindering the full potential of GPU computing power.
Innovation Solution
Implementing Ethernet switching chips on a mezzanine board connected via a designated connector to establish Ethernet connections between GPUs, enabling high-bandwidth data transmission using standard Ethernet protocols.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If PCIe buses or direct baseboard interconnections are used to connect GPUs, then the structure is simple and easy to implement, but the bandwidth is limited and data transmission efficiency is reduced
Solution Approach 1:
The patent introduces Ethernet switching chips as an intermediary device between GPUs. These switching chips are integrated on a mezzanine board that connects to the baseboard through a designated connector, providing a high-bandwidth Ethernet-based communication path that mediates data transmission between multiple GPUs while overcoming the bandwidth limitations of direct PCIe or baseboard interconnections
Solution Approach 2:
The patent transitions from traditional PCIe bus interconnection (one-dimensional bus architecture) to Ethernet-based networking (multi-dimensional network architecture). By using Ethernet switching chips and standard Ethernet protocols, the system moves to a networked dimension that provides higher bandwidth and more flexible data transmission paths between GPUs
2Productivity
If Ethernet switching chips are integrated on a mezzanine board, then bandwidth and data transmission efficiency are improved, but the device complexity increases
Solution Approach 1:
The patent uses standard Ethernet switching chips that support universal Ethernet protocols, allowing the same hardware component to serve multiple GPUs and provide flexible data transmission paths. The mezzanine board with Ethernet switching chips can be configured to support different interconnection topologies and protocols, providing multi-functionality that justifies the added complexity
Solution Approach 2:
The patent segments the Ethernet switching functionality from the main baseboard by placing it on a separate mezzanine board. This segmentation allows the Ethernet switching subsystem to be independently configured, maintained, and upgraded without affecting the core baseboard, thereby managing complexity through modular separation
3Productivity
If Ethernet connections are used between GPUs, then bandwidth is increased and congestion is reduced, but the baseboard area increases
Solution Approach 1:
The patent nests the Ethernet switching chips on a mezzanine board that attaches to the existing baseboard structure. The mezzanine board utilizes the vertical space and existing connector infrastructure, effectively nesting the Ethernet switching functionality within the existing server form factor without requiring a complete redesign of the baseboard layout
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
Disclosed are a graphics processing units, GPUs (101-108), interconnection method, device, and a storage medium. The device is applied to a server comprising two or more GPUs (101-108) interconnected with each other by an Ethernet switching chip (201, 202) to establish Ethernet connections, so that in the server, a source GPU (101-108) may determine that data needs to be transmitted to a target GPU (101-108), encapsulates the data to be transmitted based on a standard Ethernet protocol and obtains an Ethernet packet. The source GPU (101-108) sends the Ethernet packet to the Ethernet switching chip (201, 202); then the Ethernet switching chip (201, 202) sends the Ethernet packet to a designated connector. The designated connector sends the Ethernet packet to a destination GPU (101-108).