Ethernet card, communication module and server
By introducing a cross-interconnection design of multiple network card chips and connectors into the Ethernet card, the problem of synchronous task interruption caused by optical module failure is solved, and the efficiency of multi-GPU parallel computing is improved.
Patent Information
- Application Number
- CN202410950126.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-15
- Publication Date
- 2026-01-16
AI Technical Summary
In a multi-GPU parallel computing architecture, failure of the optical module in the network link can cause the synchronous task to be interrupted, affecting the execution efficiency of the entire task.
Design an Ethernet card that includes multiple network card chips and connectors. The connectors are connected to at least two network card chips to achieve cross-interconnection between the network card chips and optical modules, so that optical module failures only affect a portion of the bandwidth without interrupting communication.
It reduces the impact of optical module or optical link failures on multi-GPU parallel computing tasks and improves task execution efficiency.
Smart Images

Figure CN121357442A_ABST
Abstract
Description
Technical Field
[0001] This application relates to computer technology, and more particularly to an Ethernet card, a communication module, and a server. Background Technology
[0002] In complex tasks such as training large AI models, multiple graphics processing units (GPUs) are typically used for parallel computation. After completing one round of computation, they begin to communicate with each other to synchronize the computation results. The next round of computation can only begin after all GPUs have completed the synchronization of computation results, and this process continues until the entire task is completed.
[0003] Currently, in multi-GPU parallel computing architectures, one GPU is typically configured to correspond to one network card, which is connected to an optical module. This optical module forms an optical link with the optical module on the switch. The GPUs communicate with each other through the network link to achieve synchronization of computing results.
[0004] If a network link fails during the communication process of synchronizing computation results, such as a failure of the optical module of a switch or a network card, it will affect the synchronization task of the GPU corresponding to that network link. This will affect all GPUs from starting the next stage of computation, severely impacting the overall execution efficiency of the task. Summary of the Invention
[0005] This application provides an Ethernet card, a communication module, and a server to address the problem in multi-GPU parallel computing architectures where a failure of the optical module in the network link affects the synchronous task of the GPU corresponding to that network link, thus affecting all GPUs from starting the next stage of computation and severely impacting the overall task execution efficiency.
[0006] In a first aspect, this application provides an Ethernet card, comprising:
[0007] Multiple network interface card (NIC) chips and multiple connectors, the connectors being used to connect optical modules;
[0008] Each of the connectors is connected to at least two of the network interface card (NIC) chips, and each of the NIC chips is connected to at least two of the connectors.
[0009] In an alternative embodiment, the connector includes a plurality of first ports for transmitting electrical signals, and the connector is connected to at least two of the network interface card chips through the plurality of first ports;
[0010] The network interface card (NIC) chip includes multiple second ports, and the NIC chip is connected to at least two of the connectors through the multiple second ports.
[0011] In an alternative embodiment, the plurality of first ports of any of the connectors are respectively connected to different network interface card (NIC) chips, wherein the number of the plurality of NIC chips is greater than or equal to the number of the first ports of any of the connectors.
[0012] In an optional embodiment, the number of first ports of any connector is equal to the number of the plurality of network interface card (NIC) chips, and any connector is connected to the plurality of NIC chips respectively through the plurality of first ports;
[0013] The number of second ports of any of the network interface cards (NICs) is equal to the number of the plurality of connectors, and each of the NICs is connected to the plurality of connectors through the plurality of second ports respectively.
[0014] In one alternative embodiment, the number of connectors is greater than or equal to the number of network interface card (NIC) chips.
[0015] Secondly, this application provides an Ethernet card, comprising:
[0016] Multiple network interface card (NIC) chips and multiple connectors, the connectors being used to connect optical modules;
[0017] Each of the connectors is connected to one of the plurality of network interface card (NIC) chips, and each of the NIC chips is connected to one of the plurality of connectors.
[0018] In an optional embodiment, the connector includes a plurality of first ports for transmitting electrical signals, the number of the first ports of the connector being equal to the number of the plurality of network interface card (NIC) chips, and any one of the connectors is connected to the plurality of NIC chips respectively through the plurality of first ports;
[0019] The network interface card (NIC) chip includes multiple second ports, the number of which is equal to the number of connectors. Each NIC chip is connected to the multiple connectors through the multiple second ports.
[0020] In one optional embodiment, the Ethernet card includes: four network card chips and four connectors, the connectors being used to connect to an optical module;
[0021] Each of the connectors is connected to one of the four network interface card (NIC) chips, and each of the NIC chips is connected to one of the four connectors.
[0022] In one alternative embodiment, the Ethernet card includes: four network card chips and eight connectors, the connectors being used to connect to an optical module;
[0023] Each of the connectors is connected to one of the four network interface card (NIC) chips, and each of the NIC chips is connected to one of the eight connectors.
[0024] Thirdly, this application provides a communication module, including:
[0025] Multiple optical modules, and an Ethernet card as described in any of the foregoing aspects;
[0026] The plurality of optical modules are respectively connected to the plurality of connectors of the Ethernet card.
[0027] Fourthly, this application provides a GPU server, comprising:
[0028] Multiple GPUs, and the Ethernet card described in either aspect;
[0029] The plurality of GPUs correspond to the plurality of network interface cards (NICs) in the Ethernet card, and each GPU transmits data through its corresponding NIC chip, wherein any NIC chip corresponds to at least one GPU.
[0030] In an optional embodiment, the GPU server further includes a plurality of optical modules, each of which is connected to a plurality of connectors of the Ethernet card.
[0031] Fifthly, this application provides a server, comprising:
[0032] Multiple processors, multiple optical modules, and Ethernet cards as described in any of the foregoing aspects;
[0033] The plurality of optical modules are respectively connected to the plurality of connectors of the Ethernet card.
[0034] The plurality of processors correspond to the plurality of network interface cards (NICs) in the Ethernet card, and each processor transmits data through its corresponding NIC, wherein any NIC corresponds to at least one processor.
[0035] The Ethernet card, communication module, and server provided in this application include multiple network card chips and multiple connectors, with the connectors used to connect optical modules. Each connector connects to at least two network card chips, and each network card chip connects to at least two connectors. A single network card integrates multiple independent network card chips and multiple connectors. By connecting to at least two network card chips via any connector and connecting to at least two connectors via any network card chip, multiple network card chips are cross-interconnected with multiple optical module connectors. This allows the electrical channels of multiple network card chips to be cross-aggregated on multiple connectors. When an optical module on a link connected to any connector fails, only a portion of the bandwidth of the connected network card chip is affected, without causing communication interruption for any network card chip. This reduces the impact of optical module or optical link failures on multi-GPU parallel computing tasks and improves the efficiency of multi-GPU parallel computing tasks. Attached Figure Description
[0036] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0037] Figure 1 A schematic diagram of the architecture of a traditional Ethernet card in a GPU server provided in an embodiment of this application;
[0038] Figure 2 A schematic diagram of the structure of an Ethernet card provided in an exemplary embodiment of this application;
[0039] Figure 3 A schematic diagram of the structure of an Ethernet card provided as another exemplary embodiment of this application;
[0040] Figure 4 A schematic diagram of the structure of an Ethernet card provided in yet another exemplary embodiment of this application;
[0041] Figure 5 A schematic diagram of the structure of an Ethernet card provided in yet another exemplary embodiment of this application;
[0042] Figure 6 A schematic diagram of the structure of an Ethernet card provided in yet another exemplary embodiment of this application;
[0043] Figure 7 A schematic diagram of the structure of an Ethernet card provided in yet another exemplary embodiment of this application;
[0044] Figure 8 A schematic diagram of the structure of an Ethernet card provided in yet another exemplary embodiment of this application;
[0045] Figure 9 A schematic diagram of the structure of an Ethernet card provided in yet another exemplary embodiment of this application;
[0046] Figure 10 A schematic diagram of a typical Ethernet card structure is provided for an exemplary embodiment of this application;
[0047] Figure 11 A schematic diagram of another typical Ethernet card structure provided for an exemplary embodiment of this application;
[0048] Figure 12 A schematic diagram of the structure of a communication module provided in an exemplary embodiment of this application;
[0049] Figure 13 A schematic diagram of a typical communication module provided for an exemplary embodiment of this application;
[0050] Figure 14 A schematic diagram of the structure of a GPU server provided in an exemplary embodiment of this application;
[0051] Figure 15 A schematic diagram of the structure of a GPU server provided in another exemplary embodiment of this application;
[0052] Figure 16 This is a schematic diagram of the structure of a server provided for an exemplary embodiment of this application.
[0053] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation
[0054] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.
[0055] It should be noted that the user information (including but not limited to user device information, user attribute information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with relevant laws, regulations and standards, and corresponding operation entry points are provided for users to choose to authorize or refuse.
[0056] First, let me explain the terms used in this application:
[0057] Ethernet switches: used for building data center networks and forwarding messages between servers, based on the Ethernet protocol.
[0058] Ethernet network interface card (NIC): also known as Ethernet card or network card, it is used by servers to connect to Ethernet switches, thereby enabling the transmission of data packets between servers.
[0059] Optical module: A photoelectric conversion module used for long-distance communication, used in conjunction with optical fiber.
[0060] Large models refer to deep learning models with a massive number of parameters, typically containing hundreds of millions, tens of billions, or even trillions of parameters. Large models are also known as foundation models (FM), which are pre-trained on large-scale unlabeled corpora to produce pre-trained models with hundreds of millions of parameters. These models can adapt to a wide range of downstream tasks and have good generalization ability. Examples include Large Language Models (LLMs) and Multi-modal Pre-training Models.
[0061] In practical applications, large models only require a small number of samples to fine-tune the pre-trained model before they can be applied to different tasks. Large models can be widely used in fields such as Natural Language Processing (NLP) and Computer Vision. Specifically, they can be applied to computer vision tasks such as Visual Question Answering (VQA), Image Captioning (IC), and Image Generation, as well as NLP tasks such as text-based sentiment classification, text summarization, and machine translation. The main application scenarios for large models include digital assistants, intelligent robots, search, online education, office software, e-commerce, and intelligent design.
[0062] With the development of large-scale AI models, they have been widely applied in various fields and scenarios. In complex scenarios such as training large-scale AI models, multiple GPUs are typically used for parallel computation. After completing one round of computation, they begin to communicate with each other to synchronize the computation results. The next round of computation can only continue after all GPUs have completed the synchronization of computation results, and this process is repeated until the entire training task is completed.
[0063] In multi-GPU parallel computing architectures, each GPU is typically configured with a dedicated network interface card (NIC). This NIC connects to an optical module, which in turn forms an optical link with an optical module on a switch. GPUs communicate with each other via this network link to synchronize computation results. If the network link corresponding to a GPU fails—for example, if the optical module on the switch or the Ethernet NIC malfunctions—the link will be interrupted, affecting the synchronization task of the GPU connected to that link. This, in turn, will prevent all GPUs from starting the next stage of computation, severely impacting the overall task's execution efficiency.
[0064] Therefore, multi-GPU parallel computing tasks such as AI large model training are very sensitive to link failures. Failure of the optical module connected to the switch or network card port can cause the multi-GPU parallel computing task to be interrupted, thus affecting training efficiency.
[0065] For example, consider a server configured with 8 GPUs and an Ethernet card with a bandwidth of 400G. Figure 1 As shown, a typical configuration is one GPU corresponding to one 400G Ethernet card (containing a network card chip). The Ethernet card is connected to the optical module. The four 100G electrical signals of the Ethernet card are transmitted to the corresponding optical module. The optical module connected to the Ethernet card is connected to the optical module on the switch through an optical link (such as optical fiber or optical channel), forming a network link for the GPU to communicate with the switch. Figure 1 The code uses eight different numbers, "#1, #2, #3, #4, #5, #6, #7, #8", to distinguish different GPUs and their corresponding Ethernet cards and network interface cards (NICs). The Ethernet card and NIC chip corresponding to a GPU share the same number as the GPU; for example, Ethernet card #1 corresponds to GPU #1, and Ethernet card #1 includes NIC chip #1. The other numbers serve the same purpose, and the steps will be detailed here.
[0066] if Figure 1 If the optical module connected to the network card chip #1 in the network link corresponding to GPU #1 fails, or if the optical module of the switch on the network link fails, the network link for GPU #1 to interact with the outside world will be completely interrupted. This will prevent GPU #1 from synchronizing the calculation results, which in turn will affect all GPUs from starting the next stage of calculation, seriously affecting the execution efficiency of the entire task.
[0067] This application provides a novel Ethernet card, comprising: multiple network interface card (NIC) chips and multiple connectors, wherein the connectors are used to connect optical modules; any connector is connected to at least two NIC chips, and any NIC chip is connected to at least two connectors. The Ethernet card provided in this embodiment integrates multiple independent NIC chips and multiple connectors in a single NIC. By connecting any connector to at least two NIC chips and any NIC chip to at least two connectors, the multiple NIC chips are cross-interconnected with multiple optical module connectors, allowing the electrical channels of the multiple NIC chips to be cross-aggregated on multiple connectors. When an optical module on a link connected to any connector fails, only a portion of the bandwidth of the connected NIC chip is affected, without causing communication interruption for any NIC chip. This reduces the impact of optical module or optical link failures on multi-GPU parallel computing tasks and improves the efficiency of multi-GPU parallel computing tasks.
[0068] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.
[0069] Figure 2 This is a schematic diagram of the structure of an Ethernet card provided for an exemplary embodiment of this application. Figure 2 As shown, the Ethernet card 20 provided in this application includes multiple network card chips 21 and multiple connectors 22.
[0070] Connector 22 is used to connect the optical module. Figure 2 The dashed box in the diagram indicates that connector 22 can connect to an optical module; the Ethernet card 20 itself does not include an optical module. Connector 22 of the Ethernet card 20 can be packaged in the same form as the optical module to be connected, including but not limited to OSFP (Octal Small Form Factor Pluggable), QSFP-DD (Quad Small Form Factor Pluggable-Double Density), QSFP (Quad Small Form Factor Pluggable), and OSFP-XD (Octal Small Form Factor Pluggable-Extra Density). The specific form of connector 22 in the Ethernet card 20 can be determined based on the form of the optical module to be connected in the actual application scenario; this embodiment does not impose a specific limitation.
[0071] In this embodiment, in order to distinguish between the optical module connected to the Ethernet card 20 and the optical module of the switch, the optical module connected to the Ethernet card 20 (that is, the optical module connected to the connector 22 in the Ethernet card 20) is called the first optical module, and the optical module of the switch (that is, the optical module connected to the first optical module in the same optical fiber) is called the second optical module.
[0072] like Figure 2As shown, in the Ethernet card 20 provided in this embodiment, any connector 22 is connected to at least two network interface card (NIC) chips 21, and any NIC chip 21 is connected to at least two connectors 22. This connection method can distribute the communication bandwidth of the same optical module connected to the connector 22 to multiple NIC chips 21, so that any NIC chip 21 only uses a portion of the bandwidth of the optical module; and any NIC chip 21 is connected to multiple different optical modules, and the communication bandwidth of any NIC chip 21 is provided by multiple optical modules. In this way, when the optical link connected to any connector 22 in the Ethernet card 20 (such as the first optical module connected to the connector 22 of the Ethernet card 20, the optical fiber, or the second optical module of the switch) fails, only a portion of the bandwidth of each NIC chip 21 connected to the connector 22 is lost, and these NIC chips 21 can still communicate through the optical links of other connectors 22, without interrupting the network communication of any NIC chip 21. This can avoid the interruption of the external network communication of the GPU corresponding to the NIC chip 21, reduce the impact of optical module or optical link failures on multi-GPU parallel computing tasks, and improve the efficiency of multi-GPU parallel computing tasks.
[0073] It should be noted that, Figure 2 This illustration uses only one connector 22 connecting two network interface card (NIC) chips 21 and one NIC chip 21 connected to two connectors 22 as an example. In practical applications, one connector 22 can connect to two or more NIC chips 21. The communication bandwidth of different connectors 22 can be different, and the number of NIC chips 21 connected to different connectors 22 can also be different. Similarly, one NIC chip 21 can connect to two or more connectors 22. The communication bandwidth of different NIC chips 21 can be different, and the number of connectors 22 connected to different NIC chips 21 can also be different. The number of NIC chips 21, the number of connectors 22, and the specific connection method between connectors 22 and NIC chips 21 in the Ethernet card 20 can be designed and configured according to the needs of the actual application scenario, and are not specifically limited here. For an Ethernet card 20 including multiple NIC chips 21 and multiple optical modules, the aforementioned technical effect can be achieved if any connector 22 is connected to at least two NIC chips 21, and any NIC chip 21 is connected to at least two connectors 22.
[0074] The Ethernet card 20 provided in this embodiment integrates multiple independent network card chips 21 and multiple connectors 22. Each network card 20 is connected to at least two network card chips 21 through any connector 22, and each network card chip 21 is connected to at least two connectors 22. This achieves cross-interconnection between multiple network card chips 21 and multiple optical module connectors 22, so that the electrical channels of multiple network card chips 21 are cross-aggregated on multiple connectors 22. When the optical module on the link where any connector 22 is located fails, only part of the bandwidth of the connected network card chip 21 is affected, and no communication interruption of any network card chip 21 will occur. This can reduce the impact of optical module or optical link failures on multi-GPU parallel computing tasks and improve the efficiency of multi-GPU parallel computing tasks.
[0075] Figure 3 This is a schematic diagram of an Ethernet card provided as an exemplary embodiment of this application. In practical applications, such as... Figure 3 As shown, connector 22 includes multiple first ports 221 for transmitting electrical signals, and network card chip 21 includes multiple second ports 211.
[0076] In this embodiment, connector 22 is connected to at least two network interface card (NIC) chips 21 through multiple first ports 221, and NIC chips 21 are connected to at least two connectors 22 through multiple second ports 211. Any first port 221 of connector 22 can be connected to any second port 211 of NIC chip 21, and one of the first ports 221 is used to receive one electrical signal from NIC chip 21.
[0077] It should be noted that, Figure 3 The illustration only takes one connector 22 containing two first ports 221 and one network card chip 21 containing two second ports 211 as an example. The number of first ports 221 of the connector 22 and the number of second ports 211 of the network card chip 21 in the Ethernet card 20 can be designed and configured according to the needs of the actual application scenario, and no specific limitation is made here.
[0078] For any connector 22, if the number of first ports 221 of the connector 22 is equal to 2, the two first ports 221 of the connector 22 are respectively connected to two different network interface card (NIC) chips 21. If the number of first ports 221 of the connector 22 is greater than 2, the connector 22 can be connected to two or more NIC chips 21 through these first ports 221, and the number of NIC chips 21 connected to the connector 22 through the first ports 221 is less than or equal to the number of first ports 221. If the number of NIC chips 21 connected to the connector 22 through the first ports 221 is less than the number of first ports 221, there are at least two different first ports 221 in the connector 22 connected to the same NIC chip 21 (different first ports 221 are connected to different second ports 211 of the same NIC chip 21).
[0079] For example, Figure 4 A schematic diagram of an Ethernet card is provided, showing that the Ethernet card includes three connectors (such as...). Figure 4 The connectors shown are #1, #2, and #3, and the three network interface cards (NICs) are shown. Figure 4 The following example illustrates the connection relationship between connectors and network interface cards (NICs) in an Ethernet card, using NIC chips #1, #2, and #3 as an example. Each connector contains three first ports, and each NIC chip contains three second ports. Figure 4 As shown, connector #1 connects to network interface card (NIC) chips #1 and #2 via three first ports. The number of NIC chips connected to connector #1 is less than the number of first ports on connector #1. Two of the first ports of connector #1 are connected to two different second ports of NIC chip #1, and the remaining third first port is connected to one second port of NIC chip #2. Connector #2 connects to NIC chips #1, #2, and #3 via three first ports, each connected to one of the three NIC chips. Connector #3 connects to NIC chips #2 and #3 via three first ports. The number of NIC chips connected to connector #3 is less than the number of first ports on connector #3. Two of the first ports of connector #3 are connected to two different second ports of NIC chip #3, and the remaining first port is connected to one second port of NIC chip #2. Additionally, Figure 4 Using straight lines of different line types to represent the connections between different connectors and network card chips makes it more intuitive and easier to distinguish the connections between different connectors.
[0080] In one alternative embodiment, the number of network interface cards (NICs) included in the Ethernet card is greater than or equal to the number of first ports of any connector. The multiple first ports of any connector are respectively connected to different NICs. By connecting the multiple first ports of the connector to different NICs, the impact of a failure in the optical module or optical link connected to the connector can be distributed to as many NICs as possible, thereby reducing the impact on the communication bandwidth of each NIC.
[0081] In this embodiment, the number of first ports of any connector in the Ethernet card can be less than or equal to the number of network interface card (NIC) chips in the Ethernet card, and the number of second ports of any NIC chip can be less than or equal to the number of multiple connectors. The number of connectors is greater than or equal to the number of NIC chips.
[0082] For example, Figure 5 A schematic diagram of an Ethernet card is provided, showing that the Ethernet card includes three connectors (such as...). Figure 5 The connectors shown are #1, #2, and #3, and the three network interface cards (NICs) are shown. Figure 5 The network interface card (NIC) chips #1, #2, and #3 shown are illustrated. For example, each connector contains three first ports, and each NIC chip contains three second ports. The number of connectors in an Ethernet card equals the number of NIC chips. The number of first ports on any connector equals the number of NIC chips contained in the Ethernet card. The number of second ports on any NIC chip equals the number of connectors contained in the Ethernet card. In this case, each connector connects to each NIC chip through multiple first ports, and each NIC chip connects to each connector through multiple second ports.
[0083] like Figure 5 As shown, the three first ports of each connector can be connected to three different network interface card (NIC) chips. This connection method ensures that if the optical module or optical link connected to any one connector fails, the communication bandwidth of each NIC chip will be reduced by 1 / 3, down to 2 / 3 of its original bandwidth, without causing the NIC chip to stop communicating altogether. Furthermore, Figure 5 Using straight lines of different line types to represent the connections between different connectors and network card chips makes it more intuitive and easier to distinguish the connections between different connectors.
[0084] For example, Figure 6 A schematic diagram of an Ethernet card is provided, showing that the Ethernet card includes four connectors (such as...). Figure 6 The connectors shown are #1, #2, #3, and #4, and two network interface card (NIC) chips (e.g., ...). Figure 6 For example, network interface card (NIC) chips #1 and #2 shown in the diagram each have two first ports per connector and four second ports per NIC chip. Figure 7 As shown, the number of connectors in an Ethernet card is greater than the number of network interface card (NIC) chips. The number of first ports on any connector equals the number of NIC chips included in the Ethernet card, and the number of second ports on any NIC chip equals the number of connectors included in the Ethernet card. Figure 7 As shown, each connector's two first ports can be connected to two different network interface card (NIC) chips, and each Ethernet card's four second ports can be connected to four different connectors. This connection method ensures that if any connector's connected optical module or optical link fails, the communication bandwidth of each NIC chip will be reduced by 1 / 4, down to 3 / 4 of its original bandwidth, without causing the NIC chip's communication to stop completely. Furthermore, Figure 6 Using straight lines of different line types to represent the connections between different connectors and network card chips makes it more intuitive and easier to distinguish the connections between different connectors.
[0085] For example, Figure 7 A schematic diagram of an Ethernet card is provided, still assuming the Ethernet card includes 3 connectors (such as...). Figure 7 The connectors shown are #1, #2, and #3, and the three network interface cards (NICs) are shown. Figure 7 As shown in the diagram (network interface card (NIC) chips #1, #2, and #3), each connector contains two first ports, and each NIC chip contains two second ports. For example, the number of connectors in an Ethernet card equals the number of NIC chips. The number of first ports on any connector is less than the total number of NIC chips in the Ethernet card, and the number of second ports on any NIC chip is less than the number of connectors in the Ethernet card. Figure 7 As shown, each connector's two first ports can be connected to two different network interface card (NIC) chips. This connection method ensures that if any connector's connected optical module or optical link fails, the communication bandwidth of each NIC chip will be reduced by half, to half of its original bandwidth, without causing the NIC chip's communication to stop completely. Furthermore, Figure 7 Using straight lines of different line types to represent the connections between different connectors and network card chips makes it more intuitive and easier to distinguish the connections between different connectors.
[0086] In some alternative implementations, the number of connectors included in the Ethernet card may be less than the number of network card chips. For example, Figure 8 A schematic diagram of an Ethernet card is provided, showing that the Ethernet card includes two connectors (such as...). Figure 8 Connectors #1 and #2 shown) and 4 network card chips (such as Figure 8 The network interface card (NIC) chips #1, #2, #3, and #4 shown in the diagram each have four first ports per connector and two second ports per chip. Figure 8 As shown, the number of connectors in the Ethernet card is less than the number of network card chips. The number of first ports of any one connector is equal to the number of network card chips included in the Ethernet card, and the number of second ports of any one network card chip is equal to the number of connectors included in the Ethernet card. As Figure 8 shown, the 4 first ports of each connector can be respectively connected to 4 different network card chips, and the 2 second ports of each Ethernet card are respectively connected to 2 different connectors. In such a connection manner, when a failure occurs in the optical module or optical link connected to any one of the connectors, the communication bandwidth loss of each network card chip is 1 / 2, reduced to 1 / 2 of the original communication bandwidth, and it will not cause the communication of the network card chips to stop. In addition, Figure 8 in [reference] uses straight lines of different line types to represent the connections between different connectors and network card chips, which is more intuitive and easier to distinguish the connections of different connectors.
[0087] It should be noted that Figure 8 this is only an example of an Ethernet card in which the number of included connectors can be less than the number of network card chips. For the number of connectors and network card chips in this type of Ethernet card, as well as the number of first ports of the connectors and the number of second ports of the network card chips, no specific limitations are made.
[0088] Figure 9 This is a schematic structural diagram of an Ethernet card provided by an exemplary embodiment of the present application. A typical Ethernet card provided by an embodiment of the present application, as Figure 9 shown, this Ethernet card includes n network card chips (such as Figure 9 the network card chip #1, network card chip #2,... network card chip #n shown) and m connectors (such as Figure 9 the connector #1, connector #2,... connector #m shown), and the connectors are used to connect optical modules. Wherein, both n and m are positive integers greater than or equal to 2. Any one connector in this Ethernet card is respectively connected to m network card chips, and any one network card chip is respectively connected to n connectors.
[0089] In the Ethernet card provided by this embodiment, the number n of network card chips and the number m of connectors can be equal, or n>m, or n<m. No specific limitations are made here in this embodiment.
[0090] In an optional implementation manner, the number of first ports of any one connector is equal to the number of multiple network card chips m. The connector is respectively connected to m network card chips through m first ports, and each first port is connected to the second port of one network card chip.
[0091] The number of second ports on any network interface card (NIC) chip is equal to the number of connectors, n. The NIC chip connects to n connectors through n second ports. Each second port is connected to the first port of a connector.
[0092] In another alternative implementation, the number of first ports of any connector can be greater than the number m of network interface card (NIC) chips. The connector connects to m NIC chips through multiple first ports, wherein at least two first ports are connected to multiple different second ports of the same NIC chip. Alternatively, the connector connects to m NIC chips through m first ports, and the remaining first ports can be left unused.
[0093] The number of second ports on any network interface card (NIC) chip can be greater than the number of multiple connectors. The NIC chip connects to n connectors through multiple second ports. At least two of the second ports are connected to multiple different first ports of the same connector. Alternatively, the NIC chip connects to n NIC chips through n first ports, and the remaining second ports can be left unused.
[0094] Figure 10 This is a schematic diagram of a typical Ethernet card structure provided for an exemplary embodiment of this application. Figure 10 As shown, the Ethernet card provided in this embodiment includes four network card chips (such as...). Figure 10 The network interface card (NIC) chips #1, #2, #3, and #4 shown are shown, along with four connectors (as shown). Figure 10 Connectors #1, #2, #3, and #4 shown are used to connect optical modules. Each connector connects to one of the four network interface card (NIC) chips, and each NIC chip connects to one of the four connectors.
[0095] like Figure 10 As shown, each connector includes four first ports, and each network interface card (NIC) chip includes four second ports. The number of first ports on any connector equals the number of NIC chips contained in the Ethernet card. Each connector's four first ports connect to four different NIC chips. Similarly, each NIC chip has four second ports equal to the number of connectors in the Ethernet card, and each Ethernet card's four second ports connect to four different connectors. This connection method ensures that if any optical module or optical link connected to any connector fails, the communication bandwidth of each NIC chip will be reduced by 1 / 4, down to 3 / 4 of its original bandwidth, without causing communication to cease. Furthermore, Figure 10 Using straight lines of different line types to represent the connections between different connectors and network card chips makes it more intuitive and easier to distinguish the connections between different connectors.
[0096] For example, Figure 10Each network interface card (NIC) chip outputs four electrical signals through four secondary ports, each with a bandwidth of 100G. These four electrical signals are transmitted to connectors #1, #2, #3, and #4, respectively. Each connector converts the received electrical signal into an optical signal using an optical module and transmits it outwards. If the optical module or optical link fails during the subsequent transmission of one electrical signal, it will not affect the transmission of the remaining three signals.
[0097] Figure 11 This is a schematic diagram of another typical Ethernet card structure provided for an exemplary embodiment of this application. (See diagram below.) Figure 11 As shown, the Ethernet card provided in this embodiment includes four network card chips (such as...). Figure 11 The network interface card (NIC) chips #1, #2, #3, and #4 shown are shown, along with eight connectors (as shown). Figure 11 Connectors #1, #2, #3, #4, #5, #6, #7, and #8 shown are used to connect optical modules. Each connector connects to four network interface card (NIC) chips, and each NIC chip connects to eight connectors.
[0098] like Figure 11 As shown, each connector includes four first ports, and each network interface card (NIC) chip includes eight second ports. The number of first ports on any connector equals the number of NIC chips contained in the Ethernet card. Each connector's four first ports connect to four different NIC chips. Similarly, each NIC chip has eight second ports, equal to the number of connectors in the Ethernet card, and each Ethernet card's eight second ports connect to eight different connectors. This connection method ensures that if any optical module or optical link connected to a connector fails, the communication bandwidth of each NIC chip will decrease by 1 / 8, reducing it to 7 / 8 of its original bandwidth, without causing the NIC chip to stop communicating altogether. Furthermore, Figure 11 Using straight lines of different line types to represent the connections between different connectors and network card chips makes it more intuitive and easier to distinguish the connections between different connectors.
[0099] For example, Figure 11 Each network interface card (NIC) chip outputs eight electrical signals through eight secondary ports, each with a bandwidth of 100G. These eight electrical signals are transmitted to connectors #1, #2, #3, #4, #5, #6, #7, and #8, respectively. Each connector converts the received electrical signal into an optical signal using an optical module and transmits it outwards. If the optical module or optical link fails during the subsequent transmission of one electrical signal, it will not affect the transmission of the remaining seven signals.
[0100] Figure 12 This is a schematic diagram of the structure of a communication module provided for an exemplary embodiment of this application. Figure 12 As shown, the communication module 10 includes multiple optical modules 30 and an Ethernet card 20 provided in any of the aforementioned embodiments. The Ethernet card 20 includes multiple network interface card (NIC) chips 21 and multiple connectors 22. The connectors 22 are used to connect the optical modules 30; each connector 22 is connected to at least two NIC chips 21, and each NIC chip 21 is connected to at least two connectors 22. The multiple optical modules 30 in the communication module 10 are respectively connected to the multiple connectors 22 of the Ethernet card 20.
[0101] In practical applications, connector 22 includes a slot for inserting optical module 30. Optical module 30 includes gold fingers that match the slot of connector 22. The gold fingers of optical module 30 can be inserted into the slot of connector 22, realizing the connection between connector 22 and optical module 30. The network card chip 21 of Ethernet card 20 can transmit electrical signals to optical module 30 through connector 22. Optical module 30 converts the electrical signals into optical signals and transmits the optical signals through optical fiber.
[0102] It should be noted that the Ethernet card 20 in the communication module 10 can be any of the Ethernet cards provided in the foregoing embodiments, and the communication module 10 also includes optical modules 30 that are plugged into each connector 22 of the Ethernet card 20. Based on the Ethernet card provided in any of the foregoing embodiments, a corresponding communication module can be obtained by plugging in optical modules.
[0103] Figure 13 This is a schematic diagram of a typical communication module provided for an exemplary embodiment of this application. For example... Figure 13 As shown, the communication module provided in this embodiment includes an Ethernet card, which includes four network card chips (such as...). Figure 13 The network interface card (NIC) chips #1, #2, #3, and #4 shown are shown, along with four connectors (as shown). Figure 13 The connectors shown are #1, #2, #3, and #4. Each connector connects to one of the four network interface card (NIC) chips, and each NIC chip connects to one of the four connectors. The communication module also includes four optical modules that connect to the four connectors of the Ethernet card, such as... Figure 13 The optical modules shown are #1, #2, #3, and #4.
[0104] like Figure 13As shown, each connector includes four first ports, and each network interface card (NIC) chip includes four second ports. The number of first ports on any connector equals the number of NIC chips contained in the Ethernet card. Each connector's four first ports connect to four different NIC chips. Similarly, each NIC chip has four second ports equal to the number of connectors in the Ethernet card, and each Ethernet card's four second ports connect to four different connectors. This connection method ensures that if any optical module or optical link connected to any connector fails, the communication bandwidth of each NIC chip will be reduced by 1 / 4, down to 3 / 4 of its original bandwidth, without causing communication to cease. Furthermore, Figure 13 Using straight lines of different line types to represent the connections between different connectors and network card chips makes it more intuitive and easier to distinguish the connections between different connectors.
[0105] Figure 14 This is a schematic diagram of the structure of a GPU server provided as an exemplary embodiment of this application. Figure 14 As shown, the GPU server includes: multiple GPUs, and an Ethernet card provided in any of the foregoing embodiments. The Ethernet card includes multiple network card chips and multiple connectors, the connectors being used to connect optical modules; each connector is connected to at least two network card chips, and each network card chip is connected to at least two connectors.
[0106] The GPUs in this GPU server correspond to the network interface cards (NICs) in the Ethernet card. Each GPU has a communication link with its corresponding NIC chip, and each GPU transmits data through its corresponding NIC chip.
[0107] It should be noted that in this GPU server, each network interface card (NIC) chip corresponds to at least one GPU. Figure 14 This description only illustrates the architecture of a GPU server as an example. In a GPU server, one network interface card (NIC) chip can correspond to one or more GPUs, and all one or more GPUs corresponding to the NIC chip transmit data externally through that NIC chip. Furthermore, in some application scenarios, one GPU in a GPU server can also correspond to one or more NIC chips. This embodiment does not specifically limit the exact correspondence between NIC chips and GPUs.
[0108] The GPU in the GPU server and the network card chip in the Ethernet card can communicate with each other through a PCIe (Peripheral Component Interconnect express, high-speed serial computer expansion bus standard) bus or PCIe interface, or other types of buses or interfaces. This embodiment does not make specific limitations here.
[0109] In addition, the GPU server may also include multiple optical modules, which are respectively connected to multiple connectors of the Ethernet card.
[0110] In practical applications, the connector includes a slot for inserting an optical module. The optical module includes gold fingers that match the connector slot. The gold fingers of the optical module can be inserted into the connector slot, thus enabling the connector and the optical module to connect. The Ethernet card's network interface chip can transmit electrical signals to the optical module through the connector. The optical module converts the electrical signals into optical signals and transmits them through the optical fiber.
[0111] It should be noted that the GPU server may include one or more Ethernet cards, and may use the Ethernet cards provided in any of the foregoing embodiments.
[0112] Figure 15 This is a schematic diagram of a typical GPU server structure provided for an exemplary embodiment of this application. Figure 15 As shown, taking a GPU server configured with 8 GPUs as an example, this GPU server can use two such... Figure 10 The Ethernet card shown. (As shown in the image) Figure 15 As shown, the GPU server includes 8 GPUs: GPU#1, GPU#2, GPU#3, GPU#4, GPU#5, GPU#6, GPU#7, and GPU#8, and two Ethernet cards: Ethernet card 1 and Ethernet card 2.
[0113] The Ethernet card 1 includes four network interface cards (NICs): NIC #1, NIC #2, NIC #3, and NIC #4, and four connectors: connector #1, connector #2, connector #3, and connector #4. The four connectors are used to connect different optical modules. Each connector in Ethernet card 1 connects to one of the four NICs: NIC #1, NIC #2, NIC #3, and NIC #4. Each NIC chip in Ethernet card 1 connects to one of the four connectors: connector #1, connector #2, connector #3, and connector #4.
[0114] like Figure 15As shown, in Ethernet card 1, each connector includes four first ports, and each network card chip includes four second ports. The number of first ports of any connector is equal to the number of network card chips contained in the Ethernet card. The four first ports of each connector are connected to four different network card chips, and the four second ports of each Ethernet card are connected to four different connectors. This connection method ensures that when the optical module or optical link connected to any connector in Ethernet card 1 fails, the communication bandwidth of network card chips #1, #2, #3, and #4 will each lose 1 / 4, reducing it to 3 / 4 of its original communication bandwidth, without causing any network card chip to stop communicating.
[0115] Ethernet NIC 2 includes four network interface cards (NICs): NIC #5, NIC #6, NIC #7, and NIC #8, and four connectors: connector #5, connector #6, connector #7, and connector #8. The four connectors are used to connect different optical modules. Each connector in Ethernet NIC 2 connects to one of the four NICs: NIC #5, NIC #6, NIC #7, or NIC #8. Each NIC chip in Ethernet NIC 2 connects to one of the four connectors: connector #5, connector #6, connector #7, or connector #8.
[0116] like Figure 15 As shown, in Ethernet card 2, each connector includes four first ports, and each network card chip includes four second ports. The number of first ports of any connector is equal to the number of network card chips contained in the Ethernet card. The four first ports of each connector are connected to four different network card chips, and the four second ports of each Ethernet card are connected to four different connectors. This connection method ensures that when the optical module or optical link connected to any connector in Ethernet card 1 fails, the communication bandwidth of network card chips #5, #6, #7, and #8 will each lose 1 / 4, reducing to 3 / 4 of the original communication bandwidth, without causing any network card chip to stop communicating.
[0117] in addition, Figure 15 Using straight lines of different line types to represent the connections between different connectors and the network card chip in the same Ethernet card makes it more intuitive and easier to distinguish the connections between different connectors. Figure 15 This example illustrates the architecture of a GPU server by using a one-to-one correspondence between network interface cards (NICs) and GPUs. In some applications, one NIC in a GPU server can correspond to one or more GPUs, and all of these GPUs transmit data through that NIC. In other applications, one GPU in a GPU server can also correspond to one or more NICs. This embodiment does not specifically limit the exact correspondence between NICs and GPUs.
[0118] The GPU server provided in this embodiment can be used to perform multi-GPU parallel computing tasks that are highly sensitive to link failures, such as training large AI models. In the event of a failure in the optical module or optical link connected to any connector, only a portion of the communication bandwidth of the network interface card (NIC) chip connected to that connector is lost. This does not lead to an interruption of the network link for that NIC chip, and the corresponding GPU can still use the remaining communication bandwidth to complete the synchronization of computation results. This does not affect all GPUs from starting the next stage of computation, thus improving the execution efficiency of multi-GPU parallel computing tasks.
[0119] Figure 16 This is a schematic diagram of the structure of a server provided for an exemplary embodiment of this application. Figure 16 As shown, the server includes: multiple processors, and an Ethernet card provided in any of the foregoing embodiments. The Ethernet card includes multiple network card chips and multiple connectors, the connectors being used to connect optical modules; each connector is connected to at least two network card chips, and each network card chip is connected to at least two connectors.
[0120] The server has multiple processors that correspond to multiple network interface card (NIC) chips in the Ethernet card. Each processor has a communication link with its corresponding NIC chip, and each processor transmits data through its corresponding NIC chip. Each NIC chip corresponds to at least one processor.
[0121] It should be noted that in this server, each network interface card (NIC) chip corresponds to at least one processor. Figure 16 This description of the server architecture is merely illustrative. In a server, one network interface card (NIC) chip can correspond to one or more processors, and all of these processors transmit data externally through that NIC chip. Furthermore, in some application scenarios, one processor in a server can also correspond to one or more NIC chips. This embodiment does not specifically limit the exact correspondence between NIC chips and processors.
[0122] The processor in the server and the network card chip in the Ethernet card can communicate via a PCIe (Peripheral Component Interconnect express, high-speed serial computer expansion bus standard) bus or PCIe interface, or other types of buses or interfaces. This embodiment does not make specific limitations here.
[0123] In addition, the server may include multiple optical modules, each of which is connected to a corresponding connector of the Ethernet card.
[0124] In practical applications, the connector includes a slot for inserting an optical module. The optical module includes gold fingers that match the connector slot. The gold fingers of the optical module can be inserted into the connector slot, thus enabling the connector and the optical module to connect. The Ethernet card's network interface chip can transmit electrical signals to the optical module through the connector. The optical module converts the electrical signals into optical signals and transmits them through the optical fiber.
[0125] It should be noted that the server may include one or more Ethernet cards, and may use the Ethernet cards provided in any of the foregoing embodiments.
[0126] Optionally, the server may also include other components such as storage, firewall, load balancer, communication components, and power supply components.
[0127] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), or other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the application can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules in at least one processor.
[0128] The memory may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage device, and may also be a USB flash drive, external hard drive, read-only memory, disk or optical disc, etc.
[0129] The aforementioned memory can be object storage (OSS). This memory can be implemented using any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0130] The aforementioned communication components are configured to facilitate wired or wireless communication between the device containing the communication components and other devices. The device containing the communication components can access wireless networks based on communication standards, such as mobile hotspots (WiFi), second-generation (2G), third-generation (3G), fourth-generation (4G) / Long Term Evolution (LTE), fifth-generation (5G), or combinations thereof. In one exemplary embodiment, the communication components receive broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication components also include a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be based on Radio Frequency Identification (RFID), infrared, Ultra Wide Band (UWB), Bluetooth, and other technologies.
[0131] The aforementioned power supply components provide power to various components within the device in which they reside. These power supply components may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to the device in which they reside.
[0132] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0133] The order of the embodiments described above is merely for illustrative purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, some processes described in the above embodiments and accompanying drawings include multiple operations appearing in a specific order. However, it should be clearly understood that these operations may not be executed in the order they appear herein, or may be executed in parallel. The sequence numbers are merely used to distinguish different operations, and the sequence numbers themselves do not represent any execution order. Additionally, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should be noted that the descriptions such as "first," "second," etc., in this document are used to distinguish different messages, devices, modules, etc., and do not represent a sequential order, nor do they limit "first" and "second" to different types. "Multiple" means two or more, unless otherwise explicitly specified.
[0134] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods of the various embodiments of this application.
[0135] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein.
[0136] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.
Claims
1. An Ethernet card, characterized in that Comprising: a plurality of network card chips and a plurality of connectors, the connectors being used to connect optical modules; any one of the connectors being connected to at least two of the network card chips, and any one of the network card chips being connected to at least two of the connectors.
2. The Ethernet card of claim 1, wherein: the connectors comprise a plurality of first ports for transmitting electrical signals, the connectors being connected to at least two of the network card chips through the plurality of first ports; the network card chips comprise a plurality of second ports, the network card chips being connected to at least two of the connectors through the plurality of second ports.
3. The Ethernet card of claim 2, wherein: the plurality of first ports of any one of the connectors are connected to different network card chips respectively, and the number of the plurality of network card chips is greater than or equal to the number of the first ports of any one of the connectors.
4. The Ethernet card of claim 3, wherein: the number of the first ports of any one of the connectors is equal to the number of the plurality of network card chips, and any one of the connectors is connected to the plurality of network card chips through the plurality of first ports respectively; the number of the second ports of any one of the network card chips is equal to the number of the plurality of connectors, and any one of the network card chips is connected to the plurality of connectors through the plurality of second ports respectively.
5. The Ethernet card of any of claims 1-4, wherein, the number of the connectors is greater than or equal to the number of the network card chips.
6. An Ethernet card, characterized in that Comprising: a plurality of network card chips and a plurality of connectors, the connectors being used to connect optical modules; any one of the connectors being connected to the plurality of network card chips respectively, and any one of the network card chips being connected to the plurality of connectors respectively.
7. The Ethernet card of claim 6, wherein: the connectors comprise a plurality of first ports for transmitting electrical signals, the number of the first ports of the connectors is equal to the number of the plurality of network card chips, and any one of the connectors is connected to the plurality of network card chips through the plurality of first ports respectively; the network card chips comprise a plurality of second ports, the number of the second ports of the network card chips is equal to the number of the plurality of connectors, and any one of the network card chips is connected to the plurality of connectors through the plurality of second ports respectively.
8. The Ethernet card of claim 6 or 7, wherein, The Ethernet card comprises: four network card chips and four connectors, the connectors being used to connect optical modules; any one of the connectors being connected to the four network card chips respectively, and any one of the network card chips being connected to the four connectors respectively.
9. The Ethernet card of claim 6 or 7, wherein, The Ethernet card comprises: four network card chips and eight connectors, the connectors being used to connect optical modules; any one of the connectors being connected to the four network card chips respectively, and any one of the network card chips being connected to the eight connectors respectively.
10. A communication module, characterized in that Comprising: a plurality of optical modules, and an Ethernet card as claimed in any one of claims 1-9; the plurality of optical modules being connected to the plurality of connectors of the Ethernet card respectively.
11. A GPU server, comprising: Comprising: a plurality of GPUs, and an Ethernet card as claimed in any one of claims 1-9; the plurality of GPUs corresponding to the plurality of network card chips in the Ethernet card, each of the GPUs transmitting data through the corresponding network card chip, and any one of the network card chips corresponding to at least one GPU.
12. The GPU server of claim 11, wherein, Also included are: a plurality of optical modules, each of which is connected to a corresponding connector of the Ethernet card.
13. A server, characterized by Also included are: a plurality of processors, a plurality of optical modules, and an Ethernet card as claimed in any of claims 1-9; each of the plurality of optical modules is connected to a corresponding connector of the Ethernet card; the plurality of processors correspond to a plurality of network card chips in the Ethernet card, and each of the processors transmits data through a corresponding network card chip, wherein any of the network card chips corresponds to at least one processor.