A server and data center
By designing I2C or SPI interfaces and high-speed serial interfaces between the network card and the BMC, management functions are integrated, solving the management conflicts and duplication problems in multi-intelligent network card scenarios, improving management efficiency and reducing costs.
Patent Information
- Application Number
- CN202111115998.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-09-23
- Publication Date
- 2026-01-30
- Estimated Expiration
- 2041-09-23
AI Technical Summary
In scenarios with multiple smart NICs, there are conflicts and duplications in the management functions between the NIC and the BMC, as well as between the NICs themselves, leading to low management efficiency.
Through the interface design between the BMC and the network card, including I2C or SPI interfaces and high-speed serial interfaces, the acquisition and management of network card status information can be realized, management functions can be integrated, and duplication and conflict can be avoided.
It resolves the conflicts and duplication of management functions between network cards and BMC, and between network cards themselves, thereby improving management efficiency and reducing server deployment costs.
Smart Images

Figure CN113986526B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of servers, and more specifically to a server and a data center. Background Technology
[0002] With the development of cloud computing technology, large network service providers are increasingly using virtualization technology in data centers to meet complex and ever-changing business requirements. Data centers are also beginning to adopt Network Functions Virtualization (NFV) to handle data exchange between virtual machines. As internet services grow, the data sources and total amount of data that data centers need to process are rapidly increasing.
[0003] Traditional network function virtualization services are handled by the server's general-purpose CPU. As the amount of network data processed by the server increases, the CPU resource consumption caused by data packet processing also increases sharply, resulting in a large amount of CPU resources that should be used for application services being occupied.
[0004] Smart network interface cards (NICs) offload the workload of data packet processing to dedicated forwarding chips on the NIC. This improves data packet processing and forwarding performance while significantly reducing the workload of the server's general-purpose CPU. CPU resources used for processing network packets can then be allocated to other applications, improving overall server efficiency. This process is called offloading. With the development of smart NICs, service providers also want to offload some basic services beyond network packet processing to smart NICs. Since dedicated forwarding chips are limited to network packet processing, SoCs (System-on-a-Chip) with general-purpose CPUs have emerged on smart NICs to support these new services, forming a general architecture of SoC plus forwarding chips.
[0005] like Figure 1 As shown, current mainstream smart network interface card (NIC) hardware includes a System-on-a-Chip (SoC) with CPU functionality. The CPU architecture may be x86, ARM, or other processor architectures. A common feature of SoCs on smart NICs is their ability to install and adapt to mainstream Linux operating systems. On top of Linux, they run software-based network switching programs. The SoC is responsible for forwarding some slow-path network packets and configuring the characteristic information and target actions (i.e., flow tables) of received slow-path packets onto the fast paths handled by the forwarding chips. Furthermore, the SoC can also handle some storage service management and distribution functions. These are all business functions undertaken by the SoC.
[0006] The SoC (System-on-a-Chip) on the smart network interface card (NIC) also handles management functions, including monitoring the NIC's operational status, restarting, resetting, and upgrading various chips on the card, as well as managing PCIe devices and Ethernet interface configurations related to service functions. The SoC also manages some server functions, such as server status monitoring, restarting, and power-on / off control. External management hosts connect directly to the SoC through the management interface, without needing to go through a server.
[0007] like Figure 1 As shown, smart network interface cards (NICs) typically include a separate forwarding chip. This chip connects to the server host via a PCIe interface and to the SoC system via other high-speed serial interfaces (usually also PCIe). Furthermore, the forwarding chip usually includes an Ethernet interface for connecting to external switches. The forwarding chip on the smart NIC is responsible for forwarding network packets along the fast path. Forwarding chips are typically in the form of ASICs or FPGAs. Generally, ASIC forwarding chips offer higher performance and more functions, but are less flexible; FPGA forwarding chips have slightly lower performance but extremely high flexibility, allowing for different functions to be implemented through different configurations.
[0008] Slow path packets refer to network packets that enter the smart network card for the first time. If the forwarding chip does not find their characteristic information configuration after searching and matching, the forwarding chip will send such packets to the SoC system for processing through the high-speed serial interface. Fast path packets refer to network packets that the forwarding chip finds their characteristic information configuration and handling method after searching and matching. The forwarding chip will modify and forward the packets according to the configured handling method.
[0009] In summary, the SoC system and the forwarding chip are the main components of a smart network interface card (NIC). The SoC system is responsible for business functions such as slow path packet forwarding and management functions, while the forwarding chip is responsible for fast path packet forwarding.
[0010] The BMC (Baseboard Management Controller) is an essential system component on mainstream server hosts. It is typically implemented by a separate chip and is responsible for all hardware-related management tasks of the server, including monitoring the working status of each hardware component, powering on / off of each component, and version upgrades. The BMC can connect to an external management host through a separate management interface or by using the NCSI interface through the server's network interface card (including smart network cards).
[0011] like Figure 2 As shown, the SoC system on the smart network card acts as the management terminal to manage the smart network card and the server, which conflicts with some functions of the server host BMC.
[0012] like Figure 3 As shown, in a scenario with multiple smart network interface cards (NICs) on a single server host, there is a conflict in the deployment of management functions between the smart NICs. In servers configured with multiple CPUs, in order to improve the communication performance between the CPUs and the smart NICs, multiple smart NICs are equipped, each connected to a different CPU. However, the management functions on the smart NICs are still geared towards the server as a whole, and the management functions on multiple smart NICs conflict or overlap. Summary of the Invention
[0013] In view of this, in order to overcome at least one aspect of the above-mentioned problems, embodiments of the present invention provide a server, comprising:
[0014] Several network interface cards (NICs), each NIC is equipped with a SoC system, a forwarding chip, a first type interface, and a second type interface;
[0015] BMC, wherein the BMC is connected to the first type interface and the second type interface of each of the network cards;
[0016] The BMC is configured to obtain the status information of each network card through the first type of interface and manage each network card through the second type of interface.
[0017] In some embodiments, the BMC also includes a third type of interface.
[0018] In some embodiments, the first type of interface is an I2C interface or an SPI interface.
[0019] In some embodiments, the BMC is further configured to send management information and / or configuration information to each of the network interface cards through the second type of interface.
[0020] Based on the same inventive concept, embodiments of the present invention also propose a data center comprising multiple servers, wherein the servers include:
[0021] Several network interface cards (NICs), each NIC is equipped with a SoC system, a forwarding chip, a first type interface, and a second type interface;
[0022] BMC, wherein the BMC is connected to the first type interface and the second type interface of each of the network cards;
[0023] The BMC is configured to obtain the status information of each network card through the first type of interface and manage each network card through the second type of interface.
[0024] In some embodiments, the BMC also includes a third type of interface.
[0025] In some embodiments, the first type of interface is an I2C interface or an SPI interface.
[0026] In some embodiments, the BMC is further configured to send management information and / or configuration information to each of the network interface cards through the second type of interface.
[0027] Based on the same inventive concept, embodiments of the present invention also propose a server, comprising:
[0028] Several network interface cards (NICs), each NIC is equipped with a forwarding chip, a Type I interface, and a high-speed serial interface;
[0029] BMC, wherein the BMC is connected to the Type I interface and the high-speed serial interface of each of the network cards;
[0030] The BMC is configured to obtain the status information of each network card through the first type of interface and connect to the forwarding chip through the high-speed serial interface.
[0031] The BMC is also configured to receive and forward messages forwarded by the forwarding chip that have not been pre-configured with feature information via the high-speed serial interface;
[0032] The BMC is also configured to configure the feature information and flow table of the packets that have not been pre-configured with feature information to the forwarding chip.
[0033] In some embodiments, the BMC also includes a third type of interface.
[0034] In some embodiments, the first type of interface is an I2C interface or an SPI interface.
[0035] In some embodiments, the BMC is further configured to send management information and / or configuration information to each network interface card via the high-speed serial interface.
[0036] Based on the same inventive concept, embodiments of the present invention also propose a data center comprising multiple servers, wherein the servers include:
[0037] Several network interface cards (NICs), each NIC is equipped with a forwarding chip, a Type I interface, and a high-speed serial interface;
[0038] BMC, wherein the BMC is connected to the Type I interface and the high-speed serial interface of each of the network cards;
[0039] The BMC is configured to obtain the status information of each network card through the first type of interface and connect to the forwarding chip through the high-speed serial interface.
[0040] The BMC is also configured to receive and forward messages forwarded by the forwarding chip that have not been pre-configured with feature information via the high-speed serial interface;
[0041] The BMC is also configured to configure the feature information and flow table of the packets that have not been pre-configured with feature information to the forwarding chip.
[0042] In some embodiments, the BMC also includes a third type of interface.
[0043] In some embodiments, the first type of interface is an I2C interface or an SPI interface.
[0044] In some embodiments, the BMC is further configured to send management information and / or configuration information to each network interface card via the high-speed serial interface.
[0045] The present invention has one of the following beneficial technical effects: the solution proposed in the present invention can solve the problems of conflict and duplication of management functions between network cards and BMC, and between network cards. Attached Figure Description
[0046] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other embodiments can be obtained based on these drawings without creative effort.
[0047] Figure 1 This is a schematic diagram of the structure of a network card in the existing technology;
[0048] Figure 2 This is a schematic diagram illustrating the connection relationship between the BMC and the network card in the existing technology;
[0049] Figure 3 This is a schematic diagram of the structure of multiple network interface cards (NICs) in the existing technology;
[0050] Figure 4 This is a schematic diagram of the server structure proposed in an embodiment of the present invention;
[0051] Figure 5 This is a schematic diagram of the server structure proposed in another embodiment of the present invention. Detailed Implementation
[0052] To make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below with reference to specific examples and the accompanying drawings.
[0053] It should be noted that all uses of "first" and "second" in the embodiments of the present invention are for the purpose of distinguishing two entities or parameters with the same name but different names. It is clear that "first" and "second" are only for the convenience of expression and should not be construed as limiting the embodiments of the present invention. Subsequent embodiments will not explain this in detail.
[0054] According to one aspect of the present invention, embodiments of the present invention provide a server, such as Figure 4 As shown, it includes several network cards, each of which is equipped with a SoC system, a forwarding chip, a first type interface and a second type interface;
[0055] BMC, wherein the BMC is connected to the first type interface and the second type interface of each of the network cards;
[0056] The BMC is configured to obtain the status information of each network card through the first type of interface and manage each network card through the second type of interface.
[0057] Specifically, such as Figure 4 As shown, the BMC is the only way to manage all smart NICs. The smart NICs retain the SoC system, and the SoC system is only responsible for executing business functions.
[0058] like Figure 4 As shown, smart network cards need to provide low-speed interfaces such as I2C and SPI (i.e., the first type of interface). The BMC can access the sensors and management chips on the smart network card through the low-speed interface to obtain information such as temperature, voltage, and abnormal status alarms during the operation of the smart network card.
[0059] In some embodiments, the BMC further includes a third type of interface. Specifically, such as... Figure 4 As shown, the external management host connects to the BMC through a single management interface (third type interface) to manage the entire server.
[0060] In some embodiments, the first type of interface is an I2C interface or an SPI interface. Specifically, such as... Figure 4 As shown, smart network cards need to provide low-speed interfaces such as I2C and SPI. The BMC can access the sensors and management chips on the smart network card through the low-speed interfaces to obtain information such as temperature, voltage, and abnormal status alarms during the operation of the smart network card.
[0061] In some embodiments, the BMC is further configured to send management information and / or configuration information to each of the network interface cards (NICs) through the second type of interface. Specifically, the smart NIC needs to provide a management interface (i.e., the second type of interface), through which the BMC can send management information such as upgrade information, restart, and power-on / off information, as well as service-related configuration information such as device orchestration, forwarding flow tables, and Ethernet port configuration to the smart NIC SoC system.
[0062] The solution proposed in this invention separates the management functions of the network interface card (NIC) by combining it with the BMC, and integrates the management server and the NIC, thereby resolving the conflicts and duplication of management functions between the NIC and the BMC, and between NICs themselves.
[0063] Based on the same inventive concept, embodiments of the present invention also propose a data center comprising multiple servers, wherein the servers include:
[0064] Several network interface cards (NICs), each NIC is equipped with a SoC system, a forwarding chip, a first type interface, and a second type interface;
[0065] BMC, wherein the BMC is connected to the first type interface and the second type interface of each of the network cards;
[0066] The BMC is configured to obtain the status information of each network card through the first type of interface and manage each network card through the second type of interface.
[0067] In some embodiments, the BMC also includes a third type of interface.
[0068] In some embodiments, the first type of interface is an I2C interface or an SPI interface.
[0069] In some embodiments, the BMC is further configured to send management information and / or configuration information to each of the network interface cards through the second type of interface.
[0070] Based on the same inventive concept, embodiments of the present invention also propose a server, such as... Figure 5 As shown, it includes:
[0071] Several network interface cards (NICs), each NIC is equipped with a forwarding chip, a Type I interface, and a high-speed serial interface;
[0072] BMC, wherein the BMC is connected to the Type I interface and the high-speed serial interface of each of the network cards;
[0073] The BMC is configured to obtain the status information of each network card through the first type of interface and connect to the forwarding chip through the high-speed serial interface.
[0074] The BMC is also configured to receive and forward messages forwarded by the forwarding chip that have not been pre-configured with feature information via the high-speed serial interface;
[0075] The BMC is also configured to configure the feature information and flow table of the packets that have not been pre-configured with feature information to the forwarding chip.
[0076] In some embodiments, the BMC is further configured to send management information and / or configuration information to each network interface card via the high-speed serial interface.
[0077] Specifically, the BMC (Browser Control Center) manages all smart NICs as the sole means of operation, and also undertakes the business functions of the smart NIC's SoC (System-on-a-Chip) system. The smart NICs themselves do not have an SoC system; instead, they retain the forwarding chip. The smart NICs require a high-speed serial interface, through which the BMC takes over the business functions of the original SoC system on the smart NIC, handling tasks such as forwarding and storing slow-path packets. The BMC also uses this interface to send flow tables to the forwarding chip. Furthermore, the BMC can use this interface to send management information such as upgrade requests, reboots, and power-on / off commands to the smart NICs, as well as business-related configuration information such as Ethernet port configurations.
[0078] In some embodiments, the BMC further includes a third type of interface. Specifically, such as... Figure 5 As shown, the external management host connects to the BMC through a single management interface (third type interface) to manage the entire server.
[0079] In some embodiments, the first type of interface is an I2C interface or an SPI interface. Specifically, such as... Figure 5 As shown, smart network cards need to provide low-speed interfaces such as I2C and SPI. The BMC can directly or indirectly access the sensors and management chips on the smart network card through the low-speed interfaces to obtain information such as temperature, voltage, and abnormal status alarms during the operation of the smart network card.
[0080] The proposed solution, by integrating with the BMC (Browser Management Center), separates the network interface card (NIC) management functions, consolidating the management server and NIC. This resolves conflicts and redundancies in management functions between the NIC and the BMC, and between different NICs. Furthermore, by eliminating the SoC (System-on-a-Chip) chip in the smart NIC, it further reduces the cost of deploying NICs on the server.
[0081] Based on the same inventive concept, embodiments of the present invention also propose a data center comprising multiple servers, wherein the servers include:
[0082] Several network interface cards (NICs), each NIC is equipped with a forwarding chip, a Type I interface, and a high-speed serial interface;
[0083] BMC, wherein the BMC is connected to the Type I interface and the high-speed serial interface of each of the network cards;
[0084] The BMC is configured to obtain the status information of each network card through the first type of interface and connect to the forwarding chip through the high-speed serial interface.
[0085] The BMC is also configured to receive and forward messages forwarded by the forwarding chip that have not been pre-configured with feature information via the high-speed serial interface;
[0086] The BMC is also configured to configure the feature information and flow table of the packets that have not been pre-configured with feature information to the forwarding chip.
[0087] In some embodiments, the BMC also includes a third type of interface.
[0088] In some embodiments, the first type of interface is an I2C interface or an SPI interface.
[0089] In some embodiments, the BMC is further configured to send management information and / or configuration information to each network interface card via the high-speed serial interface.
[0090] The above are exemplary embodiments disclosed in this invention. However, it should be noted that various changes and modifications can be made without departing from the scope of the embodiments of this invention as defined by the claims. Furthermore, although the elements disclosed in the embodiments of this invention may be described or claimed individually, they may be understood as multiple unless explicitly limited to a singular number.
[0091] It should be understood that, as used herein, the singular form “a” is intended to include the plural form as well, unless the context clearly supports an exception. It should also be understood that, as used herein, “and / or” refers to any and all possible combinations of one or more of the associated listed items.
[0092] The embodiment numbers disclosed in the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0093] Those skilled in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of the invention (including the claims) is limited to these examples. Within the framework of the invention, technical features of the above embodiments or different embodiments can be combined, and many other variations of different aspects of the invention exist, which are not provided in the details for the sake of brevity. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the invention should be included within the protection scope of the invention.
Claims
1. A server, characterized by The application relates to a server, comprising: a plurality of network cards, each of which is provided with an SoC system, a forwarding chip, a first type of interface and a second type of interface; a BMC connected with the first type of interface and the second type of interface of each network card; wherein the BMC is configured to acquire state information of each network card through the first type of interface and to manage each network card through the second type of interface; the BMC is further configured to issue management information and / or configuration information to each network card through the second type of interface.
2. The server of claim 1, wherein, The BMC further comprises a third type of interface.
3. The server of claim 1, wherein, The first type of interface is an I2C interface or an SPI interface.
4. A data center, characterized by, The application further relates to a server system comprising a plurality of servers as claimed in any one of claims 1-3.
5. A server, characterized by The application relates to a server, comprising: a plurality of network cards, each of which is provided with a forwarding chip, a first type of interface and a high-speed serial interface; a BMC connected with the first type of interface and the high-speed serial interface of each network card; wherein the BMC is configured to acquire state information of each network card through the first type of interface and to connect with the forwarding chip through the high-speed serial interface; the BMC is further configured to receive and forward a packet not pre-configured with feature information which is forwarded by the forwarding chip through the high-speed serial interface; the BMC is further configured to configure feature information and a flow table of the packet not pre-configured with feature information to the forwarding chip; the BMC is further configured to issue management information and / or configuration information to each network card through the high-speed serial interface.
6. The server of claim 5, wherein, The BMC further comprises a third type of interface.
7. The server of claim 5, wherein, The first type of interface is an I2C interface or an SPI interface.
8. A data center, characterized by, The application further relates to a server system comprising a plurality of servers as claimed in any one of claims 5-7.
Citation Information
Patent Citations
Method and device for packet transmitting in Open Flow system
CN103428094A
Network card NCSI function self-adaptive system and method and integrated chip
CN112684734A