Network system, communication method, network node and storage medium

By reducing the number of data packet encapsulation layers between virtualized nodes in the network system, using RDMA signaling packets and RDMA data packets to communicate between virtualized nodes, the problem of large data transmission overhead in virtualization technology is solved, and the problem of large data transmission overhead in virtualization technology is improved. Network performance and isolation.

WO2024230439A1PCT designated stage expired Publication Date: 2024-11-14ALIBABA CLOUD COMPUTING CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/088381
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-11
Filing Date
2024-04-17
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

The existing network virtualization technology introduces too much encapsulation in the data transmission between virtualized nodes, resulting in excessive transmission overhead and affecting network system performance.

Method used

By using RDMA signaling packets and RDMA data packets in the network system for communication between virtualized nodes, the encapsulation of virtual network IP protocol headers and virtualization protocol headers is reduced, and virtualization only carries virtualization in the physical network IP protocol headers Virtualization identification of nodes can reduce the number of encapsulation layers of data packets and improve transmission efficiency.

Benefits of technology

It effectively reduces data transmission overhead, improves network performance, and ensures virtual network isolation of virtualized nodes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024088381_14112024_PF_FP_ABST
    Figure CN2024088381_14112024_PF_FP_ABST
Patent Text Reader

Abstract

Provided in the embodiments of the present application are a network system, a communication method, a network node and a storage medium. The network system comprises a plurality of network nodes, wherein each network node comprises one or more virtualization nodes; an RDMA signaling packet between two virtualization nodes is used for establishing an RDMA connection between the two virtualization nodes, an encapsulation of the RDMA signaling packet comprises an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header and a physical network IP protocol header, the virtualization protocol header of the RDMA signaling packet comprises a virtualization identifier of a virtualization node for sending the RDMA signaling packet, and different virtualization identifiers are used for identifying different virtual networks; and an RDMA data packet between the two virtualization nodes is used for performing data transmission after the RDMA connection is established, an encapsulation of the RDMA data packet comprises the RDMA protocol header and the physical network IP protocol header, and the physical network IP protocol header of the RDMA data packet comprises a virtualization identifier of a virtualization node for sending the RDMA data packet. The present application reduces data transmission overheads.
Need to check novelty before this filing date? Find Prior Art

Description

Network system, communication method, network node and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 11, 2023, with application number 2023105308893 and invention name “Network system, communication method, network node and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of network technology, and more particularly, to a network system, a communication method, a network node, and a storage medium. Background Art

[0003] Common virtualization technologies include virtual machines (VMs) and containers. Virtualization technologies are used to create virtualized nodes, such as VM nodes and / or container nodes, on the physical network nodes of a network system. Virtualized nodes can communicate with each other based on virtual networks and physical networks.

[0004] In scenarios where data is transmitted between virtualized nodes using Remote Direct Memory Access (RDMA), existing network virtualization and isolation technologies introduce excessive additional data encapsulation, resulting in excessive transmission overhead.

[0005] Summary of the Invention

[0006] The present application provides a network system, a communication method, a network node and a storage medium to reduce the transmission overhead of data in the network system.

[0007] In a first aspect, the present application provides a network system comprising: multiple networked nodes, each network node comprising one or more virtualized nodes, the virtualized nodes comprising container nodes and / or virtual machine nodes, and communication between two virtualized nodes based on remote direct data access (RDMA); wherein an RDMA signaling packet between the two virtualized nodes is used to establish an RDMA connection between the two virtualized nodes, the encapsulation of the RDMA signaling packet comprising an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header, the virtualization protocol header of the RDMA signaling packet comprising a virtualization identifier of the virtualization node sending the RDMA signaling packet, and different virtualization identifiers are used to identify different virtual networks; an RDMA data packet between the two virtualized nodes is used to transmit data after establishing the RDMA connection, the encapsulation of the RDMA data packet comprising an RDMA protocol header and a physical network IP protocol header, and the physical network IP protocol header of the RDMA data packet comprising a virtualization identifier of the virtualization node sending the RDMA data packet.

[0008] In a second aspect, the present application provides a communication method, which is applied to a network system, wherein the network system includes multiple network nodes, each network node includes one or more virtualization nodes, the virtualization nodes include virtualization nodes and / or virtual machine nodes, and two virtualization nodes communicate based on remote direct data access (RDMA). The method includes: establishing an RDMA connection between the two virtualization nodes through an RDMA signaling packet, wherein the encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header, and the virtualization protocol header of the RDMA signaling packet includes a virtualization identifier of the virtualization node that sends the RDMA signaling packet, and different virtualization identifiers are used to identify different virtual networks; after establishing the RDMA connection, the two virtualization nodes transmit data through an RDMA data packet, wherein the encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header, and the physical network IP protocol header of the RDMA data packet includes the virtualization identifier of the virtualization node that sends the RDMA data packet.

[0009] In a third aspect, the present application provides a communication method, which is applied to a first virtualization node on a first network node in a network system, wherein the network system includes multiple network nodes, each network node includes one or more virtualization nodes, the virtualization nodes include container nodes and / or virtual machine nodes, and the two virtualization nodes communicate based on remote direct data access (RDMA). The method includes: establishing an RDMA connection with a second virtualization node through an RDMA signaling packet, wherein the encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header, and the virtualization protocol header of the RDMA signaling packet includes a virtualization identifier of the first virtualization node, and different virtualization identifiers are used to identify different virtual networks; after establishing the RDMA connection with the second virtualization node, sending data to the second virtualization node through an RDMA data packet, wherein the encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header, and the physical network IP protocol header of the RDMA data packet includes the virtualization identifier of the first virtualization node.

[0010] In a fourth aspect, the present application provides a network node comprising: a memory and a processor; the memory is used to store a computer program; the processor is used to execute the computer program stored in the memory, and when the computer program is running, the processor executes the method described in the third aspect.

[0011] In a fifth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the processor executes the method described in the third aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following is a brief introduction to the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0013] FIG1 is a schematic diagram of a network system provided in an embodiment of the present application;

[0014] FIG2 is a schematic diagram of an implementation of a virtualized node of a network system provided in an embodiment of the present application;

[0015] 3 is a schematic diagram of encapsulation of an RDMA signaling packet and an RDMA data packet provided in an embodiment of the present application;

[0016] FIG4 is a flow chart of a communication method according to an embodiment of the present application;

[0017] FIG5 is a second flow chart of a communication method provided in an embodiment of the present application;

[0018] FIG6 is a schematic diagram of the structure of a network node provided in an embodiment of the present application;

[0019] FIG7 is a schematic block diagram of a network node provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] The following description sets forth many specific details to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the scope of the present application. Therefore, the present application is not limited to the embodiments disclosed below.

[0021] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0022] There are many ways to implement network virtualization. Taking the overlay network as an example, the overlay network and the underlay network are relative concepts. The overlay network is a logical network built on the underlay network, that is, a virtual network, while the underlay network is the underlying physical foundation. It is a physical network composed of multiple types of devices interconnected and is responsible for data packet transmission between devices. Network virtualization technology is used to create a virtual overlay network on top of the underlay network. In the overlay network, virtualized nodes can be interconnected through logical links as needed to form an overlay topology. Tunnels are established between the interconnected virtualized nodes in the overlay network. During transmission, data is encapsulated with the inner overlay network IP protocol header, the tunnel header, and the outer underlay network IP protocol header.

[0023] Overlay networks have various network protocols and standards. Taking the Virtual eXtensible Local Area Network (VXLAN) protocol as an example, a VXLAN tunnel is established between virtualized nodes. During transmission, data is encapsulated with an inner overlay network IP protocol header, a VXLAN protocol header, and an outer underlay network IP protocol header. The VXLAN header includes a VXLAN Network Identifier (VNI), which is a virtualization identifier. Different VNIs represent different virtual networks. The virtualization identifier is used to isolate the overlay network of virtualized nodes. In other words, in a network virtualization scenario, the data of the virtualized node will be encapsulated with a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header. The virtualization protocol header is the aforementioned tunnel header, such as the VXLAN protocol header.

[0024] Under the premise of the above-mentioned network virtualization, data can also be transmitted between virtualized nodes using RDMA, that is, data is transmitted between virtualized nodes by establishing an RDMA connection. RDMA stands for Remote Direct Memory Access, which can achieve zero copy, kernel bypass, and central processing unit (CPU) offloading. Among them, zero copy means that there is no need to copy data back and forth between user space and kernel space. Kernel bypass means that the data reading and writing process can bypass the kernel, that is, the data can be prepared in the user layer and the hardware is notified to prepare for sending and receiving. CPU offloading means that the memory can be read and written without the remote node CPU participating in the communication. The RDMA protocol has many specific implementation methods. In actual use, the data needs to be encapsulated according to the RDMA protocol first, and then the aforementioned virtual network IP protocol header, virtualization protocol header, and physical network IP protocol header are encapsulated. It can be seen that the data between virtualized nodes needs to be encapsulated through layers of protocols, which leads to excessive data transmission overhead and affects the performance of the network system.

[0025] In view of this, an embodiment of the present application proposes a network system, in which each network node in the network system includes one or more virtualized nodes, and the virtualized nodes in the network system communicate based on RDMA, that is, the virtualized nodes form an RDMA network through RDMA connections, and the virtualized nodes first establish an RDMA connection based on the TCP / IP connection of the virtual network, and then transmit data based on the RDMA connection. Since the establishment of the RDMA connection depends on the TCP / IP connection of the virtual network, the encapsulation of the RDMA signaling used to establish the RDMA connection still needs to be performed after the RDMA protocol encapsulation, and then the virtual network IP header, virtualization protocol header, and physical network IP protocol header are encapsulated. For RDMA data transmitted after the RDMA connection is established, in order to avoid additional encapsulation, the RDMA data is directly encapsulated in the physical network IP protocol header after the RDMA protocol encapsulation. At the same time, in order to ensure the isolation of the virtual network, the virtualization identifier of the virtualized node is carried in the physical network IP protocol header, thereby realizing RDMA data transmission while reducing the transmission overhead occupied by the encapsulation of the RDMA data packet. The following is an illustration through specific embodiments.

[0026] Figure 1 is a schematic diagram of a network system provided by an embodiment of the present application. As shown in Figure 1, the network system includes: multiple network nodes, each network node includes one or more virtualization nodes, the virtualization nodes include container nodes and / or virtual machine nodes, and the virtualization nodes communicate with each other based on RDMA.

[0027] The RDMA signaling packet between two virtualized nodes is used to establish an RDMA connection between the two virtualized nodes. The encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header. The virtualization protocol header of the RDMA signaling packet includes the virtualization identifier of the virtualization node sending the RDMA signaling packet. Different virtualization identifiers are used to identify different virtual networks.

[0028] The RDMA data packet between two virtualization nodes is used for data transmission after the RDMA connection is established. The encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header. The physical network IP protocol header of the RDMA data packet includes the virtualization identifier of the virtualization node sending the RDMA data packet.

[0029] In the embodiment of the present application, virtualized nodes on the network nodes establish RDMA connections according to communication requirements to form an RDMA network. RDMA signaling and RDMA data transmitted between virtualized nodes in this network system are encapsulated differently. Encapsulated RDMA signaling is called an RDMA signaling packet, and encapsulated RDMA data is called an RDMA data packet.

[0030] The virtualized nodes in the RDMA network have RDMA network identifiers, and an RDMA connection can be identified between virtualized nodes by the RDMA network identifier. The RDMA network identifier can be generated or assigned when the RDMA connection is established. The RDMA protocol header is generated based on the RDMA network identifier of the virtualized node. It should be noted that the RDMA protocol header can be generated based on the RDMA network identifier of the virtualized node and other information. The RDMA network identifier of the virtualized node can be generated based on the virtual session identifier of the virtualized node and the physical network card IP address of the network node where the virtualized node is located. It should be noted that the RDMA network identifier can be generated based on the aforementioned virtual session identifier, physical network card IP address and other information.

[0031] Because establishing an RDMA connection relies on the TCP / IP connection of the virtual network, the RDMA signaling packet used to establish the RDMA connection includes the RDMA protocol header, the virtual network IP protocol header, the virtualization protocol header, and the physical network IP protocol header. For example, if the virtual network uses an overlay network and VXLAN, the RDMA signaling packet encapsulation includes the RDMA protocol header, the overlay network IP protocol header, the VXLAN protocol header, and the underlay network IP protocol header. The VXLAN protocol header includes the virtualization identifier of the virtualization node, which is the VNI.

[0032] Compared with RDMA signaling packets, the encapsulation of RDMA data packets in the embodiment of the present application reduces the virtual network IP protocol header and the virtualization protocol header, and carries the virtualization identifier of the virtualization node in the physical network IP header. The encapsulation of the RDMA data packet includes the RDMA protocol header and the physical network IP protocol header carrying the virtualization identifier. In this way, while ensuring the virtual network isolation of the virtualization node, the number of encapsulation layers of the RDMA data packet is reduced, thereby reducing transmission overhead and improving network performance.

[0033] In the embodiments of the present application, the IP protocols used by the physical network and the virtual network in the network system are not limited, and the IP protocols used by the physical network and the virtual network can be consistent or inconsistent. In other words, both the physical network and the virtual network can choose to use the IPv4 protocol or the IPv6 protocol according to application needs, and there is no correlation between the two. For example, when the physical network uses the IPv4 protocol, the virtual network can use the IPv4 protocol or the IPv6 protocol; similarly, when the physical network uses the IPv6 protocol, the virtual network can use the IPv4 protocol or the IPv6 protocol. Based on the IP protocols used by the physical network and the virtual network, the virtual network IP protocol header in the aforementioned embodiments can be an IPv4 protocol header or an IPv6 protocol header, and the physical network IP protocol header can be an IPv4 protocol header or an IPv6 protocol header.

[0034] For an RDMA data packet, the virtualization identifier of the virtualization node contained therein is carried in the physical network IP protocol header. In one embodiment, when the physical network IP protocol header is an IPv6 protocol header, the physical network IP protocol header includes the physical network card IPv6 address of the network node where the virtualization node is located. The virtualization identifier in the physical network IP protocol header of the RDMA data packet can be encoded in the physical network card IPv6 address of the network node. In other words, the space in the physical network card IPv6 address of the network node can be used, for example, 24 bits thereof can be taken as the encoding space for the virtualization identifier. By encoding the virtualization identifier in the physical network card IPv6 address of the network node, the virtualization identifier of the virtualization node is carried in the physical network IP protocol header. In one embodiment, when the physical network IP protocol header is an IPv6 protocol header, other fields in the IPv6 protocol header, such as a reserved field or a specific identification field, can also be used to carry the virtualization identifier of the virtualization node, or an extended header of the IPv6 protocol can also be used to carry the virtualization identifier of the virtualization node. When the physical network IP protocol header is an IPv4 protocol header, similar to the above, a reserved field or a specific identification field in the IPv4 protocol header may be used to carry the virtualization identification of the virtualization node.

[0035] In the embodiment of the present application, there is no limitation on the specific field occupied by the virtualization identifier in the physical network IP protocol header of the RDMA data packet or the encoding method of the virtualization identifier, as long as the virtualization identifier of the virtualization node is carried in the physical network IP protocol header.

[0036] It should be noted that in the scenario where the virtualization identifier of the virtualized node is encoded in the physical network card IPv6 address of the network node where it is located, the network node triggers the gateway device in the network system, such as a switch or router, through a neighbor discovery (ND) protocol message to parse the physical network card IPv6 address of the network node to obtain the forwarding table entry corresponding to the network node, so as to achieve the correct transmission of the RDMA data packet using the above-encoded IPv6 address.

[0037] In one embodiment, to improve network system performance, the physical network IP protocol header of the RDMA packet in the embodiments of the present application may further include flow control information of the virtualization node sending the RDMA packet and / or the network node where the virtualization node resides. This flow control information is used to implement flow control of the RDMA packet. In one embodiment, the flow control information may be used to indicate the transmission priority of the RDMA packet.

[0038] Figure 2 is a schematic diagram of an implementation of a virtualized node of a network system provided in an embodiment of the present application. The Pod in Figure 2 is a container node, and the figure illustrates an example of running an artificial intelligence (AI) application in a container. Eth0 is the IP network card of the virtual network of the container node, and is assigned a corresponding IP address. The physical function (PF), virtual function (VF), and virtual switch illustrated in the physical network card are only used to illustrate an implementation method, and are not used to limit the physical network card.

[0039] In an embodiment of the present application, the network type (Network Type) of the container node is configured as RDMA. In one embodiment, the network type can be further divided based on different RDMA protocols. For example, if the RDMA protocol is the RDMA over Converged Ethernet (RoCE) protocol based on converged Ethernet, the corresponding network type is RDMA-RoCE. Another example is that if the RDMA protocol is the Solar-RDMA protocol, the corresponding network type is RDMA-solar. An RDMA connection is established in the RDMA signaling network based on TCP / IP (RDMA over TCP / IP), and the RDMA network identifier of the container node is allocated. For example, the RDMA network identifier is a Queue Pair Context (QPC) or a connection identifier (Conn-id). In the RDMA data network, data packets are encapsulated based on the RDMA connection for data transmission.

[0040] For the container node, a new RDMA network card is defined in the embodiment of the present application. rd0 is used as an example in the figure, and rd0 is inserted into the Pod namespace.

[0041] The container network management system synchronizes the virtual network address information of the same container node to the address management component, including IP and RDMA network address information. The container network management system associates the virtualization identifier of the container node with the physical network card IP address of the network node where the container node resides, and stores it in the RDMA flow table. It also proxies ND protocol interactions with the gateway device for the physical network card IP address with the embedded virtualization identifier.

[0042] The RDMA driver obtains the virtualization identifier of the container node and the physical network card IP address of the network node where the container node is located from the container network management system, and provides them to the user-side RDMA software stack for RDMA connection establishment. After the connection is established, the table entry included in the RDMA network identifier is sent to the RDMA flow table in the physical network card hardware cache. The table entry included in the RDMA network identifier may include the RDMA network address. The physical network card hardware encapsulates the RDMA data packet and transmits the message. Figure 3 illustrates the encapsulation of RDMA signaling packets and RDMA data packets.

[0043] FIG4 is a flow chart of a communication method provided in an embodiment of the present application. The method is applied to a network system, wherein the network system includes multiple network nodes, each network node includes one or more virtualization nodes, and the virtualization nodes include virtualization nodes and / or virtual machine nodes. Two virtualization nodes communicate with each other based on remote direct data access (RDMA). As shown in FIG4 , the method includes:

[0044] S401. An RDMA connection is established between two virtualized nodes through an RDMA signaling packet. The RDMA signaling packet encapsulates an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header. The virtualization protocol header of the RDMA signaling packet includes the virtualization identifier of the virtualization node that sends the RDMA signaling packet. Different virtualization identifiers are used to identify different virtual networks.

[0045] S402: After establishing an RDMA connection, the two virtualized nodes perform data transmission via RDMA packets. The RDMA packet encapsulation includes an RDMA protocol header and a physical network IP protocol header. The physical network IP protocol header of the RDMA packet includes the virtualization identifier of the virtualized node that sends the RDMA packet.

[0046] The method of the embodiment of the present application is applied to the network system in the aforementioned embodiment. Its implementation principle and technical effects are described in the aforementioned embodiment and will not be repeated here.

[0047] FIG5 is a second flow diagram of a communication method provided by an embodiment of the present application. The method is applied to a first virtualization node on a first network node in a network system. The network system includes multiple network nodes, each of which includes one or more virtualization nodes, each of which includes a container node and / or a virtual machine node. The two virtualization nodes communicate based on remote direct data access (RDMA). As shown in FIG5 , the method includes:

[0048] S501. Establish an RDMA connection with the second virtualization node through an RDMA signaling packet. The encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header. The virtualization protocol header of the RDMA signaling packet includes a virtualization identifier of the first virtualization node. Different virtualization identifiers are used to identify different virtual networks.

[0049] S502. After establishing an RDMA connection with the second virtualization node, send data to the second virtualization node via an RDMA data packet. The encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header. The physical network IP protocol header of the RDMA data packet includes a virtualization identifier of the first virtualization node.

[0050] The method of the embodiment of the present application is applied to the virtualized node in the network system in the aforementioned embodiment. Its implementation principle and technical effects are described in the aforementioned embodiment and will not be repeated here.

[0051] FIG6 is a schematic diagram of the structure of a network node provided in an embodiment of the present application. As shown in FIG6 , the network node 600 includes:

[0052] The connection establishment module 601 establishes an RDMA connection with the second virtualization node through an RDMA signaling packet. The encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header. The virtualization protocol header of the RDMA signaling packet includes the virtualization identifier of the first virtualization node. Different virtualization identifiers are used to identify different virtual networks.

[0053] The transmission module 602 is used to send data to the second virtualization node via an RDMA data packet after establishing an RDMA connection with the second virtualization node. The encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header, and the physical network IP protocol header of the RDMA data packet includes the virtualization identifier of the first virtualization node.

[0054] In one implementation, the virtualization identifier is a virtual extended local area network identifier (VNI).

[0055] In one implementation, the virtual network IP protocol header is an IPv4 protocol header or an IPv6 protocol header, and the physical network IP protocol header is an IPv4 protocol header or an IPv6 protocol header.

[0056] In one implementation, the physical network IP protocol header is an IPv6 protocol header, and the virtualization identifier in the physical network IP protocol header of the RDMA data packet is encoded in the physical network card IPv6 address of the network node.

[0057] In one implementation, the network node 600 includes a discovery module configured to trigger a gateway device in the network system to resolve the physical network card IPv6 address of the network node through a neighbor discovery ND protocol message to obtain a forwarding table entry corresponding to the network node.

[0058] In one implementation, the physical network IP protocol header of the RDMA data packet includes flow control information of the virtualization node that sends the RDMA data packet and / or the network where the virtualization node is located.

[0059] In one implementation, the RDMA protocol header is generated based on the RDMA network identifier of the virtualization node, and the RDMA network identifier of the virtualization node is generated based on the virtualization identifier of the virtualization node and the physical network card IP address of the network node where the virtualization node is located.

[0060] In the network system, communication method, network node and storage medium provided in the present application, in the network system, virtualized nodes on the network nodes communicate based on RDMA, wherein the encapsulation of the RDMA signaling packet used to establish the RDMA connection includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header and a physical network IP protocol header, and the virtualization protocol header includes the virtualization identifier of the virtualization node that sends the RDMA signaling packet, and different virtualization identifiers are used to identify different virtual networks. For the RDMA data packet transmitted between the virtualized nodes after the RDMA connection is established, its encapsulation includes the RDMA protocol header and the physical network IP protocol header. At the same time, in order to ensure the virtual network isolation of the virtualized node, the virtualization identifier of the virtualized node is carried in the physical network IP protocol header of the RDMA data packet, thereby reducing the transmission overhead occupied by the encapsulation of the RDMA data packet while realizing RDMA data transmission, thereby improving network performance.

[0061] The device of the embodiment of the present application is used to implement the method implemented by the network node in the above embodiment. Its implementation principle and technical effects are similar and will not be repeated here.

[0062] Figure 7 is a schematic block diagram of a network node provided in an embodiment of the present application. As shown in Figure 7, the network node 700 may include at least one processor 701 for implementing the communication method provided in an embodiment of the present application.

[0063] In one embodiment, the network node 700 further includes at least one memory 702 for storing program instructions and / or data. The memory 702 is coupled to the processor 701. Coupling in this embodiment refers to an indirect coupling or communication connection between devices, units, or modules, which may be electrical, mechanical, or other forms, and is used for information exchange between the devices, units, or modules. The processor 701 may operate in conjunction with the memory 702. The processor 701 may execute program instructions stored in the memory 702. At least one of the at least one memory may be included in the processor.

[0064] In one embodiment, the network node 700 also includes a communication interface 703 for communicating with other devices via a transmission medium, thereby enabling the distributed system node 700 to communicate with other devices. The communication interface 703 may be, for example, a transceiver, an interface, a bus, a circuit, or a device capable of performing transceiver functions. The processor 701 may utilize the communication interface 703 to transmit and receive data and / or information and to implement the methods provided in the embodiments of the present application. For details, please refer to the detailed description in the previous embodiments and will not be repeated here.

[0065] The specific connection medium between the processor 701, memory 702, and communication interface 703 is not limited in the embodiments of the present application. In Figure 7, the processor 701, memory 702, and communication interface 703 are connected via a bus 704. Bus 704 is represented by a bold line in Figure 7. The connection methods between other components are only for schematic illustration and are not limiting. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, Figure 7 only uses a single bold line, but this does not mean that there is only one bus or only one type of bus.

[0066] It should be understood that the processor in the embodiments of the present application can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above-mentioned method embodiment can be completed by hardware integrated logic circuits in the processor or by software instructions. The above-mentioned processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of the present application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above-mentioned method.

[0067] It should also be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0068] The present application also provides a computer-readable storage medium storing a computer program (also referred to as code or instruction). When the computer program is executed, the computer executes the method in any of the aforementioned embodiments.

[0069] The terms "unit," "module," and the like used in this specification may be used to refer to a computer-related entity, hardware, firmware, a combination of hardware and software, software, or software in execution.

[0070] Those skilled in the art will appreciate that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented using electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application. In the several embodiments provided in this application, it should be understood that the disclosed devices, equipment, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not performed. In addition, the coupling or direct coupling or communication connection shown or discussed can be through some interface, indirect coupling or communication connection of devices or units, and can be electrical, mechanical, or other forms.

[0071] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of the solution of this embodiment according to actual needs.

[0072] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0073] In the above-described embodiments, the functions of each functional unit can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions (programs). When the computer program instructions (program) are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)).

[0074] If this function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

[0075] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0076] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A network system, comprising: A plurality of network nodes, each network node includes one or more virtualization nodes, the virtualization nodes include container nodes and / or virtual machine nodes, and the virtualization nodes communicate with each other based on remote direct data access RDMA; wherein, The RDMA signaling packet between two virtualized nodes is used to establish an RDMA connection between the two virtualized nodes. The encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header. The virtualization protocol header of the RDMA signaling packet includes a virtualization identifier of the virtualization node that sends the RDMA signaling packet. Different virtualization identifiers are used to identify different virtual networks. The RDMA data packet between the two virtualized nodes is used for data transmission after establishing an RDMA connection. The encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header. The physical network IP protocol header of the RDMA data packet includes a virtualization identifier of the virtualized node that sends the RDMA data packet. 2 . The network system according to claim 1 , wherein the virtualization identifier is a virtual extended local area network identifier (VNI).

3. The network system according to claim 1, wherein the virtual network IP protocol header is an IPv4 protocol header or an IPv6 protocol header, and the physical network IP protocol header is an IPv4 protocol header or an IPv6 protocol header.

4. According to the network system of claim 3, the physical network IP protocol header is an IPv6 protocol header, and the virtualization identifier in the physical network IP protocol header of the RDMA data packet is encoded in the physical network card IPv6 address of the network node.

5. The network system according to claim 4, wherein the network node triggers a gateway device in the network system to resolve the physical network card IPv6 address of the network node through a neighbor discovery ND protocol message to obtain a forwarding table entry corresponding to the network node.

6. The network system according to claim 1, wherein the physical network IP protocol header of the RDMA data packet includes flow control information of the virtualization node that sends the RDMA data packet and / or the network node where the virtualization node is located.

7. According to the network system of claim 1, the RDMA protocol header is generated based on the RDMA network identifier of the virtualization node, and the RDMA network identifier of the virtualization node is generated based on the virtualization identifier of the virtualization node and the physical network card IP address of the network node where the virtualization node is located.

8. A communication method, applied to a network system, wherein the network system includes a plurality of network nodes, each network node includes one or more virtualization nodes, the virtualization nodes include virtualization nodes and / or virtual machine nodes, and two virtualization nodes communicate based on remote direct data access (RDMA), the method comprising: An RDMA connection is established between two virtualized nodes through an RDMA signaling packet, wherein the encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header, and the virtualization protocol header of the RDMA signaling packet includes a virtualization identifier of the virtualization node that sends the RDMA signaling packet, and different virtualization identifiers are used to identify different virtual networks; After establishing the RDMA connection, the two virtualized nodes perform data transmission via an RDMA data packet, wherein the encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header, and the physical network IP protocol header of the RDMA data packet includes a virtualization identifier of the virtualized node that sends the RDMA data packet.

9. A communication method, applied to a first virtualization node on a first network node in a network system, wherein the network system includes a plurality of network nodes, each network node includes one or more virtualization nodes, the virtualization nodes include container nodes and / or virtual machine nodes, and two virtualization nodes communicate based on remote direct data access (RDMA), the method comprising: Establishing an RDMA connection with the second virtualization node through an RDMA signaling packet, wherein the encapsulation of the RDMA signaling packet includes an RDMA protocol header, a virtual network IP protocol header, a virtualization protocol header, and a physical network IP protocol header, and the virtualization protocol header of the RDMA signaling packet includes a virtualization identifier of the first virtualization node, and different virtualization identifiers are used to identify different virtual networks; After establishing an RDMA connection with the second virtualization node, data is sent to the second virtualization node via an RDMA data packet, the encapsulation of the RDMA data packet includes an RDMA protocol header and a physical network IP protocol header, and the physical network IP protocol header of the RDMA data packet includes a virtualization identifier of the first virtualization node.

10. A network node, comprising: Memory and processor; The memory is used to store computer programs; The processor is configured to execute a computer program stored in the memory, and the computer program enables the processor to execute the method according to claim 9 when running.

11. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the processor is caused to execute the method according to claim 9.

Citation Information

Patent Citations

  • Data transmission method, device and equipment and storage medium

    CN111193653A

  • Communication method and network card

    CN112243046A

  • Network system, communication method, network node, and storage medium

    CN116566763A

  • Data transmission system, data transmission method, and network device

    WO2022151820A1