Network fault detection method based on DPU, electronic equipment and computer storage medium
By implementing the network fault detection method on the DPU, using the first detector to obtain the network configuration of the container, accurately detect the network failure of the container and the DPU, the data security problem caused by network failure in the distributed data center is solved, and the security of the data center is improved.
Patent Information
- Application Number
- CN202411589426.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-08
- Publication Date
- 2025-03-07
AI Technical Summary
Existing containers in distributed data centers may experience network failures when running, resulting in data breaches or data tampering, and lack effective network failure detection methods.
By implementing the network fault detection method on the DPU, the first detector sends query instructions to the DPU, obtains the current and preset network configuration of the container, judges whether there is a network failure in the DPU, and performs a network reset if necessary.
This method can accurately detect network failures of containers and DPUs, avoid data leakage or tampering, and improve the security of distributed data centers.
Smart Images
Figure CN119583416A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a DPU-based network fault detection method, electronic device, and computer storage medium. Background Art
[0002] With the development of DPU (Data Processing Unit) technology, more and more nodes in distributed data centers will be equipped with DPU to accelerate the data processing speed of containers (Pods) in the nodes and reduce data transmission delays.
[0003] However, when the existing distributed data center containers are running, network failures may occur. When the network configuration of the container fails, data leakage or data tampering may occur. Therefore, a DPU-based network failure detection method, device, electronic device and computer storage medium are urgently needed. Summary of the invention
[0004] In view of this, embodiments of the present application provide a DPU-based network fault detection method, device, electronic device, and computer storage medium to at least partially solve the above problems.
[0005] According to a first aspect of an embodiment of the present application, a DPU-based network fault detection method is provided, the method comprising:
[0006] The first detector sends a first query instruction to the DPU, where the first query instruction is used to instruct the DPU to send a current network configuration and a preset network configuration of at least one container to the first detector, wherein the first detector and the DPU are both set in a node of a distributed data center;
[0007] The first detector determines whether the DPU has a network failure according to the received current network configuration and preset network configuration of the at least one container.
[0008] In some embodiments, the first detector determines whether the DPU has a network failure based on the received current network configuration and preset network configuration of the at least one container, including:
[0009] The first detector determines whether there is a network fault in the container according to a current network configuration and a preset network configuration of the container;
[0010] If the first detector determines that there is a first container, it determines that the DPU has a network fault, wherein the first container is a container with a network fault.
[0011] In some embodiments, the method further comprises:
[0012] The first detector obtains label information of the first container;
[0013] The first detector sends the label information to the indicator collector of the distributed data center, so that the distributed data center determines the first container according to the label information in the indicator collector.
[0014] In some embodiments, the first detector obtains label information of the first container, including:
[0015] The first detector obtains the preset network configuration of the first container;
[0016] The first detector determines, in a management component of the distributed data center, the label information corresponding to the preset network configuration according to a mapping relationship between the preset network configuration and the label information.
[0017] In some embodiments, before the first detector obtains the label information of the container with the network failure, the method further includes:
[0018] The first detector sends a network reset instruction to the DPU, wherein the network reset instruction is used to instruct the DPU to reconfigure the network of the first container;
[0019] The first detector acquires the current network configuration and the preset network configuration of the first container in response to the received reset completion information;
[0020] When the first detector determines that the network reset fails according to the current network configuration and the preset network configuration of the first container, executing the step of the first detector acquiring the label information of the first container;
[0021] When the first detector determines that the network reset is successful, the first detector determines that the first container is the container without a network failure.
[0022] In some embodiments, the method further comprises:
[0023] The second detector determines the label information of the container in the second query instruction in response to the received second query instruction, wherein one end of the second detector is connected to the indicator collector and the other end is connected to the service agent of the distributed data center;
[0024] The second detector determines whether the label information exists in the indicator collector;
[0025] If so, the second detector sends network fault information to the service agent, wherein the network fault information is used to instruct the service agent to create a second container and replace the first container with the second container;
[0026] If not, the second detector sends network normal information to the service agent.
[0027] In some embodiments, the method further comprises:
[0028] The service agent creates the second container in response to the network fault information;
[0029] The service agent replaces the first container with the second container.
[0030] In some embodiments, the method further comprises:
[0031] The service agent obtains the number of the first containers and the total number of containers;
[0032] When the service agent determines that the number of the first containers reaches a preset threshold, the service agent creates the second container.
[0033] According to the second aspect of an embodiment of the present application, there is provided an electronic device, comprising: a processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other through the communication bus; the memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform operations corresponding to the DPU-based network fault detection method as described in the first aspect.
[0034] According to a third aspect of an embodiment of the present application, a computer storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the DPU-based network fault detection method as described in the first aspect is implemented.
[0035] According to the DPU-based network fault detection method provided in the embodiment of the present application, a first query instruction is sent to the DPU through a first detector, and further, the first detector can determine whether the DPU has a network fault based on the current network configuration and preset network configuration of at least one container received. The embodiment of the present application obtains the current network configuration and preset network configuration of the container through the first detector, and then can accurately determine the container network status through the detected container network configuration, and further determine the network status of the DPU based on the container network status, so that the container network fault can be accurately discovered, avoiding data leakage or data tampering due to the failure of the container network configuration, and improving the security of the distributed data center. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.
[0037] Figure 1 A schematic diagram of the structure of a distributed data platform applicable to an embodiment of the present application;
[0038] Figure 2 A flowchart of a DPU-based network fault detection method according to an embodiment of the present application;
[0039] Figure 3 It is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0040] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the embodiments of the present application should fall within the scope of protection of the embodiments of the present application.
[0041] The specific implementation of the embodiment of the present application is further explained below in conjunction with the accompanying drawings of the embodiment of the present application.
[0042] The present invention provides a DPU-based network fault detection method, which is applied to Figure 1 The distributed data processing platform shown in the figure includes an indicator display component (grafana), an indicator collector (prometheus), an alarm component (alert), a management component (k8s apiserver), a second detector (DPU Healthcontroller&webhook) and multiple nodes, wherein each node includes a DPU, a first detector (DPUtelemetry) and at least one container (Pod). Among them, one end of the first detector is connected to the DPU, and the other end is respectively connected to the management component and the indicator collector of the distributed data platform, one end of the second detector is connected to the indicator, and the other end is connected to the service agent of the distributed data platform through a probe (liviness).
[0043] Specifically, the DPU-based network detection method of the embodiment of the present application is as follows: Figure 2 As shown, specifically including:
[0044] S201: A first detector sends a first query instruction to a DPU.
[0045] In an embodiment of the present application, when the container is running, the first detector sends a first query instruction to the DPU, and the first query instruction is used to instruct the DPU to send the current network configuration and preset network configuration of at least one container to the first detector. After receiving the first query instruction, the DPU responds to the instruction to query the current network configuration and preset network configuration of each container in the node. After the query is completed, the DPU sends the current network configuration and preset network configuration of the container to the first detector.
[0046] In one example, when the DPU sends the current network configuration and the preset network configuration of the container to the first detector, the DPU may query the current network configuration and the preset network configuration of the container and send it to the first detector, or query the current network configuration and the preset network configuration of all containers in the node.
[0047] For example, if there are containers 1, 2, and 3 in the node, the DPU may send the current network configuration and preset network configuration of container 1 to the first detector when querying the current network configuration and preset network configuration of container 1. The DPU may also send the current network configuration and preset network configuration of container 1, container 2, and container 3 to the first detector after querying the current network configuration and preset network configuration of container 1, container 2, and container 3.
[0048] S202: The first detector determines whether a DPU has a network failure according to the received current network configuration and preset network configuration of at least one container.
[0049] In an embodiment of the present application, after receiving the current network configuration and preset network configuration of at least one container sent by the DPU, the first detector compares the current network configuration and the preset network configuration of each container to determine whether there is a network fault in the container, thereby determining whether there is a network fault in the DPU.
[0050] The DPU-based network fault detection method provided in the embodiment of the present application sends a first query instruction to the DPU through a first detector. Further, the first detector can determine whether the DPU has a network fault based on the current network configuration and preset network configuration of at least one container received. The embodiment of the present application obtains the current network configuration and preset network configuration of the container through the first detector, and then can accurately determine the container network status through the detected container network configuration, and further determine the network status of the DPU based on the container network status, so that the container network fault can be accurately detected, avoiding data leakage or data tampering due to the failure of the container network configuration, and improving the security of the distributed data center.
[0051] Further, the first detector of the embodiment of the present application determines whether the DPU has a network failure according to the current network configuration and the preset network configuration of the received at least one container, which may include the following steps:
[0052] S2021: The first detector determines whether there is a network failure in the container according to the current network configuration and the preset network configuration of the container.
[0053] When the first detector of the embodiment of the present application determines whether the DPU has a network fault, the first detector compares the current network configuration of the received container with the preset network configuration to determine whether the current network configuration and the preset network configuration are the same. When the current network configuration and the preset network configuration are the same, the first detector determines that there is no network fault in the container; when the current network configuration is different from the preset network configuration, the first detector determines that there is a network fault in the container.
[0054] S2022: If the first detector determines that there is a first container, it determines that a network failure exists in the DPU.
[0055] In an embodiment of the present application, after determining whether there is a network failure in the container, the first detector collects statistics on the network failure status of the container, so as to determine whether there is a first container with a network failure. When the first detector determines that there is at least one first container, the first detector determines that there is a network failure in the DPU.
[0056] The first detector in the embodiment of the present application can accurately determine whether the container has a network by detecting the network configuration of the container, and then monitor the network status of the container. Furthermore, the first detector can also detect the network status of the DPU through the network status of the container, so as to accurately detect network failures of the container, avoid data leakage or data tampering due to failures in the network configuration of the container, and improve the security of the distributed data center.
[0057] Furthermore, the DPU-based network fault detection method of the embodiment of the present application may also include the following steps:
[0058] S203: The first detector obtains label information of the first container.
[0059] In the embodiment of the present application, after the first detector determines that the first container exists, the first detector obtains label information of the first container in the management component in the distributed data platform.
[0060] In one example, when the first detector obtains the label information of the first container in the management component in the distributed data platform, the first detector obtains the preset network configuration of the first container, and further determines the label information of the first container based on the mapping relationship between the preset network configuration and the label information.
[0061] S204: The first detector sends the label information to the indicator collector of the distributed data center, so that the distributed data center determines the first container according to the label information in the indicator collector.
[0062] In an embodiment of the present application, after determining the label information of the first container, the first detector sends the label information of the first container to an indicator collector of the distributed data platform, so that the distributed data platform can determine the first container based on the label information.
[0063] Furthermore, before the first detector obtains the label information of the container with the network failure, the embodiment of the present application may further include the following steps:
[0064] S205: The first detector sends a network reset instruction to the DPU.
[0065] In the embodiment of the present application, when the first detector determines that the first container exists, the first detector sends a network reset instruction to the DPU to instruct the DPU to reset the network of the first container, and then try to repair the network of the first container. After receiving the network reset instruction, the DPU resets the network of the first container, and when the reset is completed, sends a reset completion message to the first detector.
[0066] S206: The first detector obtains the current network configuration and the preset network configuration of the first container in response to the received reset completion information.
[0067] In the embodiment of the present application, when the first detector receives the reset completion information sent by the DPU, the first detector obtains the current network configuration and the preset network configuration of the first container.
[0068] S207, when the first detector determines that the network reset fails according to the current network configuration and the preset network configuration of the first container, the first detector acquires the label information of the first container.
[0069] In the embodiment of the present application, after the first detector obtains the current network configuration and the preset network configuration of the first container, when the current network configuration is different from the preset network configuration, the first detector determines that the network reset of the first container fails, and executes the step of obtaining the label information of the first container.
[0070] S208: When the first detector determines that the network reset is successful, the first detector determines that the first container is a container without a network failure.
[0071] In the embodiment of the present application, after the first detector obtains the current network configuration and the preset network configuration of the first container, when the current network configuration is the same as the preset network configuration, the first detector determines that the network repair of the first container is successful, and then redetermines the first container as a container without network failure.
[0072] The embodiment of the present application sends a network reset instruction to the DPU through the first detector, so that the DPU can promptly repair the first container, thereby effectively avoiding data leakage or data tampering caused by network failure of the container, and improving the security of the distributed data center.
[0073] Furthermore, the DPU-based network fault detection method of the embodiment of the present application may also include the following steps:
[0074] S209: The second detector determines the label information of the container in the second query instruction in response to the received second query instruction.
[0075] In the embodiment of the present application, the service agent of the distributed data center periodically sends a second query instruction to the second detector to instruct the second detector to query the label information of the container in the indicator collector, so as to determine whether there is a network failure in the container network. After receiving the second query instruction, the second detector parses the label information carried in the second query instruction, and the second detector then queries the indicator collector based on the label information.
[0076] S210: The second detector determines whether there is label information in the indicator collector.
[0077] In the embodiment of the present application, after determining the label information, the second detector queries the indicator collector to determine whether the same label information exists in the indicator collector.
[0078] S211: If yes, the second detector sends network fault information to the service agent.
[0079] In the embodiment of the present application, when the second detector determines that the indicator collector has the same label information as the label information carried in the second query instruction, the second detector determines that the container corresponding to the label information is the first container with a network failure, and sends the network failure information to the service agent. Specifically, the network failure information in the embodiment of the present application is used to instruct the service agent to create a second container and replace the first container with the second container.
[0080] S212: If it does not exist, the second detector sends network normal information to the service agent.
[0081] In an embodiment of the present application, when the second detector determines that there is no label information in the indicator collector that is identical to the label information carried in the second query instruction, the second detector determines that the container corresponding to the label information carried in the second query instruction is a container with a normal network, and then the second detector sends normal network information to the service agent.
[0082] By setting a second detector, the embodiment of the present application can enable the distributed data center to determine whether there is a network failure in the container, and further enable the distributed data center to determine that there is a first container. By creating a new second container to replace the first container, the network failure of the container can be repaired, thereby avoiding data leakage or data tampering due to a failure in the network configuration of the container, thereby improving the security of the distributed data center.
[0083] Furthermore, the DPU-based network fault detection method of the embodiment of the present application may also include the following steps:
[0084] S213: The service agent creates a second container in response to the network failure information.
[0085] In the embodiment of the present application, after receiving the network fault information sent by the second detector, the service agent creates a second container at the location of the first container.
[0086] S214: The service agent replaces the first container with the second container.
[0087] In the embodiment of the present application, when the service agent completes the creation of the second container, it deactivates the first container and replaces the first container with the second container, thereby repairing the network of the container to improve the security of the distributed data center.
[0088] In one example, before creating the second container, the service agent first obtains the number of the first container, and only when the service agent determines that the number of the first container reaches a preset threshold does the service agent create the second container and use the second container to replace the first container.
[0089] Reference Figure 3, shows a schematic diagram of the structure of an electronic device according to an embodiment of the present application. The specific embodiment of the present application does not limit the specific implementation of the electronic device.
[0090] like Figure 3 As shown, the electronic device may include: a processor (processor) 302 , a communication interface (Communications Interface) 304 , a memory (memory) 306 , and a communication bus 308 .
[0091] in:
[0092] The processor 302 , the communication interface 304 , and the memory 306 communicate with each other via the communication bus 308 .
[0093] The communication interface 304 is used to communicate with other electronic devices or servers.
[0094] The processor 302 is used to execute the program 310, and specifically can execute the relevant steps in the above-mentioned DPU-based network fault detection method embodiment.
[0095] Specifically, the program 310 may include program codes, which include computer operation instructions.
[0096] The processor 302 may be a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the smart device may be processors of the same type, such as one or more CPUs; or processors of different types, such as one or more CPUs and one or more ASICs.
[0097] The memory 306 is used to store the program 310. The memory 506 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.
[0098] The program 310 may be specifically configured to enable the processor 302 to perform the following operations:
[0099] In an optional implementation, the program 310 is also used to enable the processor 302 to implement each step in the program 310. The specific implementation can refer to the corresponding steps and corresponding descriptions in the units in the above-mentioned DPU-based network fault detection method embodiment, which will not be repeated here. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the above-described devices and modules can refer to the corresponding process description in the above-mentioned method embodiment, which will not be repeated here.
[0100] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present application can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present application.
[0101] The above-mentioned method according to the embodiment of the present application can be implemented in hardware, firmware, or implemented as software or computer code that can be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk or magneto-optical disk), or implemented as a computer code originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded through a network and to be stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor or programmable or dedicated hardware (such as an ASIC or FPGA). It can be understood that a computer, a processor, a microprocessor controller or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor or hardware, the DPU-based network fault detection method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the DPU-based network fault detection method shown herein, the execution of the code converts the general-purpose computer into a dedicated computer for executing the DPU-based network fault detection method shown herein.
[0102] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application.
[0103] The above implementation methods are only used to illustrate the embodiments of the present application, and are not limitations on the embodiments of the present application. Ordinary technicians in the relevant technical field can make various changes and modifications without departing from the spirit and scope of the embodiments of the present application. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present application. The scope of patent protection of the embodiments of the present application should be limited by the claims.
Claims
1. A network fault detection method based on DPU, characterized in that: The method comprises: The first detector sends a first query instruction to the DPU, where the first query instruction is used to instruct the DPU to send a current network configuration and a preset network configuration of at least one container to the first detector, wherein the first detector and the DPU are both set in a node of a distributed data center; The first detector determines whether the DPU has a network failure according to the received current network configuration and preset network configuration of the at least one container.
2. The method according to claim 1, characterized in that The first detector determines whether the DPU has a network failure according to the received current network configuration and preset network configuration of the at least one container, including: The first detector determines whether there is a network fault in the container according to a current network configuration and a preset network configuration of the container; If the first detector determines that there is a first container, it determines that the DPU has a network fault, wherein the first container is a container with a network fault.
3. The method according to claim 2, characterized in that The method further comprises: The first detector obtains label information of the first container; The first detector sends the label information to the indicator collector of the distributed data center, so that the distributed data center determines the first container according to the label information in the indicator collector.
4. The method according to claim 3, characterized in that: The first detector acquires label information of the first container, including: The first detector obtains the preset network configuration of the first container; The first detector determines, in a management component of the distributed data center, the label information corresponding to the preset network configuration according to a mapping relationship between the preset network configuration and the label information.
5. The method according to claim 3, characterized in that: Before the first detector obtains the label information of the container with the network failure, the method further includes: The first detector sends a network reset instruction to the DPU, wherein the network reset instruction is used to instruct the DPU to reconfigure the network of the first container; The first detector acquires the current network configuration and the preset network configuration of the first container in response to the received reset completion information; When the first detector determines that the network reset fails according to the current network configuration and the preset network configuration of the first container, executing the step of the first detector acquiring the label information of the first container; When the first detector determines that the network reset is successful, the first detector determines that the first container is the container without a network failure.
6. The method according to claim 4 or 5, characterized in that: The method further comprises: The second detector determines the label information of the container in the second query instruction in response to the received second query instruction, wherein one end of the second detector is connected to the indicator collector and the other end is connected to the service agent of the distributed data center; The second detector determines whether the label information exists in the indicator collector; If so, the second detector sends network fault information to the service agent, wherein the network fault information is used to instruct the service agent to create a second container and replace the first container with the second container; If not, the second detector sends network normal information to the service agent.
7. The method according to claim 6, characterized in that The method further comprises: The service agent creates the second container in response to the network fault information; The service agent replaces the first container with the second container.
8. The method according to claim 7, characterized in that The method further comprises: The service agent obtains the number of the first containers and the total number of containers; When the service agent determines that the number of the first containers reaches a preset threshold, the service agent creates the second container.
9. An electronic device, comprising: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform operations corresponding to the DPU-based network fault detection method as described in any one of claims 1-8.
10. A computer storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the DPU-based network fault detection method according to any one of claims 1 to 8 is implemented.