Data processing method, device, first node and storage medium

Abstract

The present application discloses a data processing method, comprising: determining whether an anomaly exists in a first communication link and a second communication link; wherein the first communication link is a communication link between the first node and the second node for processing storage services; and the second communication link is a communication link between the first node and the second node for performing node management; if an anomaly exists in the first communication link and no anomaly exists in the second communication link, processing storage services with the second node via the second communication link. The present application also discloses a data processing device, a first node, and a storage medium.

Description

Technical Field

[0001] The present application relates to data processing technology in the field of communications, and in particular to a data processing method, device, first node and storage medium. Background Art

[0002] A hyper-converged product is one in which computing, storage, and network resources are implemented on a single node, with multiple nodes forming a hyper-converged cluster. When a failure occurs in the storage network between two nodes in the multiple nodes, the storage service interaction between the two nodes is interrupted, and at this time, only one of the two nodes can process the storage service locally. Based on this, in related technologies, when a failure occurs in the storage network between two nodes, the network is usually manually repaired so as to restore the storage network between the two nodes to normal in time, thereby restoring the storage service between the two nodes. However, during the manual repair period, the two nodes are still unable to process storage services, which reduces the ability of the hyper-converged cluster to process storage services. Summary of the Invention

[0003] In order to solve the above technical problems, the embodiments of the present application hope to provide a data processing method, device, first node and storage medium, which solves the problem that storage services cannot be processed between two nodes during manual maintenance, reducing the ability of the hyper-converged cluster to process storage services, and improves the ability of the hyper-converged cluster to process storage services.

[0004] A data processing method, applied to a first node in a hyper-converged cluster, comprising:

[0005] Determining whether there are abnormalities in a first communication link and a second communication link; wherein the first communication link is a communication link between the first node and the second node for processing storage services; and the second communication link is a communication link between the first node and the second node for performing node management;

[0006] When an abnormality occurs in the first communication link and no abnormality occurs in the second communication link, storage services are processed with the second node through the second communication link.

[0007] In the above solution, processing the storage service with the second node through the second communication link includes:

[0008] Determining a first target network address translation NAT rule based on the acquired target data packet, wherein the first target NAT rule includes a first modification operation for modifying a network address corresponding to the first communication link in the target data packet to a network address corresponding to the second communication link;

[0009] Based on the first modification operation, the network address corresponding to the first communication link in the target data packet is modified to the network address corresponding to the second communication link, and based on the modified target data packet and the second communication link, storage services are processed with the second node.

[0010] In the above solution, determining the first target network address translation NAT rule based on the acquired target data packet includes:

[0011] Obtain a second port identifier of a second port providing storage service on the second node, and generate a second NAT rule based on the second port identifier;

[0012] Based on the target data packet, a first target NAT rule is determined from the second NAT rule.

[0013] In the above solution, determining the first target NAT rule from the second NAT rule based on the target data packet includes:

[0014] When it is determined that the target data packet is initiated by the first node, querying the first target NAT rule corresponding to the target port from the second NAT rule based on an identifier of the target port in the target data packet;

[0015] In the above solution, the step of modifying the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link based on the first modification operation includes:

[0016] Based on the first modification operation, the source Internet Protocol IP address in the target data packet is modified to the IP address of the second communication link corresponding to the first node, and the destination IP address in the target data packet is modified to the IP address of the second communication link corresponding to the second node.

[0017] In the above solution, the method further includes:

[0018] Obtain a first port identifier of a first port providing storage service on the first node, and generate a first NAT rule based on the first port identifier;

[0019] Based on the target data packet, a second target NAT rule is determined from the first NAT rule; wherein the second target NAT rule includes a second modification operation for modifying the network address corresponding to the second communication link in the target data packet to the network address corresponding to the first communication link.

[0020] In the above solution, determining the second target NAT rule from the first NAT rule based on the target data packet includes:

[0021] When it is determined that the target data packet is received by the first node, querying the first NAT rule for the second target NAT rule corresponding to the target port based on an identifier of the target port in the target data packet;

[0022] In the above solution, the method further includes:

[0023] Based on the second modification operation, the source IP address in the target data packet is modified to the IP address of the first communication link corresponding to the second node, and the destination IP address in the target data packet is modified to the IP address of the first communication link corresponding to the first node.

[0024] In the above solution, when the first communication link is abnormal and the second communication link is not abnormal, after processing the storage service with the second node through the second communication link, the method further includes:

[0025] When monitoring that the first communication link returns to normal, deleting the first NAT rule and the second NAT rule;

[0026] The communication link for processing storage services between the first node and the second node is switched to the first communication link.

[0027] In the above solution, determining whether there is an abnormality in the first communication link and the second communication link includes:

[0028] Simultaneously monitor whether the first communication link and the second communication link are abnormal.

[0029] In the above solution, before determining whether there is an abnormality in the first communication link and the second communication link, the method further includes:

[0030] Establishing the first communication link based on the first network card of the first node and the first network card of the second node;

[0031] Establishing the second communication link through the switch based on the second network card of the first node and the second network card of the second node;

[0032] A third communication link is established through the switch based on the second network card of the first node and the second network card of the third node; wherein the third communication link is a communication link for performing storage service arbitration between the first node and the third node.

[0033] A data processing device, comprising:

[0034] a determining unit, configured to determine whether there is an abnormality in a first communication link and a second communication link; wherein the first communication link is a communication link between the first node and the second node for processing storage services; and the second communication link is a communication link between the first node and the second node for performing node management;

[0035] A processing unit is configured to process a storage service with the second node through the second communication link when an abnormality occurs in the first communication link and no abnormality occurs in the second communication link.

[0036] A first node, comprising: a processor, a memory, and a communication bus;

[0037] The communication bus is used to realize the communication connection between the processor and the memory;

[0038] The processor is used to execute the data processing program in the memory to implement the steps of the above data processing method.

[0039] A computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the above-mentioned data processing method.

[0040] The data processing method, device, first node and storage medium provided by the embodiments of the present application determine whether there is an abnormality in the first communication link and the second communication link; wherein the first communication link is a communication link for processing storage services between the first node and the second node; the second communication link is a communication link for performing node management between the first node and the second node; when there is an abnormality in the first communication link and there is no abnormality in the second communication link, the storage service is processed with the second node through the second communication link; in this way, when there is an abnormality in the first communication link and there is no abnormality in the second communication link, the storage service can be processed through the second communication link, thereby avoiding the inability to process storage services between the first node and the second node when there is an abnormality in the first communication link, improving the ability of the hyper-converged cluster to process storage services, and not having to wait until the storage network between the first node and the second node returns to normal to process storage services, solving the problem that the storage service cannot be processed between the first node and the second node during manual network maintenance. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 A flowchart of a data processing method provided in an embodiment of the present application;

[0042] Figure 2 A flowchart of another data processing method provided in an embodiment of the present application;

[0043] Figure 3 A schematic diagram of the architecture of a hyper-converged cluster for a data processing method provided in an embodiment of the present application;

[0044] Figure 4 A schematic diagram of the architecture of a hyper-converged cluster in the related technology provided in the embodiments of this application;

[0045] Figure 5 A schematic diagram of the structure of a hyper-converged cluster deployment system for a data processing method provided in an embodiment of the present application;

[0046] Figure 6 A schematic diagram of the structure of a fault monitoring system for a data processing method provided in an embodiment of the present application;

[0047] Figure 7 A flowchart of another data processing method provided in an embodiment of the present application;

[0048] Figure 8 A schematic diagram of the structure of a data processing device provided in an embodiment of the present application.

[0049] Figure 9 A schematic structural diagram of a first node provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application.

[0051] The present application embodiment provides a data processing method that can be applied to the first node in a hyper-converged cluster. Figure 1 As shown, the method includes the following steps:

[0052] Step 101: Determine whether there is an abnormality in the first communication link and the second communication link.

[0053] The first communication link is a communication link between the first node and the second node for processing storage services; the second communication link is a communication link between the first node and the second node for performing node management.

[0054] In an embodiment of the present application, the hyper-converged cluster includes at least a first node and a second node; the first node and the second node are nodes that integrate computing, storage, network and other resources; wherein the first node and the second node can specifically be storage servers that provide storage services in the hyper-converged cluster. The network design in the hyper-converged cluster is divided into a management network and a storage network; wherein the storage network is the network used for communication when the first node and the second node provide storage services; the management network is the network used for node management, which can be specifically understood as the network used by the first node to communicate with the second node when managing the second node; or, the network used by the second node to communicate with the first node when managing the first node. The storage network is a private network between the first node and the second node.

[0055] It should be noted that the first communication link may be a storage network communication link between the first node and the second node; the second communication link may be a management network communication link between the first node and the second node. The first node may detect whether there are any anomalies in the first and second communication links in real time; of course, it may also periodically detect whether there are any anomalies in the first and second communication links; the first node may detect whether there are any anomalies in the first and second communication links simultaneously; the first node may first detect whether there are any anomalies in the first communication link and then detect whether there are any anomalies in the second communication link; of course, the first node may first detect whether there are any anomalies in the second communication link and then detect whether there are any anomalies in the first communication link.

[0056] Specifically, the first node may perform a heartbeat detection on the first communication link to determine whether there is an abnormality in the first communication link, and perform a heartbeat detection on the second communication link to determine whether there is an abnormality in the second communication link.

[0057] Step 102: When an abnormality occurs in the first communication link and an abnormality occurs in the second communication link, a storage service is processed with the second node through the second communication link.

[0058] In an embodiment of the present application, when the first node determines that there is an abnormality in the first communication link and there is no abnormality in the second communication link, the first node and the second node can process storage services through the second communication link, thereby avoiding the situation where the first node and the second node cannot interact with storage services when the first communication link is abnormal, thereby reducing the processing capacity and efficiency of the storage services.

[0059] It should be noted that when there is an abnormality in the first communication link, storage business interaction cannot be carried out between the first node and the second node, and the first node can only process storage business locally. That is to say, the virtual machine running on the first node cannot input / output (I / O) and is completely interrupted, thereby causing a direct loss of 50% of the computing power of the hyper-converged cluster composed of the first node and the second node; when an abnormality is detected in the first communication link, storage business interaction is carried out between the first node and the second node through the second communication link, so that the second node can also process storage business; that is, the virtual machine running on the first node can perform normal I / O, so that the computing power is no longer lost by 50%, but 100% of the computing power is retained, reducing the risk of data loss due to failure of the first node and the second node, and improving the security and reliability of processing storage business.

[0060] The data processing method provided by the embodiment of the present application determines whether there is an abnormality in the first communication link and the second communication link; wherein the first communication link is a communication link for processing storage services between the first node and the second node; the second communication link is a communication link for performing node management between the first node and the second node; when there is an abnormality in the first communication link and there is no abnormality in the second communication link, the storage service is processed with the second node through the second communication link; in this way, when there is an abnormality in the first communication link and there is no abnormality in the second communication link, the storage service can be processed through the second communication link, thereby avoiding the inability to process the storage service between the first node and the second node when there is an abnormality in the first communication link, improving the ability of the hyper-converged cluster to process storage services, and not having to wait until the storage network between the first node and the second node returns to normal to process the storage service, solving the problem that the storage service cannot be processed between the first node and the second node during manual network maintenance.

[0061] Based on the above embodiments, the embodiments of the present application provide a data processing method, referring to Figure 2 As shown, the method includes the following steps:

[0062] Step 201: The first node simultaneously monitors whether there are abnormalities in the first communication link and the second communication link.

[0063] In an embodiment of the present application, the first node can send the first heartbeat information to the second node multiple times through the first communication link at the target time, and send the second heartbeat information to the second node multiple times through the second communication link at the target time; in this way, simultaneous monitoring of the first communication link and the second communication link can be achieved, so that when the first communication link or the second communication link is abnormal, the abnormal situation can be handled in time, reducing the impact of the abnormality of the first communication link or the second communication link on the operation of the hyper-converged cluster and improving the stability of the operation of the hyper-converged cluster.

[0064] If the first feedback information sent by the second node for any of the multiple first heartbeat information is not received in the first time period, it is determined that there is an abnormality in the first communication link. In other words, it is determined that a failure has occurred in the storage network between the first node and the second node. When the first feedback information sent by the second node for any of the first heartbeat information is received in the first time period, it is determined that there is no abnormality in the first communication link.

[0065] In a feasible implementation, when the heartbeat exceeds a specified threshold and is not received, it is determined that the first communication link fails.

[0066] If the second feedback information sent by the second node in response to any of the multiple second heartbeat messages is not received during the second time period, it is determined that an abnormality exists in the second communication link. In other words, a failure has occurred in the management network between the first node and the second node. If the second feedback information sent by the second node in response to any of the second heartbeat messages is received during the second time period, it is determined that no abnormality exists in the second communication link. The first time period and the second time period may be the same; however, the first time period and the second time period may also be different.

[0067] Step 202: When an abnormality exists in the first communication link and no abnormality exists in the second communication link, the first node determines a first target network address translation NAT rule based on the acquired target data packet.

[0068] The first target NAT rule includes a first modification operation for modifying the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link. The target data packet may be a data packet carrying a target communication identifier. The target data packet may be acquired when an anomaly exists in the first communication link and an anomaly does not exist in the second communication link; however, it may also be acquired when an anomaly exists in both the first and second communication links. In one feasible implementation, the target data packet may be a SYN packet.

[0069] In an embodiment of the present application, the target communication identifier can be an identifier representing a newly established Transmission Control Protocol (TCP) connection; wherein, the target data packet can be a handshake data packet initially initiated by the first node when a new TCP connection is established between a client on the first node and a server on the second node, in which case the first node is the sender; the target data packet can also be a handshake data packet initially received by the first node when a TCP connection is established between a server on the first node and a client on the second node, in which case the first node is the receiver.

[0070] It should be noted that the first and second nodes in the hyper-converged cluster both have clients and servers; wherein, the first and second nodes each have one client; and each of the first and second nodes has multiple servers; the number of servers on the first node and the number of servers on the second node may be different; of course, the number of servers on the first node and the number of servers on the second node may also be the same. Each server on the first node corresponds to a first port; and each server on the second node corresponds to a second port. When the first communication link is normal and storage services are being processed between the first and second nodes, a virtual machine running on the first node can initiate an IO request to a first client on the first node. The first client can forward the IO request to the server on the first node, which in turn forwards the IO request to the server on the second node via the first communication link. After receiving the IO request, the server on the first node and the server on the second node can obtain the data to be stored contained in the IO request and store the data to be stored. In the context of storage services, an IO request can be understood as a storage request. Of course, the client on the second node can also initiate IO requests to the server on the second node and the server on the first node.

[0071] In an embodiment of the present application, a target data packet may be parsed to obtain a target port identifier from the target data packet, and then a first target Network Address Translation (NAT) rule matching the target port identifier is determined based on the target port identifier. The target port identifier may be the port number of the destination port in the target data packet.

[0072] It should be noted that step 202 can be implemented through steps A1 to A2:

[0073] Step A1: The first node obtains a second port identifier of a second port providing storage service on the second node, and generates a second NAT rule based on the second port identifier.

[0074] In an embodiment of the present application, after the hyper-converged cluster starts working, the first node can obtain the second port identifier of the second port providing storage services on the second node by monitoring the second node; if an abnormality is detected in the first communication link and no abnormality is detected in the second communication link, a second NAT rule is generated based on the second port identifier. At the same time, the second node can also obtain the first port identifier of the first port providing storage services on the first node by monitoring the first node; in this way, the identifier of the port providing storage services on the other end is stored on the first node and the second node, thereby improving the reliability of subsequent data storage by the first node and the second node.

[0075] In a feasible implementation, the second node may be monitored to obtain a list of Transmission Control Protocol (TCP) interfaces monitored by a process in the second node, and the second port identifier may be obtained from the list, wherein the second port may be a TCP interface on the second node.

[0076] It should be noted that the first node can obtain and store the second port identifier of the second node in real time; if there is an abnormality in the first communication link and there is no abnormality in the second communication link, the second port identifier obtained at the most recent time can be read from the stored second port identifier. The second NAT rule includes the second port identifier and a modification operation for modifying the network address corresponding to the first communication link to the network address corresponding to the second communication link.

[0077] Step A2: The first node determines a first target NAT rule from the second NAT rule based on the target data packet.

[0078] In an embodiment of the present application, the target data packet can be parsed to obtain the identifier of the target port from the target data packet, and based on the identifier of the target port, a NAT rule that matches the identifier of the target port is determined from the second NAT rule to obtain the first target NAT rule.

[0079] It should be noted that step A2 can be implemented through step a1:

[0080] Step a1: When it is determined that the target data packet is initiated by the first node, based on the identifier of the target port, query the first target NAT rule corresponding to the target port from the second NAT rule.

[0081] In an embodiment of the present application, the source of the target data packet can be determined. When the source of the target data packet indicates that the target data packet is initiated by the first node, the NAT rule corresponding to the target port can be queried from the second NAT rule based on the identifier of the target port to obtain the first target NAT rule.

[0082] Step 203: The first node modifies the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link based on the first modification operation, and processes the storage service with the second node based on the modified target data packet and the second communication link.

[0083] In an embodiment of the present application, based on the first modification operation, the source IP address and destination IP address corresponding to the first communication link (i.e., the storage network) in the target data packet can be modified to the source IP address and destination IP address corresponding to the second communication link (management network), and then the modified target data packet can be transmitted to the second node through the second communication link to establish a TCP connection between the first node and the second node through the second communication link, so that the first node and the second node can then process storage services through the second communication link.

[0084] It should be noted that, in step 203, based on the first modification operation, the network address corresponding to the first communication link in the target data packet is modified to the network address corresponding to the second communication link, which can be achieved through step B1:

[0085] Step B1: Based on the first modification operation, the first node modifies the source IP address in the target data packet to the IP address of the second communication link corresponding to the first node, and modifies the destination IP address in the target data packet to the IP address of the second communication link corresponding to the second node.

[0086] The target data packet is an initial handshake data packet for establishing a new TCP connection, and the initial handshake data packet carries a four-tuple; the four-tuple includes a source IP address, a destination IP address, a source port, and a destination port.

[0087] In an embodiment of the present application, when it is determined that the target data packet is initiated by the first node, the source IP address in the quadruple can be modified to the IP address of the second communication link corresponding to the first node based on the first modification operation, and the destination IP address in the quadruple can be modified to the IP address of the second communication link corresponding to the second node.

[0088] It should be noted that the source IP address and destination IP address in the target data packet are modified to the source IP address and destination IP corresponding to the second communication link. When establishing a TCP connection, the target data packet is also sent through the second communication link. However, for the application layer on the first node, it will still be considered as the target data packet sent through the first communication link. In other words, the application layer cannot perceive the change in the link address, which improves the stability of subsequent storage business processing through the second communication link.

[0089] Based on the foregoing embodiment, in other embodiments of the present application, the data processing method further includes:

[0090] Step 204: The first node obtains a first port identifier of a first port providing storage service on the first node, and generates a first NAT rule based on the first port identifier.

[0091] In an embodiment of the present application, after the hyper-converged cluster starts working, the first node can monitor the first port for providing storage services in real time or periodically to obtain a first port identifier. When there is an abnormality in the first communication link and there is no abnormality in the second communication link, the first port identifier obtained at the most recent time from the stored first port identifier can be read, and a first NAT rule can be generated based on the obtained first port identifier. The first NAT rule includes the first port identifier and a modification operation for modifying the network address corresponding to the second communication link to the network address corresponding to the first communication link.

[0092] Step 205: The first node determines a second target NAT rule from the first NAT rule based on the target data packet.

[0093] The second target NAT rule includes a second modification operation for modifying the network address corresponding to the second communication link in the target data packet to the network address corresponding to the first communication link.

[0094] In an embodiment of the present application, the target data packet can be parsed to obtain the identifier of the target port from the target data packet, and based on the identifier of the target port, a NAT rule that matches the identifier of the target port is determined from the first NAT rule to obtain a second target NAT rule.

[0095] It should be noted that step 205 can be implemented by C1:

[0096] Step C1: When it is determined that the target data packet is received by the first node, the first node searches the first NAT rule for a second target NAT rule corresponding to the target port based on the identifier of the target port in the target data packet.

[0097] In an embodiment of the present application, the source of the target data packet can be determined. When the source of the target data packet indicates that the target data packet is received by the first node, the NAT rule that matches the identifier of the target port can be queried from the first NAT rule based on the identifier of the target port in the target data packet to obtain the second target NAT rule.

[0098] The target data packet may be sent by the second node to the first node through the second communication link when an abnormality exists in the first communication link and no abnormality exists in the second communication link. In this case, the first node serves as the receiving end.

[0099] Step 206: Based on the second modification operation, the first node modifies the source IP address in the target data packet to the IP address of the first communication link corresponding to the second node, and modifies the destination IP address in the target data packet to the IP address of the first communication link corresponding to the first node.

[0100] The target data packet is an initial handshake data packet for establishing a new TCP connection, and the initial handshake data packet carries a four-tuple; the four-tuple includes a source IP address, a destination IP address, a source port, and a destination port.

[0101] In an embodiment of the present application, when it is determined that the target data packet is received by the first node, the target data packet is sent from the second node to the first node via the second communication link. The source IP address in the target data packet is the IP address of the second communication link corresponding to the second node, and the destination IP address in the target data packet is the IP address of the second communication link corresponding to the first node. At this time, the first node can modify the source IP address in the quadruple to the IP address of the first communication link corresponding to the second node based on the second modification operation, and modify the destination IP address in the quadruple to the IP address of the first communication link corresponding to the first node, so that the application layer cannot perceive the abnormality of the first communication link, and further enable the first node and the second node to process storage services safely and stably.

[0102] It should be noted that, when the target data packet is received at the first node, the source IP address in the target data packet can be modified to the IP address of the first communication link corresponding to the second node, and the destination IP address can be modified to the IP address of the first communication link corresponding to the first node; in this way, although the first node receives the target data packet through the second communication link when the first communication link is abnormal, when the target data packet is received, the network address corresponding to the second communication link in the target data packet is promptly modified to the network address corresponding to the first communication link. When the application layer captures the target data packet for security detection due to security requirements, it still detects the target data packet received through the first communication link. In this way, the application layer cannot perceive the abnormality of the first communication link, so that the storage business can be processed safely and stably between the first node and the second node.

[0103] Step 207: When it is detected that the first communication link has returned to normal, the first node deletes the first NAT rule and the second NAT rule.

[0104] In an embodiment of the present application, when processing storage services through the second communication link, it is also necessary to perform real-time detection on the first communication link. Specifically, multiple third heartbeat messages can be sent to the second node through the first communication link. When the third feedback message sent by the second node for any third heartbeat message is received, it is determined that the first communication link has returned to normal; when the third feedback message sent by the second node is not received, it indicates that the first communication link has not returned to normal. When it is determined that the first communication link has returned to normal, the first NAT rule and the second NAT rule are deleted. After that, the first node no longer modifies the link address in the target data packet when obtaining the target data packet, so that the storage service can be processed subsequently through the first communication link that has returned to normal.

[0105] Step 208: The first node switches the communication link for processing storage services between the first node and the second node to the first communication link.

[0106] In an embodiment of the present application, switching information can be generated, and based on the switching information, the communication link for processing storage services between the first node and the second node is switched to the first communication link. The switching information can be generated when it is monitored that the first communication link has returned to normal; wherein, the switching information can be used to notify the first node to switch the corresponding link when storing data.

[0107] Based on the foregoing embodiment, in other embodiments of the present application, before determining whether there is an abnormality in the first communication link and the second communication link, the method may further include the following steps:

[0108] Step 209: The first node establishes a first communication link based on the first network card of the first node and the first network card of the second node;

[0109] In an embodiment of the present application, a first address of a first network card of a first node and a second address of a first network card of a second node are obtained, and a first communication link is established based on the first address and the second address, wherein the first address and the second address may be preconfigured.

[0110] Step 210: The first node establishes a second communication link through the switch based on the second network card of the first node and the second network card of the second node.

[0111] In an embodiment of the present application, the third address of the second network card of the first node and the fourth address of the second network card of the second node are obtained, and a second communication link is established through the switch based on the third address and the fourth address. The third address and the fourth address may be pre-configured.

[0112] Step 211: The first node establishes a third communication link through the switch based on the second network card of the first node and the second network card of the third node.

[0113] The third communication link is a communication link for performing storage service arbitration between the first node and the third node.

[0114] In an embodiment of the present application, the fifth address of the second network card of the first node and the sixth address of the second network card of the third node can be obtained, and a third communication link can be established through the switch based on the fifth address and the sixth address.

[0115] The first and second nodes may be data nodes; the third node may be an arbitration node. The first and second nodes are storage servers; the third node is an arbitration server; the third node does not provide storage services. The number of the first, second, and third nodes is one each. The third node provides service arbitration services for server A and server B via a third communication link.

[0116] In one possible implementation, Figure 3 As shown, the first node can be server A, the second node can be server B, and the third node can be arbitration node C; wherein, based on the first address and the second address, the first network card of server A can be directly connected to the first network card of server B, thereby obtaining a first direct communication link between service A and service B, namely, a storage network communication link; based on the third address and the fourth address, the second network card of server A can be connected to the second network card of server B through a gigabit switch, thereby obtaining a second non-direct communication link between server A and server B, namely, a management network communication link; based on the fifth address and the sixth address, the second network card of server A can be connected to the second network card of arbitration node C through a gigabit switch, thereby obtaining a third non-direct communication link between server A and arbitration node C, namely, an arbitration communication link.

[0117] It should be noted that in the related art, the arbitration node C is connected to the storage network through a 10G switch, and the storage business between server A and service B is also communicated through the 10G switch. Figure 4As shown, the first network card of server A and the first network card of server B are connected through a 10 Gigabit switch to enable communication between server A and server B when processing storage services. The second network card of arbitration node C establishes communication with server A through the 10 Gigabit switch, and the second network card of arbitration node C establishes communication with server B through the 10 Gigabit switch to enable the arbitration node to provide storage service arbitration for server A and server B. However, the overhead of 10 Gigabit switches is too high, and the cost is too high. Through the data processing method provided in the embodiment of the present application, server A and server B can be directly connected, and the arbitration node can provide storage service arbitration to server A and server B through the management network. There is no need for a 10 Gigabit switch to enable communication between server A and server B when processing storage services, as in the related art, nor is there a need for a 10 Gigabit switch to provide service arbitration for server A and server B. In this way, the deployment cost of the hyper-converged cluster is reduced.

[0118] Based on the above embodiments, an embodiment of the present application further provides a hyper-converged cluster deployment system, and the data processing method is applied to the hyper-converged cluster deployment system, such as Figure 5 As shown, the system includes a storage client, a storage service, a Domain Name System (DNS) resolution module, a storage management plane and an arbitration server; wherein, the first node and the second node both include a storage client, a storage service, a DNS resolution module and a storage management plane; the third node includes an arbitration server and a DNS resolution module. wherein, in the first node and the second node, the storage client can be referred to as the client, and the storage service can be referred to as the server; the DNS resolution module is responsible for recording the correspondence between the domain name and the IP of each node in the hyper-converged cluster deployment system. The storage management plane is responsible for storage management related operations and for controlling changes in the cluster topology map in the hyper-converged cluster deployment system. By deploying arbitration nodes in the hyper-converged cluster deployment system, the problem of data brain split in the hyper-converged cluster deployment system can be avoided.

[0119] In a feasible implementation, the virtual machine running on the first node can send a storage request, the client on the first node can receive the storage request, and forward the storage request to the server on the first node and the server on the second node according to the configured storage policy. After receiving the storage request, the server writes the data to be stored carried in the storage request to the hard disk medium.

[0120] The arbitration server is responsible for receiving the client's IO arbitration request and writing arbitration-related information to the arbitration node's hard disk media. Although the arbitration server does not store business data, the client still needs to send a storage request to the arbitration server when sending a storage request.

[0121] In order to improve the stability of the hyper-converged cluster deployment system when providing storage services, the embodiment of the present application also provides a fault monitoring system, which is applied to the first node and the second node, such as Figure 6 As shown, the system includes a network fault processing module, a network monitoring module, a NAT module, and a storage service configuration module. The following application scenario uses the fault monitoring system applied on the first node to explain in detail the working process of each module in the fault monitoring system.

[0122] In a feasible implementation, the first node may be host A, and the second node may be host B. Figure 7 As shown, the network monitoring module on host A can monitor whether there is an abnormality in the storage network between host A and host B by sending a first heartbeat message, and can also send a second heartbeat message to monitor whether there is an abnormality in the management network between host B. When it is determined that there is an abnormality in the storage network between host A and host B, the network monitoring module can send a storage network failure event to the network fault processing module. After receiving the storage network failure event, the network fault processing module reads the second port identifier of the second port providing storage service on host B from the storage service configuration module, generates a second NAT rule based on the second port identifier, and sends the second NAT rule to the NAT module, so that the NAT module stores the data in the newly created TCP data packet. The IP address corresponding to the network is modified to the IP address corresponding to the management network, so as to switch the traffic of the storage network to the management network, so as to realize data storage between host A and host B through the management network; of course, the first node can also obtain the first port identifier of the first port for which it provides storage services, and generate a first NAT rule based on the first port identifier, so that when the first node acts as a receiving end and receives a new TCP data packet sent by the second node through the second communication link, the IP address corresponding to the management network in the new TCP data packet is modified to the IP address corresponding to the storage network, so that the application layer of the first node cannot perceive the abnormality of the first communication link, thereby improving the stability of the subsequent storage business processing between the first node and the second node. The data in the storage service configuration module on the first node and the storage service configuration module on the second node can be synchronized in real time. Figure 6 The NAT rules shown in FIG include a first NAT rule and a second NAT rule.

[0123] Among them, when the network monitoring module detects that the storage network has returned to normal, it can send a normal storage network event to the network fault handling module. After receiving the event, the network fault handling module will automatically delete the first NAT rule and the second NAT rule, and generate switching information to restore the storage network traffic and switch back to the storage network.

[0124] It should be noted that in actual applications, the fault monitoring system needs to be deployed on both the first and second nodes to monitor the storage network and management network in the hyper-converged cluster. This allows for timely processing of network failures, improving the stability of hyper-converged cluster service processing. In the event of a storage network failure, storage services can be promptly switched to the management network. This allows the virtual machine on the first node to run in two copies, rather than a single copy, reducing the risk of data loss due to dual-node failures.

[0125] It should be noted that, for the description of the same steps and contents in this embodiment as those in other embodiments, reference can be made to the description in other embodiments and will not be repeated here.

[0126] The data processing method provided in the embodiments of the present application can process storage services through the second communication link when there is an abnormality in the first communication link and there is no abnormality in the second communication link, thereby avoiding the inability to process storage services between the first node and the second node when there is an abnormality in the first communication link, improving the ability of the hyper-converged cluster to process storage services, eliminating the need to process storage services after the storage network between the first node and the second node returns to normal, and solving the problem of being unable to process storage services between the first node and the second node during manual network maintenance.

[0127] Based on the above embodiments, the embodiments of the present application provide a data processing device, which can be applied to Figures 1-2 In the data processing method provided in the corresponding embodiment, refer to Figure 8 As shown, the data processing device 3 may include:

[0128] The determining unit 31 is configured to determine whether there is an abnormality in the first communication link and the second communication link; wherein the first communication link is a communication link between the first node and the second node for processing storage services; and the second communication link is a communication link between the first node and the second node for performing node management.

[0129] The processing unit 32 is configured to process the storage service with the second node via the second communication link when an abnormality occurs in the first communication link and no abnormality occurs in the second communication link.

[0130] In the embodiment of the present application, the processing unit 32 is further configured to perform the following steps:

[0131] Determining a first target network address translation NAT rule based on the acquired target data packet, the first target NAT rule including a first modification operation for modifying a network address corresponding to the first communication link in the target data packet to a network address corresponding to the second communication link;

[0132] Based on the first modification operation, the network address corresponding to the first communication link in the target data packet is modified to the network address corresponding to the second communication link, and based on the modified target data packet and the second communication link, the storage service is processed with the second node.

[0133] In the embodiment of the present application, the processing unit 32 is further configured to perform the following steps:

[0134] Obtain a second port identifier of a second port providing storage service on the second node, and generate a second NAT rule based on the second port identifier;

[0135] Based on the target data packet, a first target NAT rule is determined from the second NAT rule.

[0136] In the embodiment of the present application, the processing unit 32 is further configured to perform the following steps:

[0137] When it is determined that the target data packet is initiated by the first node, querying the first target NAT rule corresponding to the target port from the second NAT rule based on the identifier of the target port;

[0138] Accordingly, based on the first modification operation, modifying the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link includes:

[0139] Based on the first modification operation, the source Internet Protocol IP address in the target data packet is modified to the IP address of the second communication link corresponding to the first node, and the destination IP address in the target data packet is modified to the IP address of the second communication link corresponding to the second node.

[0140] In the embodiment of the present application, the processing unit 32 is further configured to perform the following steps:

[0141] Obtain a first port identifier of a first port providing storage service on the first node, and generate a first NAT rule based on the first port identifier;

[0142] Based on the target data packet, a second target NAT rule is determined from the first NAT rule; wherein the second target NAT rule includes a second modification operation for modifying the network address corresponding to the second communication link in the target data packet to the network address corresponding to the first communication link.

[0143] In the embodiment of the present application, the processing unit 32 is further configured to perform the following steps:

[0144] When it is determined that the target data packet is received by the first node, querying a second target NAT rule corresponding to the target port from the first NAT rule based on an identifier of the target port in the target data packet;

[0145] Accordingly, the method further includes:

[0146] Based on the second modification operation, the source IP address in the target data packet is modified to the IP address of the first communication link corresponding to the second node, and the destination IP address in the target data packet is modified to the IP address of the first communication link corresponding to the first node.

[0147] In the embodiment of the present application, the processing unit 32 is further configured to perform the following steps:

[0148] When it is detected that the first communication link is restored to normal, deleting the first NAT rule and the second NAT rule;

[0149] The communication link for processing the storage service between the first node and the second node is switched to the first communication link.

[0150] In the embodiment of the present application, the determining unit 31 is further configured to perform the following steps:

[0151] Simultaneously monitor whether there are any abnormalities in the first communication link and the second communication link.

[0152] In the embodiment of the present application, the processing unit 32 is further configured to perform the following steps:

[0153] Establishing a first communication link based on the first network card of the first node and the first network card of the second node;

[0154] Establishing a second communication link through the switch based on the second network card of the first node and the second network card of the second node;

[0155] A third communication link is established through the switch based on the second network card of the first node and the second network card of the third node; wherein the third communication link is a communication link for performing storage service arbitration between the first node and the third node.

[0156] It should be noted that the interaction process between the various units in the embodiment of the present application can refer to Figures 1-2 The implementation process of the data processing method provided in the corresponding embodiment will not be repeated here.

[0157] The data processing device provided in the embodiment of the present application can process storage services through the second communication link when there is an abnormality in the first communication link and there is no abnormality in the second communication link, thereby avoiding the inability to process storage services between the first node and the second node when there is an abnormality in the first communication link, improving the ability of the hyper-converged cluster to process storage services, eliminating the need to wait until the storage network between the first node and the second node returns to normal before processing storage services, and solving the problem of being unable to process storage services between the first node and the second node during manual network maintenance.

[0158] Based on the above embodiments, the embodiments of the present application provide a first node, which can be applied to Figures 1-2 In the data processing method provided in the corresponding embodiment, refer to Figure 9 As shown, the first node 4 may include: a processor 41, a memory 42 and a communication bus 43, wherein:

[0159] The communication bus 43 is used to realize the communication connection between the processor 41 and the memory 42;

[0160] The processor 41 is configured to execute the data processing program stored in the memory 42 to implement the following steps:

[0161] Determine whether there are abnormalities in a first communication link and a second communication link; wherein the first communication link is a communication link between the first node and the second node for processing storage services; and the second communication link is a communication link between the first node and the second node for performing node management;

[0162] When an abnormality occurs in the first communication link and no abnormality occurs in the second communication link, the storage service is processed with the second node through the second communication link.

[0163] In other embodiments of the present application, the processor 41 is configured to execute the data processing program stored in the memory 42 to process storage services with the second node through the second communication link, so as to implement the following steps:

[0164] Determining a first target network address translation NAT rule based on the acquired target data packet, the first target NAT rule including a first modification operation for modifying a network address corresponding to the first communication link in the target data packet to a network address corresponding to the second communication link;

[0165] Based on the first modification operation, the network address corresponding to the first communication link in the target data packet is modified to the network address corresponding to the second communication link, and based on the modified target data packet and the second communication link, the storage service is processed with the second node.

[0166] In other embodiments of the present application, the processor 41 is configured to execute the data processing program stored in the memory 42 to determine the first target network address translation NAT rule based on the acquired target data packet, including:

[0167] Obtain a second port identifier of a second port providing storage service on the second node, and generate a second NAT rule based on the second port identifier;

[0168] Based on the target data packet, a first target NAT rule is determined from the second NAT rule.

[0169] In other embodiments of the present application, the processor 41 is configured to execute the data processing program stored in the memory 42 to determine the first target NAT rule from the second NAT rule based on the target data packet, so as to implement the following steps:

[0170] When it is determined that the target data packet is initiated by the first node, querying the first target NAT rule corresponding to the target port from the second NAT rule based on the identifier of the target port in the target data packet;

[0171] Accordingly, based on the first modification operation, modifying the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link includes:

[0172] Based on the first modification operation, the source Internet Protocol IP address in the target data packet is modified to the IP address of the second communication link corresponding to the first node, and the destination IP address in the target data packet is modified to the IP address of the second communication link corresponding to the second node.

[0173] In other embodiments of the present application, the processor 41 is configured to execute the data processing program stored in the memory 42 to implement the following steps:

[0174] Obtain a first port identifier of a first port providing storage service on the first node, and generate a first NAT rule based on the first port identifier;

[0175] Based on the target data packet, a second target NAT rule is determined from the first NAT rule; wherein the second target NAT rule includes a second modification operation for modifying the network address corresponding to the second communication link in the target data packet to the network address corresponding to the first communication link.

[0176] In other embodiments of the present application, the processor 41 is configured to execute, in the data processing program stored in the memory 42, a step of determining, based on the target data packet, the second target NAT rule from the first NAT rule, to implement the following steps:

[0177] When it is determined that the target data packet is received by the first node, querying a second target NAT rule corresponding to the target port from the first NAT rule based on an identifier of the target port in the target data packet;

[0178] Accordingly, the method further includes:

[0179] Based on the second modification operation, the source IP address in the target data packet is modified to the IP address of the first communication link corresponding to the second node, and the destination IP address in the target data packet is modified to the IP address of the first communication link corresponding to the first node.

[0180] In other embodiments of the present application, the processor 41 is configured to execute the data processing program stored in the memory 42 to implement the following steps:

[0181] When it is detected that the first communication link is restored to normal, deleting the first NAT rule and the second NAT rule;

[0182] The communication link for processing the storage service between the first node and the second node is switched to the first communication link.

[0183] In other embodiments of the present application, the processor 41 is configured to execute the data processing program stored in the memory 42 to determine whether there is an abnormality in the first communication link and the second communication link, so as to implement the following steps:

[0184] Simultaneously monitor whether there are any abnormalities in the first communication link and the second communication link.

[0185] In other embodiments of the present application, the processor 41 is configured to execute the data processing program stored in the memory 42 to implement the following steps:

[0186] Establishing a second communication link through the switch based on the second network card of the first node and the second network card of the second node;

[0187] A third communication link is established through the switch based on the second network card of the first node and the second network card of the third node; wherein the third communication link is a communication link for performing storage service arbitration between the first node and the third node.

[0188] It should be noted that the specific implementation process of the steps executed by the processor in this embodiment can be referred to Figures 1-2 The implementation process of the data processing method provided in the corresponding embodiment will not be repeated here.

[0189] The first node provided in the embodiment of the present application can process storage services through the second communication link when there is an abnormality in the first communication link and there is no abnormality in the second communication link, thereby avoiding the inability to process storage services between the first node and the second node when there is an abnormality in the first communication link, improving the ability of the hyper-converged cluster to process storage services, eliminating the need to wait until the storage network between the first node and the second node returns to normal before processing storage services, and solving the problem of being unable to process storage services between the first node and the second node during manual network maintenance.

[0190] Based on the above embodiments, the embodiments of the present application provide a computer-readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement Figures 1-2 The steps in the data processing method provided by the corresponding embodiment.

[0191] It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0192] It should be noted that the above-mentioned computer-readable storage medium can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface storage, an optical disc, or a compact disc read-only memory (CD-ROM); it can also be various electronic devices that include one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0193] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0194] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0195] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0196] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0197] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0198] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0199] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A data processing method, characterized in that: Applied to a first node in a cluster, the cluster also including a second node, the first node and the second node both integrating computing, storage, and network resources, the method comprising: Establishing a first communication link based on the first network card of the first node and the first network card of the second node; Establishing a second communication link through the switch based on the second network card of the first node and the second network card of the second node; Determining whether there are abnormalities in a first communication link and a second communication link; wherein the first communication link is a storage network communication link between the first node and the second node for processing storage services; the second communication link is a management network communication link between the first node and the second node for performing node management; and the storage network is a private network between the first node and the second node; When an abnormality exists in the first communication link and an abnormality does not exist in the second communication link, obtaining a second port identifier of a second port providing storage service on the second node, and generating a second NAT rule based on the second port identifier; Obtain a first port identifier of a first port providing storage service on the first node, and generate a first NAT rule based on the first port identifier; When it is determined that the acquired target data packet is initiated by the first node, querying a first target NAT rule corresponding to the target port from the second NAT rule based on an identifier of the target port in the target data packet; the first target NAT rule includes a first modification operation for modifying the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link; When it is determined that the target data packet is received by the first node, querying a second target NAT rule corresponding to the target port from the first NAT rule based on an identifier of the target port in the target data packet; Based on the first modification operation, the network address corresponding to the first communication link in the target data packet is modified to the network address corresponding to the second communication link, and based on the modified target data packet and the second communication link, storage services are processed with the second node.

2. The method according to claim 1, characterized in that The modifying, based on the first modification operation, the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link includes: Based on the first modification operation, the source Internet Protocol IP address in the target data packet is modified to the IP address of the second communication link corresponding to the first node, and the destination IP address in the target data packet is modified to the IP address of the second communication link corresponding to the second node.

3. The method according to claim 1, characterized in that The second target NAT rule includes a second modification operation for modifying the network address corresponding to the second communication link in the target data packet to the network address corresponding to the first communication link.

4. The method according to claim 3, characterized in that The method further comprises: Based on the second modification operation, the source IP address in the target data packet is modified to the IP address of the first communication link corresponding to the second node, and the destination IP address in the target data packet is modified to the IP address of the first communication link corresponding to the first node.

5. The method according to claim 1, wherein In the case where the first communication link is abnormal and the second communication link is not abnormal, after processing the storage service with the second node through the second communication link, the method further includes: When monitoring that the first communication link returns to normal, deleting the first NAT rule and the second NAT rule; The communication link for processing storage services between the first node and the second node is switched to the first communication link.

6. The method according to claim 1, characterized in that Determining whether there is an abnormality between the first communication link and the second communication link includes: Simultaneously monitor whether the first communication link and the second communication link are abnormal.

7. The method according to claim 1, characterized in that Before determining whether there is an abnormality in the first communication link and the second communication link, the method further includes: A third communication link is established through the switch based on the second network card of the first node and the second network card of the third node; wherein the third communication link is a communication link for performing storage service arbitration between the first node and the third node.

8. A data processing device, characterized in that: The device comprises: A processing unit, configured to establish a first communication link based on a first network card of a first node and a first network card of a second node; the first node and the second node both integrate computing, storage, and network resources; The processing unit is further configured to establish a second communication link through the switch based on the second network card of the first node and the second network card of the second node; a determining unit configured to determine whether there are abnormalities in a first communication link and a second communication link; wherein the first communication link is a storage network communication link between the first node and the second node for processing storage services; the second communication link is a management network communication link between the first node and the second node for performing node management; and the storage network is a private network between the first node and the second node; The processing unit is further configured to, when an abnormality exists in the first communication link and no abnormality exists in the second communication link, obtain the second port identifier of the second port providing storage services on the second node, and generate a second NAT rule based on the second port identifier; obtain the first port identifier of the first port providing storage services on the first node, and generate a first NAT rule based on the first port identifier; when it is determined that the obtained target data packet is initiated by the first node, query the first target NAT rule corresponding to the target port from the second NAT rule based on the identifier of the target port in the target data packet; the first target NAT rule includes a first modification operation for modifying the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link; when it is determined that the target data packet is received by the first node, query the second target NAT rule corresponding to the target port from the first NAT rule based on the identifier of the target port in the target data packet; based on the first modification operation, modify the network address corresponding to the first communication link in the target data packet to the network address corresponding to the second communication link, and process storage services with the second node based on the modified target data packet and the second communication link.

9. A first node, characterized in that: The first node includes: a processor, a memory and a communication bus; The communication bus is used to realize the communication connection between the processor and the memory; The processor is used to execute the data processing program in the memory to implement the steps of the data processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the data processing method according to any one of claims 1 to 7.

Images