Method and equipment for relieving congestion of data backup network

Abstract

The invention provides a method and device for relieving congestion of a data backup network, and the method comprises the steps: obtaining a support compression algorithm index notified by a data backup device; determining that an output port queue length of the backup data is greater than a queue length minimum value but less than a queue ECN value; sending the backup data to the data backup device based on the destination IP address of the backup data; and based on the source IP address of the backup data, notifying a source device of the backup data of the supported compression algorithm index of the data backup device, so that the source device records the compression algorithm index, and compresses subsequent backup data sent to the data backup device according to a corresponding compression algorithm.

Description

Technical Field

[0001] The present application relates to communication technology, and more specifically to a method and device for alleviating data backup network congestion. Background Art

[0002] Currently, distributed storage within data centers regularly synchronizes data across replicas to ensure consistency. Data centers also need to support off-site disaster recovery and regularly back up stored data. When backing up large amounts of data between data centers, the inter-data center network may become congested, as inter-data center networks are typically leased from carriers with limited bandwidth.

[0003] ECN (Explicit Congestion Notification) is an end-to-end congestion control mechanism used in IP networks. Congestion information from network nodes is fed back to the data sender, allowing it to adjust the data transmission rate to avoid congestion. However, the data sender calculates the reduced data transmission rate based on its own congestion control algorithm.

[0004] Although ECN technology can alleviate the network congestion of data center data distribution, it will also reduce the backup efficiency between data centers and extend the data backup time, resulting in the backup time of one piece of data taking up to one or more days to complete.

[0005] However, when the backup data needs to be enabled before the data backup between data centers is completed, the backup data is incomplete, which causes the backup data to become invalid and take a longer time to complete. If the backup data needs to be enabled during this period, the backup data will be unavailable. Summary of the Invention

[0006] The purpose of this application is to provide a method and device for alleviating data backup network congestion, thereby avoiding the unavailability of backup data caused by reduced forwarding speed of backup data.

[0007] To achieve the above-mentioned objectives, the present application provides a method for alleviating data backup network congestion, the method comprising: obtaining a supported compression algorithm index announced by a data backup device; determining that the outbound port queue length of the backup data is greater than the minimum queue length but less than the queue ECN value; sending the backup data to the data backup device based on the destination IP address of the backup data; and notifying the source device of the backup data of the supported compression algorithm index of the data backup device based on the source IP address of the backup data, so that the source device records the compression algorithm index and compresses subsequent backup data sent to the data backup device according to the corresponding compression algorithm.

[0008] To achieve the above-mentioned purpose, the present application also provides a device for alleviating data backup network congestion, the device including a processor and a memory, the processor performing the following operations by running machine-readable instructions recorded in the memory to obtain the supported compression algorithm index announced by the data backup device; determine that the outbound port queue length of the backup data is greater than the minimum queue length but less than the queue ECN value; send the backup data to the data backup device based on the destination IP address of the backup data; based on the source IP address of the backup data, notify the supported compression algorithm index of the data backup device to the source device of the backup data, so that the source device records the compression algorithm index and compresses subsequent backup data sent to the data backup device according to the corresponding compression algorithm.

[0009] The beneficial effect of the present application is that, when the data backup network for transmitting backup data is congested, the switching device notifies the source device to back up the data according to the compression algorithm used by the data backup device. There is no need for a storage program or the server kernel to have message compression capabilities, which is more compatible with current off-site backup. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A flowchart of an embodiment of a method for alleviating data backup network congestion provided by the present application;

[0011] Figure 2 A flowchart of another embodiment of alleviating data backup network congestion is provided for this application;

[0012] Figure 3 A flowchart of an embodiment of data backup network congestion recovery is provided for this application;

[0013] Figure 4 A flowchart of another embodiment of data backup network congestion recovery is provided for this application;

[0014] Figure 5 The device provided for this application is used to alleviate data backup network congestion. DETAILED DESCRIPTION

[0015] The present invention will be described in detail with reference to a plurality of examples shown in the accompanying drawings. In the following detailed description, a number of specific details are provided to provide a comprehensive understanding of the present invention. Known methods, steps, components, and circuits are not described in detail in the examples to avoid obscuring the understanding of the examples.

[0016] Among the terms used, the term "including" means including but not limited to; the term "containing" means including but not limited to; the terms "above," "within," and "below" are inclusive; the terms "greater than" and "less than" are exclusive. The term "based on" means based on at least a portion.

[0017] Figure 1This is a flowchart of an embodiment of a method for alleviating data backup network congestion provided by the present application; the embodiment includes:

[0018] Step 101: Obtain the supported compression algorithm index notified by the data backup device;

[0019] Congestion on data backup networks often occurs on switches. The server's Smart NIC, acting as the data backup device, sends LLDP (Link Layer Discovery Protocol) messages to notify the switch of the backup device's compression algorithm index and compression capabilities. The switch then records the backup device's compression algorithm index. This completely offloads virtual switch functionality from the server CPU to the NIC, freeing up expensive server CPU computing power for application use. This significantly expands NIC functionality and provides higher performance.

[0020] Step 102: Determine that the outbound port queue length of the backup data is greater than the minimum queue length but less than the queue ECN value;

[0021] This application uses the queue length setting of ECN congestion technology to control whether the outbound port queue for sending backup data is congested. The minimum stack length and queue ECN value are set for the outbound port queue of backup data.

[0022] Step 103: Send the backup data to the data backup device based on the destination IP address of the backup data;

[0023] In this application, no congestion flag is set for the backup data to avoid the backup data being discarded by the intermediate device based on the congestion flag, resulting in data backup failure.

[0024] Step 104 : Based on the source IP address of the backup data, the index of the compression algorithm supported by the data backup device is notified to the source device of the backup data.

[0025] The source device records the compression algorithm index and compresses subsequent backup data sent to the data backup device according to the corresponding compression algorithm.

[0026] In this way, when the network is congested, the speed is not reduced first, but the backup data is compressed, which relieves the congestion while ensuring network throughput.

[0027] Figure 1 The beneficial effect of the embodiment is that when the data backup network for transmitting backup data is congested, the switching device notifies the source device to back up the data according to the compression algorithm supported by the data backup device. There is no need for a storage program or the server kernel to have message compression capabilities, which is more compatible with current off-site backup.

[0028] Figure 2 The present application provides a flowchart of another embodiment for alleviating data backup network congestion; the embodiment includes:

[0029] Step 201, determining that the length of the outbound port queue of the backup data is greater than the queue ECN threshold value and less than the queue ECN threshold value;

[0030] Step 202: Send a speed reduction backup notification message to the source device based on the source IP address of the backup data.

[0031] The source device receives the backup speed reduction notification message, stops compressing the data to be backed up, and reduces the sending rate of the data to be backed up to the specified rate.

[0032] The beneficial effect of the present application is that after the source device compresses the backup data, the network congestion worsens, and the switch notifies the source device to reduce the speed of forwarding the backup data to avoid further deterioration of the network congestion.

[0033] Figure 3 A flowchart of an embodiment of data backup network congestion recovery is provided for this application;

[0034] Step 301: Determine that the length of the outbound port queue for backup data is greater than the minimum queue length and less than the queue ECN threshold.

[0035] Step 302: Send a compression release message to the source device based on the source IP address of the backup data.

[0036] The source device receives the compression release message and stops compressing the backup data. The data source device compresses the backup data and sends it. The congestion in the data backup network is relieved, and the switch notifies the source device to stop sending compressed data and send the original backup data at a normal rate.

[0037] Figure 4 A flowchart of an embodiment of data backup network congestion recovery is provided for this application;

[0038] Step 401: Determine whether the length of the outbound queue for backup data is lower than the queue ECN threshold and greater than the minimum queue length.

[0039] Step 402: Send a compression recovery message to the source device based on the source IP address of the backup data.

[0040] The source device receives a compression recovery message, indicating that the backup data transmission rate has been limited, alleviating congestion on the data backup network. To avoid immediately removing all congestion control measures, which would cause repeated congestion on the data backup network, the source device restores the backup data transmission rate based on the compression recovery message. The backup data is compressed according to the recorded compression algorithm index and then sent to the compressed backup data server. This step-by-step recovery method alleviates network congestion.

[0041] Figure 5The present application provides a device for alleviating data backup network congestion. The device 50 includes a processor, memory, a switching chip, and a network interface. The processor executes the following operations by executing machine-readable instructions recorded in the memory: obtaining a supported compression algorithm index announced by the data backup device; determining that the outbound port queue length of the backup data is greater than the minimum queue length but less than the queue ECN value; sending the backup data to the data backup device based on the backup data's destination IP address; and notifying the backup data's source device of the supported compression algorithm index of the data backup device based on the backup data's source IP address, so that the source device records the compression algorithm index and compresses subsequent backup data sent to the data backup device using the corresponding compression algorithm.

[0042] The processor performs the following operations by running machine-readable instructions recorded in the memory to determine that the length of the outbound port queue of the backup data is greater than the minimum queue length and less than the queue ECN threshold; based on the source IP address of the backup data, a compression release message is sent to the source device to cause the source device to stop compressing the data to be backed up.

[0043] The processor performs the following operations by running machine-readable instructions recorded in the memory: when it is determined that the length of the outbound port queue of the backup data is greater than the queue ECN threshold value and less than the queue ECN threshold value, based on the source IP address of the backup data, a speed reduction backup notification message is sent to the source device, so that the source device stops compressing the data to be backed up and reduces the sending rate of the data to be backed up to the specified rate.

[0044] The processor performs the following operations by running machine-readable instructions recorded in the memory to determine that the length of the outbound port queue of the backup data is lower than the queue ECN threshold value and greater than the minimum queue length; based on the source IP address of the backup data, a compression recovery message is sent to the source device to enable the source device to restore the sending rate of the data to be backed up to a normal rate, and compress subsequent backup data sent to the data backup device according to the recorded compression algorithm index.

[0045] The processor executes the operation of obtaining the supported compression algorithm index announced by the data backup device by running the machine-readable instructions recorded in the memory, including receiving the link layer discovery protocol message sent by the data backup device carrying the supported compression algorithm index; and obtaining the supported compression algorithm index from the received link layer discovery protocol message.

[0046] In this application, a machine-readable memory can be any electronic, magnetic, optical, or other physical storage device that stores or contains information (e.g., executable instructions, data, etc.). For example, any machine-readable memory described herein can be any type of random access memory (RAM), volatile memory, non-volatile memory, flash memory, storage drive (e.g., hard drive), solid-state drive, any type of storage optical disk (e.g., CD-ROM, DVD, etc.), and similar devices, or a combination thereof. In addition, any machine-readable memory described herein can be a non-transitory machine-readable memory.

[0047] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for alleviating data backup network congestion, characterized in that: The method comprises, Get the supported compression algorithm index announced by the data backup device; Ensure that the outbound port queue length for backup data is greater than the minimum queue length but less than the queue ECN value. Sending the backup data to a data backup device based on the destination IP address of the backup data; Based on the source IP address of the backup data, the supported compression algorithm index of the data backup device is notified to the source device of the backup data, so that the source device records the compression algorithm index and compresses subsequent backup data sent to the data backup device according to the corresponding compression algorithm.

2. The method according to claim 1, characterized in that The method further comprises, Determine that the outbound port queue length of the backup data is greater than the minimum queue length and less than the queue ECN threshold; Based on the source IP address of the backup data, a compression release message is sent to the source device to enable the source device to stop compressing the data to be backed up.

3. The method according to claim 2, characterized in that When it is determined that the outbound port queue length of the backup data is greater than the queue ECN threshold value and less than the queue ECN threshold value, Based on the source IP address of the backup data, a speed reduction backup notification message is sent to the source device to cause the source device to stop compressing the data to be backed up and reduce the sending rate of the data to be backed up to a specified rate.

4. The method according to claim 3, characterized in that Determine that the outbound port queue length of the backup data is lower than the queue ECN threshold and greater than the minimum queue length; Based on the source IP address of the backup data, a compression recovery message is sent to the source device to enable the source device to restore the sending rate of the data to be backed up to a normal rate, and compress the subsequent backup data sent to the data backup device according to the recorded compression algorithm index.

5. The method according to claim 1, wherein Obtaining the supported compression algorithm index announced by the data backup device refers to receiving a link layer discovery protocol sent by the data backup device carrying the supported compression algorithm index; and obtaining the supported compression algorithm index from the link layer discovery protocol message.

6. A device for alleviating data backup network congestion, characterized in that: The device includes a processor and a memory, and the processor performs the following operations by running machine-readable instructions recorded in the memory: Get the supported compression algorithm index announced by the data backup device; Ensure that the outbound port queue length for backup data is greater than the minimum queue length but less than the queue ECN value. Sending the backup data to a data backup device based on the destination IP address of the backup data; Based on the source IP address of the backup data, the supported compression algorithm index of the data backup device is notified to the source device of the backup data, so that the source device records the compression algorithm index and compresses subsequent backup data sent to the data backup device according to the corresponding compression algorithm.

7. The device according to claim 6, characterized in that The processor executes the following operations by running the machine-readable instructions recorded in the memory: Determine that the outbound port queue length of the backup data is greater than the minimum queue length and less than the queue ECN threshold; Based on the source IP address of the backup data, a compression release message is sent to the source device to enable the source device to stop compressing the data to be backed up.

8. The device according to claim 6, characterized in that The processor executes the following operations by running the machine-readable instructions recorded in the memory: When it is determined that the outbound port queue length of the backup data is greater than the queue ECN threshold value and less than the queue ECN threshold value, Based on the source IP address of the backup data, a speed reduction backup notification message is sent to the source device to cause the source device to stop compressing the data to be backed up and reduce the sending rate of the data to be backed up to a specified rate.

9. The device according to claim 6, characterized in that The processor executes the following operations by running the machine-readable instructions recorded in the memory: Determine that the outbound port queue length of the backup data is lower than the queue ECN threshold and greater than the minimum queue length; Based on the source IP address of the backup data, a compression recovery message is sent to the source device to enable the source device to restore the sending rate of the backup data to a normal rate and compress subsequent backup data sent to the data backup device according to the recorded compression algorithm index.

10. The device according to claim 6, characterized in that The processor executes the operation of obtaining the supported compression algorithm index announced by the data backup device by running the machine-readable instructions recorded in the memory, including: receiving the link layer discovery protocol sent by the data backup device carrying the supported compression algorithm index; obtaining the supported compression algorithm index from the link layer discovery protocol message.

Images