Fault recovery method and device, computer equipment, readable storage medium and program product

Abstract

The invention relates to a fault recovery method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: if a virtual network element in a network meets a fault condition, determining an actual restart number of a target time point; and initiating restart of the virtual network element corresponding to the actual restart number of the target time point at the target time point, and determining the restart success rate of the virtual network element at the target time point. And based on the restart success rate of the target time point and a preset number adjustment strategy, determining an actual restart number of a next target time point of the target time point, and re-executing restart of the virtual network element corresponding to the restart number of the target time point at the target time point. And determining a restart success rate of the virtual network element at the target time point until the virtual network element is determined not to meet the fault condition, so that a restart storm of the virtual network element after the local side equipment in the network has a fault can be avoided, and rapid recovery of the fault is realized.

Description

Technical Field

[0001] The present application relates to the field of cloud computing technology, and in particular to a fault recovery method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] In the scenarios of new metropolitan area networks and converged edge in cloud-network integration, massive virtualized network elements are applied to operational-level networks. When the physical hardware equipment in the network fails, the virtualized network elements in the network will initiate a reconnection request when they determine that they have lost network connection, that is, a large number of virtualized network elements will restart and establish external connections. Since the virtualized network elements are through cloud software, their restart speed and connection initiation speed are much faster than the restart speed of the physical hardware equipment in the network, which will cause an impact on the external network and cause secondary failures. Summary of the invention

[0003] Based on this, it is necessary to provide a fault recovery method, apparatus, computer equipment, computer-readable storage medium and computer program product that can improve the reliability of virtualized network element and network communication in response to the above technical problems.

[0004] In a first aspect, the present application provides a fault recovery method, comprising:

[0005] If the virtual network elements in the network meet the fault condition, determining the actual restart number at the target time point, where the restart number corresponding to the target time point being the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time;

[0006] At the target time point, initiating a restart of the virtual network elements corresponding to the actual restart number at the target time point, and determining a restart success rate of the virtual network elements at the target time point;

[0007] Based on the restart success rate of the target time point and the preset number adjustment strategy, the actual restart number of the next target time point of the target time point is determined, and based on the actual restart number of the next target time point, the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point and determining the restart success rate of the virtual network elements at the target time point are re-executed until it is determined that the virtual network element does not meet the fault condition.

[0008] In one embodiment, the target time point is an initial time point, and if the virtual network element in the network meets the failure condition, determining the actual restart number at the target time point includes:

[0009] When it is determined that each virtual network element in the network is disconnected from the network and the fault condition is met, the theoretical restart number at the initial time point is determined, and the theoretical restart number at the initial time point is used as the actual restart number at the initial time point.

[0010] In one embodiment, the method further comprises:

[0011] Calculate the initial completion time based on the maximum restart rate corresponding to the network and the total number of network elements that need to be restarted;

[0012] Based on the initial completion time and the preset buffer time, a target completion time is obtained;

[0013] The target time point and the target completion time are processed by a preset trigonometric function to obtain a first adjustment parameter, and a second adjustment parameter is obtained based on the total number of network elements that need to be restarted and the target completion time. The sum of the first adjustment parameter and the second adjustment parameter is determined as the theoretical restart number corresponding to the target time point.

[0014] In one embodiment, determining the actual restart number at the next target time point of the target time point based on the restart success rate at the target time point and a preset number adjustment strategy includes:

[0015] Calculating initial adjustment parameters based on a preset number adjustment strategy and a failure rate corresponding to a restart success rate at the target time point;

[0016] Based on the initial adjustment parameter, the relationship between the failure rate at the target time point and a preset failure rate threshold, the target adjustment parameter is determined, and based on the target adjustment parameter, the theoretical restart number corresponding to the next target time point of the target time point is adjusted to obtain the actual restart number of the next target time point.

[0017] In one embodiment, determining the target adjustment parameter based on the relationship between the initial adjustment parameter, the failure rate at the target time point and a preset failure rate threshold includes:

[0018] If the failure rate at the target time point is greater than or equal to a preset failure rate threshold, the difference between the target value and the initial adjustment parameter is determined as the target adjustment parameter; or,

[0019] If the failure rate at the target time point is less than a preset failure rate threshold, the sum of the target value and the initial adjustment parameter is determined as the target adjustment parameter.

[0020] In one embodiment, determining the actual restart number at the next target time point of the target time point based on the restart success rate at the target time point and a preset number adjustment strategy includes:

[0021] Based on the failure rate corresponding to the restart success rate at the target time point, in the preset number adjustment strategy, the restart number matching the failure rate is queried, and the restart number matching the failure rate is determined to be the actual restart number at the next time point after the target time point.

[0022] In a second aspect, the present application also provides a fault recovery device, including:

[0023] A first determination module is used to determine the actual restart number at a target time point if the virtual network element in the network meets the fault condition, wherein the restart number corresponding to the target time point being the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time;

[0024] An initiating module, configured to initiate, at the target time point, a restart of the virtual network elements corresponding to the actual restart number at the target time point, and determine a restart success rate of the virtual network elements at the target time point;

[0025] The second determination module is used to determine the actual restart number of the next target time point of the target time point based on the restart success rate of the target time point and a preset number adjustment strategy, and based on the actual restart number of the next target time point, re-execute the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point, and determining the restart success rate of the virtual network elements at the target time point until it is determined that the virtual network element does not meet the fault condition.

[0026] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0027] If the virtual network elements in the network meet the fault conditions, the actual restart number at the target time point is determined. The corresponding restart number when the target time point is the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time.

[0028] At the target time point, initiating the restart of the virtual network elements corresponding to the actual restart number at the target time point, and determining the restart success rate of the virtual network elements at the target time point;

[0029] Based on the restart success rate of the target time point and the preset number adjustment strategy, the actual restart number of the next target time point of the target time point is determined, and based on the actual restart number of the next target time point, the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point and determining the restart success rate of the virtual network elements at the target time point are re-executed until it is determined that the virtual network elements do not meet the fault conditions.

[0030] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0031] If the virtual network elements in the network meet the fault conditions, the actual restart number at the target time point is determined. The corresponding restart number when the target time point is the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time.

[0032] At the target time point, initiating the restart of the virtual network elements corresponding to the actual restart number at the target time point, and determining the restart success rate of the virtual network elements at the target time point;

[0033] Based on the restart success rate of the target time point and the preset number adjustment strategy, the actual restart number of the next target time point of the target time point is determined, and based on the actual restart number of the next target time point, the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point and determining the restart success rate of the virtual network elements at the target time point are re-executed until it is determined that the virtual network elements do not meet the fault conditions.

[0034] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0035] If the virtual network elements in the network meet the fault conditions, the actual restart number at the target time point is determined. The corresponding restart number when the target time point is the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time.

[0036] At the target time point, initiating the restart of the virtual network elements corresponding to the actual restart number at the target time point, and determining the restart success rate of the virtual network elements at the target time point;

[0037] Based on the restart success rate of the target time point and the preset number adjustment strategy, the actual restart number of the next target time point of the target time point is determined, and based on the actual restart number of the next target time point, the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point and determining the restart success rate of the virtual network elements at the target time point are re-executed until it is determined that the virtual network elements do not meet the fault conditions.

[0038] The above-mentioned fault recovery method, device, computer equipment, computer-readable storage medium and computer program product, wherein the method may include: if the virtual network elements in the network meet the fault conditions, then determining the actual restart number at the target time point, the corresponding restart number when the target time point is the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted and the target completion time; at the target time point, initiating the restart of the virtual network elements corresponding to the actual restart number at the target time point, and determining the restart success rate of the virtual network elements at the target time point; based on the restart success rate at the target time point and a preset number adjustment strategy, determining the actual restart number of the next target time point of the target time point, and based on the actual restart number of the next target time point, re-executing the steps of initiating the restart of the virtual network elements corresponding to the restart number at the target time point at the target time point, and determining the restart success rate of the virtual network elements at the target time point, until it is determined that the virtual network elements do not meet the fault conditions.

[0039] By adopting this method, the restart storm of virtual network elements after the failure of the local end equipment in the network can be avoided, and each virtual network element can smoothly re-initiate the network connection when the failure is recovered, avoiding the fluctuation of the user's online rate. The backup equipment in the network can quickly process the restarted virtual network elements to achieve rapid recovery from the failure. The restart number of the virtual gateway during the restart process is controlled by a preset number adjustment strategy, so as to achieve high efficiency of the network reconstruction process, support multiple number adjustment strategies, and more effectively adapt to the actual application scenarios of various networks. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 An application environment diagram of a fault recovery method in an embodiment;

[0042] Figure 2 A schematic diagram of a process flow of a fault recovery method in an embodiment;

[0043] Figure 3 A schematic flow chart of the steps of determining the theoretical restart number in one embodiment;

[0044] Figure 4 A schematic diagram of a process for determining an actual restart number in one embodiment;

[0045] Figure 5 is a schematic diagram of a system architecture in an embodiment;

[0046] Figure 6 A curve diagram of the number of online users per second in one embodiment;

[0047] Figure 7 A curve diagram of the theoretical restart number in one embodiment;

[0048] Figure 8 A curve diagram of the actual number of restarts in one embodiment;

[0049] Fig. 9 is a schematic diagram of grouping virtual network elements in one embodiment;

[0050] Fig.10 is a flowchart of a fault recovery method in another embodiment;

[0051] Fig.11 is a structural block diagram of a fault recovery device in one embodiment;

[0052] Fig.12 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0054] The fault recovery method provided in the embodiment of the present application can be applied to Figure 1In the application environment shown. The specific application scenario can be a new metropolitan area network and converged edge scenario for cloud-network integration, which includes a server cluster and multiple local end devices. The virtual network element (virtualized network element) 100 in the server cluster communicates with the local end device 200 in the network through the metropolitan area network. For example, a local end device 200 in the network can hang multiple virtual network elements 100, and the network is also configured with a backup local end device of the local end device 200. When the local end device fails and cannot provide communication for the multiple virtual network elements hanging below, the network provided by this embodiment can control the restart speed and restart number of the virtual network element, so that each virtual network element can quickly achieve connection with the backup local end device under the condition of being accurately scheduled, and realize the smooth restart of the virtual network element.

[0055] In an exemplary embodiment, Figure 2 As shown, a fault recovery method is provided, including the following steps 202 to 206. Among them:

[0056] Step 202: If the virtual network element in the network meets the failure condition, the actual restart number at the target time point is determined.

[0057] Among them, the corresponding restart number when the target time point is the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time. The initial time point may be the first moment when the virtual network elements in the network are restarted after the failure conditions are determined. The actual restart number at the target time point may be the number of virtual network elements that actually initiate the restart at the target time point. The failure condition may be a judgment condition for determining that a virtual network element in the network has failed, and its content may be that all virtual network elements hanging under the local device are disconnected, etc. The virtual network element may be a virtualized network element (NFV), which refers to a network device function implemented by cloud software, and is usually used in a cloud network.

[0058] Specifically, the network includes multiple local-end devices, each local-end device may have multiple virtual network elements hanging thereunder, and may also be configured with backup local-end devices corresponding to each local-end device. In this way, if it is detected that a local-end device fails, and each virtual network element under the local-end device is disconnected, it can be determined that the virtual network elements in the current network meet the failure conditions. Then the actual number of restarts at the initial time point can be determined, for example, the maximum restart rate of the virtual network elements corresponding to the network, the total number of virtual network elements that need to be restarted in the network, and the target completion time can be obtained. The target completion time may be the completion time required to restart the virtual network element, or it may also be the calculated completion time required to restart the virtual network element, and the target completion time is determined based at least on the maximum restart rate corresponding to the network and the total number of network elements that need to be restarted.

[0059] Step 204 : at the target time point, initiating the restart of the virtual network elements corresponding to the actual restart number at the target time point, and determining the restart success rate of the virtual network elements at the target time point.

[0060] Specifically, when the target time point is reached, the restart of the actual restart number of virtual network elements at the target time point can be initiated, and the restart success rate of the current virtual network elements can be calculated during the restart process. For example, when the initial time point is reached, the actual restart number of virtual network elements at the initial time point can be determined among the virtual network elements to be restarted, and a restart operation can be initiated for the actual restart number of virtual network elements at the initial time point. After determining to initiate a restart operation for the actual restart number of virtual network elements at the initial time point, the number of virtual network elements that have been successfully restarted is determined, and based on the number of virtual network elements that have been successfully restarted and the actual restart number at the initial time point, the restart success rate of the virtual network elements at the initial time point is calculated.

[0061] Step 206, based on the restart success rate at the target time point and the preset number adjustment strategy, determine the actual restart number of the next target time point of the target time point, and based on the actual restart number of the next target time point, re-execute the step of initiating the restart of the virtual network element corresponding to the restart number of the target time point at the target time point, and determine the restart success rate of the virtual network element at the target time point until it is determined that the virtual network element does not meet the fault condition.

[0062] The preset number adjustment strategy may be a virtual network element grouping strategy, or a number adjustment strategy in which a theoretical restart number is adjusted to obtain an actual restart number, and the like.

[0063] Specifically, for each target time point, after determining the restart success rate of the target time point, the actual restart number corresponding to the next target time point of the target time point can be calculated based on the restart success rate of the target time point and the preset number adjustment strategy. And when it is determined that the virtual network elements corresponding to the target time point have all been restarted, the actual restart number of the next target time point determined is used as the new target time point to execute the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point and determining the restart success rate of the virtual network elements at the target time point until it is determined that the virtual network elements do not meet the fault conditions. The failure conditions may be that all virtual network elements in the current network are reconnected to the backup local end device, or the current network fault is restored, and all virtual network elements are connected to the original local end device, or it may also be that all current virtual network elements have been successfully restarted and a communication connection with the local end device has been suggested, etc.

[0064] In one example, when it is determined that the virtual network elements in the network meet the fault conditions, the actual number of restarts when the target time point is the initial time point can be determined based on the maximum restart rate corresponding to the network, the total number of network elements that need to be restarted, and the target completion time. At the initial time point, the restart of the actual number of virtual network elements corresponding to the initial time point is initiated, and it is determined whether all the current virtual network elements have initiated a restart. If all have initiated a restart, the number of successful restarts of the virtual network elements is obtained, and the restart success rate corresponding to the initial time point is calculated based on the number of successful restarts of the virtual network elements.

[0065] If the restart success rate is less than or equal to the preset restart success rate threshold, the virtual network elements with the actual restart number corresponding to the initial time point can be re-initiated to restart, and the restart success rate corresponding to the updated initial time point can be obtained. If the restart success rate corresponding to the updated initial time point is greater than the preset restart success rate threshold, the actual restart number of the next target time point of the initial time point can be obtained based on the actual restart number of the initial time point and the preset number adjustment strategy. The next target time point is used as the new target time point, and the steps of determining the actual restart number of the next target time point of the target time point based on the restart success rate of the target time point and the preset number adjustment strategy are executed until all virtual network elements in the network are restarted.

[0066] At the target time point, initiate the restart of the actual number of virtual network elements (group B) corresponding to the target time point, and determine whether all virtual network elements in group B have initiated a restart. If all have initiated a restart, obtain the number of successful restarts of the virtual network elements, and calculate the restart success rate corresponding to the target time point based on the number of successful restarts of the virtual network elements.

[0067] If the restart success rate is less than or equal to the preset restart success rate threshold, the virtual network elements with the actual restart number corresponding to the target time point in group B can be re-initiated to restart, and the restart success rate corresponding to the updated target time point can be obtained. If the restart success rate corresponding to the updated target time point is greater than the preset restart success rate threshold, the actual restart number of the next target time point of the target time point can be obtained based on the actual restart number of the target time point and the preset number adjustment strategy. The next target time point is used as the new target time point, and the steps of determining the actual restart number of the next target time point of the target time point based on the restart success rate of the target time point and the preset number adjustment strategy are executed until all virtual network elements in the network are restarted.

[0068] In the above fault recovery method, the restart storm of virtual network elements after the local end equipment in the network fails can be avoided, and each virtual network element can smoothly re-initiate the network connection during fault recovery to avoid the user's online rate fluctuation. The backup device in the network can quickly process the restarted virtual network element to achieve rapid recovery from the fault. The number of restarts during the restart process of the virtual gateway is controlled by a preset number adjustment strategy to achieve efficient network reconstruction process. It supports multiple number adjustment strategies and can more effectively adapt to the actual application scenarios of various networks.

[0069] In one embodiment, the target time point is the initial time point, and the specific processing process of the step "if the virtual network element in the network meets the failure condition, determining the actual restart number at the target time point" may include:

[0070] When each virtual network element in the network is disconnected from the network and it is determined that the fault condition is met, the theoretical restart number at the initial time point is determined, and the theoretical restart number at the initial time point is used as the actual restart number at the initial time point.

[0071] The fault condition may be that all virtual network elements in the network are disconnected from the central office equipment in the network.

[0072] Specifically, when it is determined that all virtual network elements in the network are disconnected from the local end devices in the network, it can be determined that the fault conditions are currently met. In this way, the theoretical restart number corresponding to the initial time point can be calculated, and the theoretical restart number at the initial time point can be determined as the actual restart number at the initial time point.

[0073] Optionally, the specific process of calculating the theoretical restart number at the initial time point may be: processing the initial time point and the target completion time through a preset trigonometric function to obtain a first adjustment parameter, and based on the total number of network elements to be restarted and the target completion time, obtaining a second adjustment parameter, and determining the sum of the first adjustment parameter and the second adjustment parameter as the theoretical restart number corresponding to the initial time point.

[0074] Specifically, a trigonometric function calculation is performed on the initial time point and the target completion time based on a preset trigonometric function, and the obtained trigonometric function value is determined as the first adjustment parameter. And the quotient between the total number of network elements to be restarted and the target completion time is calculated, and the quotient is determined as the second adjustment parameter. In this way, the sum of the first adjustment parameter and the second adjustment parameter can be calculated, and the sum can be determined as the theoretical restart number corresponding to the initial time point.

[0075] In one example, based on the target completion time T and the first target value, the quotient between the target completion time T and the first target value is calculated, and the sum between the quotient and the initial time point t is calculated. The sum is processed by a trigonometric function based on a preset trigonometric function to obtain a trigonometric function value. Optionally, the preset trigonometric function may be tan -1 (), the first target value can be 2.

[0076] In this embodiment, the restart of the virtual network element in the faulty network can be initiated in time through the fault condition, thereby improving the flexibility of the virtual network element control and ensuring the stability of the user online rate and the stability of the network communication.

[0077] In an exemplary embodiment, Figure 3 As shown, the fault recovery method also includes:

[0078] Step 302: Calculate the initial completion time based on the maximum restart rate corresponding to the network and the total number of network elements that need to be restarted.

[0079] Specifically, the constraint condition of the maximum restart rate of the network for the virtual network element and the total number of virtual network elements to be restarted in the current network are obtained, and the initial completion time is calculated. The maximum restart rate corresponding to the network can be the maximum peak rate of the network pre-configured or determined based on the actual situation of the network. The corresponding total number of network elements to be restarted can be the total number of virtual network elements disconnected from the network in the current network. Optionally, the quotient of the total number of network elements to be restarted and the maximum restart rate corresponding to the network can be calculated, and the quotient can be determined as the initial completion time.

[0080] Step 304, obtaining the target completion time based on the initial completion time and the preset buffer time.

[0081] The preset buffer time may be a pre-configured buffer delay, and the specific value of the preset buffer time may be 1s, 2s, etc. The present disclosure does not specifically limit the specific value of the preset buffer time. The preset buffer time is a value greater than 0.

[0082] Specifically, the sum of the initial completion time and the preset buffer time is calculated, and the sum is determined to be the target completion time.

[0083] Step 306, the target time point and the target completion time are processed by a preset trigonometric function to obtain a first adjustment parameter, and a second adjustment parameter is obtained based on the total number of network elements to be restarted and the target completion time, and the sum of the first adjustment parameter and the second adjustment parameter is determined as the theoretical restart number corresponding to the target time point.

[0084] Specifically, a trigonometric function calculation is performed on the target time point and the target completion time based on a preset trigonometric function, and the obtained trigonometric function value is determined as the first adjustment parameter. And the quotient between the total number of network elements to be restarted and the target completion time is calculated, and the quotient is determined as the second adjustment parameter. In this way, the sum of the first adjustment parameter and the second adjustment parameter can be calculated, and the sum can be determined as the theoretical restart number corresponding to the target time point.

[0085] In one example, based on the target completion time T and the first target value, the quotient between the target completion time T and the first target value is calculated, and the sum between the quotient and the target time point t is calculated. The sum is processed by a trigonometric function based on a preset trigonometric function to obtain a trigonometric function value. Optionally, the preset trigonometric function may be tan -1 (), the first target value can be 2, and the theoretical restart number V corresponding to the target time point can be calculated by the following formula:

[0086]

[0087] Where S is the total number of network elements that need to be restarted.

[0088] In this embodiment, the target completion time that meets network requirements is determined by a preset buffer time, and is processed by a preset trigonometric function to ensure that the theoretical restart numbers corresponding to each target time point calculated are controllable, thereby avoiding restart storms of virtual network elements and further improving the stability of the network during fault recovery.

[0089] In one embodiment, Figure 4 As shown, the specific processing of the step of "determining the actual restart number at the next target time point of the target time point based on the restart success rate at the target time point and the preset number adjustment strategy" may include:

[0090] Step 402 : Calculate initial adjustment parameters based on a preset number adjustment strategy and a failure rate corresponding to a restart success rate at a target time point.

[0091] The preset number adjustment strategy may be an adjustment parameter algorithm / adjustment factor algorithm.

[0092] Specifically, for each target time point, the restart success rate corresponding to the target time point can be obtained, and the failure rate corresponding to the target time point can be obtained by the difference between the second target value and the restart success rate. Optionally, the second target value can be 1.

[0093] In this way, the failure rate is processed by the preset adjustment parameter algorithm to obtain an output result, and the output result is determined as the initial adjustment parameter. For example, the failure rate P at the target time point can be input into the preset adjustment parameter algorithm k() function to obtain the output result k(P) of the adjustment parameter algorithm, and the output result is determined as the initial adjustment parameter. Optionally, the preset adjustment parameter algorithm can be a k() function, and the present disclosure does not limit the specific type of the preset adjustment parameter algorithm. The k() function can be a linear function or a nonlinear function.

[0094] Step 404, based on the initial adjustment parameter, the relationship between the failure rate at the target time point and the preset failure rate threshold, determine the target adjustment parameter, and adjust the theoretical restart number corresponding to the next target time point of the target time point based on the target adjustment parameter to obtain the actual restart number at the next target time point.

[0095] The preset failure rate threshold may be determined based on actual application scenarios, may be pre-configured, or may be determined based on the performance of the network where the current failure occurs, for example, 5%.

[0096] Specifically, by comparing the target time point with the preset failure rate threshold, a comparison result is obtained, and the target adjustment parameter can be obtained by calculation based on the comparison result, the first target value, and the initial adjustment parameter. In this way, the theoretical restart number at the next target time point can be calculated first by the method described in the above embodiment, and the theoretical restart number at the next target time point can be adjusted based on the target adjustment parameter to obtain the actual restart number at the next target time point. For example, the product value between the target adjustment parameter and the theoretical restart number at the next target time point can be calculated, and the calculated product value is determined as the actual restart number corresponding to the next target time point.

[0097] In this embodiment, the preset number adjustment strategy can effectively control the number of virtual network elements online at different time points, ensuring that the number of virtual network elements restarted at each time point is controllable, and the networking reconstruction process is also controllable, thereby achieving efficient restart of virtual network elements.

[0098] In an exemplary embodiment, the specific implementation process of the step of “determining the target adjustment parameter based on the relationship between the initial adjustment parameter, the failure rate at the target time point, and the preset failure rate threshold” may include:

[0099] If the failure rate at the target time point is greater than or equal to the preset failure rate threshold, the difference between the target value and the initial adjustment parameter is determined as the target adjustment parameter.

[0100] If the failure rate at the target time point is less than a preset failure rate threshold, the sum of the target value and the initial adjustment parameter is determined as the target adjustment parameter.

[0101] Specifically, the target adjustment parameter can be obtained by comparing the failure rate P at the target time point with the preset failure rate threshold p. For example, if the failure rate at the target time point is greater than or equal to the preset failure rate threshold, the difference between the target value and the initial adjustment parameter k(P) can be calculated, and the difference is determined to be the target adjustment parameter. If the failure rate at the target time point is less than the preset failure rate threshold, the sum of the initial adjustment parameter and the target value can be calculated, and the sum is determined to be the target adjustment parameter.

[0102] In an example, the actual restart number v corresponding to the next target time point may be determined by the following formula:

[0103]

[0104] The target value may be 1, and V may be the theoretical restart number at the next target time point.

[0105] In this embodiment, the preset number adjustment strategy can effectively control the number of virtual network elements online at different time points, ensuring that the number of virtual network elements restarted at each time point is controllable, and the networking reconstruction process is also controllable, thereby achieving efficient restart of virtual network elements.

[0106] In an exemplary embodiment, the specific processing of the step of "determining the actual restart number at the next target time point of the target time point based on the restart success rate at the target time point and the preset number adjustment strategy" includes:

[0107] Based on the failure rate corresponding to the restart success rate at the target time point, in the preset number adjustment strategy, the restart number matching the failure rate is queried, and the restart number matching the failure rate is determined as the actual restart number at the next time point of the target time point.

[0108] Among them, the preset number adjustment strategy can be a group matching strategy, and the virtual network elements to be restarted in the corresponding network can be divided into virtual network element groups containing different numbers of virtual network elements. The preset number adjustment strategy can include the restart numbers corresponding to different restart failure rates, that is, it includes the corresponding relationship between the restart failure rate and the restart number.

[0109] Specifically, for each target time point, the restart success rate corresponding to the target time point can be obtained, and the failure rate corresponding to the target time point can be obtained by the difference between the second target value and the restart success rate, and optionally, the second target value can be 1. In the multiple corresponding relationships included in the preset number adjustment strategy, the restart number matching the failure rate is queried, and the restart number is determined as the actual restart number at the next time point of the current target time point.

[0110] In this embodiment, the preset number adjustment strategy can effectively control the number of virtual network elements online at different time points, ensuring that the number of virtual network elements restarted at each time point is controllable, and the networking reconstruction process is also controllable, thereby achieving efficient restart of virtual network elements.

[0111] In the following, in conjunction with a specific embodiment, a detailed description of the specific implementation process of the above fault recovery method may include:

[0112] The metropolitan area network may include multiple physical devices and multiple local devices, for example, physical device 1, physical device 2, and physical device 3. Each physical device may be connected to local device 1. When local device 1 fails, the physical device under local device 1 will be disconnected. In traditional technology, all physical devices initiate restart or re-establish connection after discovering that they are disconnected. Local device 2 may be the backup of local device 1. Due to a large number of sudden connection requests from devices, local device 2 cannot process them in time, and the reconnection of the physical device will time out. Since there is no coordination mechanism between physical devices, the time backoff algorithm will cause the user's online rate to fluctuate, and the average rate will be lower than the device performance limit, and it is also easy to cause the failure of the local backup device.

[0113] The fault recovery method provided in this embodiment is a method applied to the above-mentioned scenario, for example, it can be a scenario where a large number of virtual network element devices restart and establish external connections during fault recovery, realizing the scheduling of restart of virtualized network elements after faults, avoiding the secondary fault problem caused by virtual network element restart storm, and making the network more stable during fault recovery. Figure 5 As shown, it can be a schematic diagram of a fault of a virtual network element in the network:

[0114] The metropolitan area network includes a server cluster and multiple local-end devices. The server cluster may include virtual network element 1, virtual network element 2, and virtual network element 3. The multiple local-end devices may include local-end device 1 and local-end device 2. When local-end device 1 fails, it is necessary to restart virtual network element 1, virtual network element 2, and virtual network element 3 and initiate a connection with local-end device 2.

[0115] In one example, if the local device 1 fails, virtual network elements 1, 2, and 3 will be disconnected. Under the unified control of the cluster, a small number of virtual network elements will try to redial, and most virtual network elements will remain silent. After a small number of virtual network elements dial successfully, the cluster will add more virtual network elements to initiate a restart and link establishment. Figure 6 As shown, the online rate of the virtual network element (the number of online users per second) will soon reach the online rate limit of the central office device (the online rate limit of the central office device), and can be stabilized at the highest online rate. The backup central office device 2 can quickly process the restarted virtual network element to achieve rapid recovery from the fault. At the same time, the number of online users is controllable, no shock will occur, and the backup device is not prone to new faults.

[0116] In one example, based on the target completion time T and the first target value, the quotient between the target completion time T and the first target value is calculated, and the sum between the quotient and the target time point t is calculated. The sum is processed by a trigonometric function based on a preset trigonometric function to obtain a trigonometric function value. Optionally, the preset trigonometric function may be tan -1 (), the first target value can be 2, and the theoretical restart number V corresponding to the target time point can be calculated by the following formula:

[0117]

[0118] Where S is the total number of network elements that need to be restarted, and the relationship between each target time point and the theoretical restart number (theoretical calculated value) corresponding to each target time point can be as follows: Figure 7 As shown, U represents the maximum restart peak rate that the network can withstand.

[0119] In an example, the actual restart number v corresponding to the next target time point may be determined by the following formula:

[0120]

[0121] The target value may be 1, and V may be the theoretical restart number at the next target time point. The relationship between each target time point and the actual restart number (actual value) corresponding to each target time point may be as follows: Figure 8 shown.

[0122] In one example, if Fig. 9 As shown, the preset number adjustment strategy can be a group matching strategy, and the virtual network elements to be restarted in the corresponding network can be divided into virtual network element groups including different numbers of virtual network elements. The preset number adjustment strategy can include restart numbers corresponding to different restart failure rates, that is, it includes the corresponding relationship between the restart failure rate and the restart number. Each group can be group A, group B, group C...

[0123] For example, the number of virtual network elements included in group A may be 3, the number of virtual network elements included in group B may be 9, and the number of virtual network elements included in group C may be N. The server cluster fault recovery control plane may control the restart rate based on the recovery policy control, restart the virtual network elements of the corresponding group, obtain the restart result feedback, and reuse the feedback result for the recovery policy control.

[0124] like Fig.10 As shown, it may be a specific execution process of the fault recovery method in an embodiment:

[0125] The network fails and the cluster control finds that almost all virtualized network elements are disconnected.

[0126] Initiate restart of group A according to the strategy. Group A usually has a small number of members.

[0127] Determine whether the group dialing is completed, that is, determine whether the restart of group A is fully initiated. Initiating dialing may be restarting the virtual network element including dialing, sending a network connection request, sending a message, etc. If not completed, return to re-determine whether the dialing is completed.

[0128] If completed, it is determined whether the group dialing success rate is greater than the threshold, that is, whether the current restart success rate is greater than or equal to the preset success rate threshold. If it is less than the preset success rate threshold, it returns to re-execute the step of initiating the restart of group A according to the strategy.

[0129] If it is greater than or equal to, then determine whether all redials are completed, that is, determine whether all current virtual network elements to be restarted have restored the connection with the central office device. If not, increase the number of restarts in the next cycle according to the strategy, for example, you can use group B or C to dial, and return to re-execute the step of determining whether the dialing is completed. If all current virtual network elements to be restarted have restored the connection with the central office device, the fault is recovered.

[0130] The fault recovery method in this embodiment can realize the re-online of the virtual network element device, avoiding the secondary fault recovery failure caused by the link storm during the sudden restart. It can avoid network shock when a large number of users dial up suddenly, and can also adjust the strategy through the preset number to control the reconstruction process, and can realize an efficient reconstruction mechanism through the strategy. Optionally, it also supports the configuration of different strategy selections and parameters, which can more effectively adapt to different network states and expand applicable application scenarios.

[0131] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time point, but can be executed at different time points, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0132] Based on the same inventive concept, the embodiment of the present application also provides a fault recovery device for implementing the fault recovery method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more fault recovery device embodiments provided below can refer to the limitations on the fault recovery method above, and will not be repeated here.

[0133] In an exemplary embodiment, Fig.11 As shown, a fault recovery device 1100 is provided, comprising:

[0134] The first determination module 1102 is used to determine the actual restart number at the target time point if the virtual network elements in the network meet the fault conditions. The corresponding restart number when the target time point is the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements that need to be restarted, and the target completion time.

[0135] The initiating module 1104 is used to initiate the restart of the virtual network elements corresponding to the actual restart number at the target time point at the target time point, and determine the restart success rate of the virtual network elements at the target time point.

[0136] The second determination module 1106 is used to determine the actual restart number of the next target time point of the target time point based on the restart success rate of the target time point and the preset number adjustment strategy, and re-execute the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point, and determining the restart success rate of the virtual network elements at the target time point based on the actual restart number of the next target time point, until it is determined that the virtual network elements do not meet the fault conditions.

[0137] In one embodiment, the target time point is an initial time point, and the first determining module is specifically configured to:

[0138] When it is determined that each virtual network element in the network is disconnected from the network and the fault condition is met, the theoretical restart number at the initial time point is determined, and the theoretical restart number at the initial time point is used as the actual restart number at the initial time point.

[0139] In one embodiment, the device further comprises:

[0140] The first calculation module is used to calculate the initial completion time based on the maximum restart rate corresponding to the network and the total number of network elements that need to be restarted.

[0141] The second calculation module is used to obtain the target completion time based on the initial completion time and the preset buffer time.

[0142] The third calculation module is used to process the target time point and the target completion time through a preset trigonometric function to obtain a first adjustment parameter, and to obtain a second adjustment parameter based on the total number of network elements that need to be restarted and the target completion time, and to determine the sum of the first adjustment parameter and the second adjustment parameter as the theoretical restart number corresponding to the target time point.

[0143] In one embodiment, the second determining module is specifically configured to:

[0144] Based on a preset number adjustment strategy and a failure rate corresponding to the restart success rate at the target time point, an initial adjustment parameter is calculated.

[0145] Based on the initial adjustment parameter, the relationship between the failure rate at the target time point and a preset failure rate threshold, the target adjustment parameter is determined, and based on the target adjustment parameter, the theoretical restart number corresponding to the next target time point of the target time point is adjusted to obtain the actual restart number of the next target time point.

[0146] In one embodiment, the second determining module is specifically configured to:

[0147] If the failure rate at the target time point is greater than or equal to a preset failure rate threshold, the difference between the target value and the initial adjustment parameter is determined as the target adjustment parameter.

[0148] If the failure rate at the target time point is less than a preset failure rate threshold, the sum of the target value and the initial adjustment parameter is determined as the target adjustment parameter.

[0149] In one embodiment, the second determining module is specifically configured to:

[0150] Based on the failure rate corresponding to the restart success rate at the target time point, in the preset number adjustment strategy, the restart number matching the failure rate is queried, and the restart number matching the failure rate is determined to be the actual restart number at the next time point after the target time point.

[0151] Each module in the above fault recovery device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0152] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Fig.12 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data of virtual network elements. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a fault recovery method is implemented.

[0153] Those skilled in the art will understand that Fig.12 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0154] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps described in the above embodiment when executing the computer program.

[0155] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps described in the above embodiment are implemented.

[0156] In one embodiment, a computer program product is provided, including a computer program, which implements the steps described in the above embodiment when executed by a processor.

[0157] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0158] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0159] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0160] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A fault recovery method, characterized in that: The method comprises: If the virtual network elements in the network meet the fault condition, determining the actual restart number at the target time point, where the restart number corresponding to the target time point being the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time; At the target time point, initiating a restart of the virtual network elements corresponding to the actual restart number at the target time point, and determining a restart success rate of the virtual network elements at the target time point; Based on the restart success rate of the target time point and the preset number adjustment strategy, the actual restart number of the next target time point of the target time point is determined, and based on the actual restart number of the next target time point, the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point and determining the restart success rate of the virtual network elements at the target time point are re-executed until it is determined that the virtual network element does not meet the fault condition.

2. The method according to claim 1, characterized in that The target time point is an initial time point, and if the virtual network element in the network meets the failure condition, determining the actual restart number at the target time point includes: When it is determined that each virtual network element in the network is disconnected from the network and the fault condition is met, the theoretical restart number at the initial time point is determined, and the theoretical restart number at the initial time point is used as the actual restart number at the initial time point.

3. The method according to claim 1, characterized in that The method further comprises: Calculate the initial completion time based on the maximum restart rate corresponding to the network and the total number of network elements that need to be restarted; Based on the initial completion time and the preset buffer time, a target completion time is obtained; The target time point and the target completion time are processed by a preset trigonometric function to obtain a first adjustment parameter, and a second adjustment parameter is obtained based on the total number of network elements that need to be restarted and the target completion time. The sum of the first adjustment parameter and the second adjustment parameter is determined as the theoretical restart number corresponding to the target time point.

4. The method according to claim 2, characterized in that: The determining the actual restart number at the next target time point of the target time point based on the restart success rate at the target time point and a preset number adjustment strategy includes: Calculating initial adjustment parameters based on a preset number adjustment strategy and a failure rate corresponding to a restart success rate at the target time point; Based on the initial adjustment parameter, the relationship between the failure rate at the target time point and a preset failure rate threshold, the target adjustment parameter is determined, and based on the target adjustment parameter, the theoretical restart number corresponding to the next target time point of the target time point is adjusted to obtain the actual restart number of the next target time point.

5. The method according to claim 4, characterized in that The determining the target adjustment parameter based on the relationship between the initial adjustment parameter, the failure rate at the target time point and a preset failure rate threshold comprises: If the failure rate at the target time point is greater than or equal to a preset failure rate threshold, the difference between the target value and the initial adjustment parameter is determined as the target adjustment parameter; or, If the failure rate at the target time point is less than a preset failure rate threshold, the sum of the target value and the initial adjustment parameter is determined as the target adjustment parameter.

6. The method according to claim 1, characterized in that The determining the actual restart number at the next target time point of the target time point based on the restart success rate at the target time point and a preset number adjustment strategy includes: Based on the failure rate corresponding to the restart success rate at the target time point, in the preset number adjustment strategy, the restart number matching the failure rate is queried, and the restart number matching the failure rate is determined to be the actual restart number at the next time point after the target time point.

7. A fault recovery device, characterized in that: The device comprises: A first determination module is used to determine the actual restart number at a target time point if the virtual network element in the network meets the fault condition, wherein the restart number corresponding to the target time point being the initial time point is determined based on the maximum restart rate corresponding to the network, the total number of network elements to be restarted, and the target completion time; An initiating module, configured to initiate, at the target time point, a restart of the virtual network elements corresponding to the actual restart number at the target time point, and determine a restart success rate of the virtual network elements at the target time point; The second determination module is used to determine the actual restart number of the next target time point of the target time point based on the restart success rate of the target time point and a preset number adjustment strategy, and based on the actual restart number of the next target time point, re-execute the steps of initiating the restart of the virtual network elements corresponding to the restart number of the target time point at the target time point, and determining the restart success rate of the virtual network elements at the target time point until it is determined that the virtual network element does not meet the fault condition.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images