Distributed load balancing system data processing method and apparatus

By transforming deep health checks into an asynchronous processing mode in the distributed load balancing system, and using a specific algorithm to dynamically adjust the sending rate and interval of health check requests, combined with a circuit breaker degradation mechanism, the performance loss of deep health checks on backend servers is solved, thereby improving the stability and processing capacity of the system.

CN116185755BActive Publication Date: 2025-11-25INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211563498.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-12-07
Publication Date
2025-11-25
Estimated Expiration
2042-12-07

AI Technical Summary

Technical Problem

In existing distributed load balancing systems, deep health checks cause excessive performance overhead to backend servers, limit the expansion of the load balancer cluster, and result in excessive pressure from health check requests.

Method used

The deep health check was transformed into an asynchronous processing mode. The sending rate and interval of health check requests were dynamically adjusted through a specific algorithm. Combined with the circuit breaker degradation mechanism, the pressure on the backend business system was reduced.

Benefits of technology

Without affecting the isolation effect and efficiency of load balancing health checks, the pressure of health checks on backend business systems is reduced, thereby improving the overall operational stability and business processing capabilities of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116185755B_ABST
    Figure CN116185755B_ABST
Patent Text Reader

Abstract

The embodiment of the application provides a kind of distributed load balancing system data processing method and device, it is related to distributed field, method includes: according to load balancing server information and the background server information to be carried out health check, determine health check sending rate;According to the health check sending rate, health check signal is sent to corresponding background server, to make the background server according to the health check signal executes health check and returns the result of the health check;The application can reduce the health check pressure of distributed load balancing system health check to back-end business system, and provide health check automatic fuse degradation mode, improve the overall operation stability and business processing capacity of system.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the field of distributed systems, and in particular to a distributed load balancing system data processing method and device. BACKGROUND

[0002] Health checks are divided into deep health checks and non-deep health checks. The non-deep health check only verifies the connectivity of the backend server, and the performance consumption is small, but the normal connectivity of the backend server cannot guarantee that the server can normally provide services. The deep health check can guarantee that the backend server with a normal monitoring state can normally provide services, and therefore the deep health check is more and more widely used.

[0003] The current processing method of the deep health check of the distributed load balancing is as follows: each load balancer under a load balancing cluster periodically performs health checks on the backend server cluster through a fixed interval time, and the health check generally adopts the mode of simulating user requests to confirm whether the backend server can normally respond to user requests, and the time interval of each health check is in seconds. Since the health check strategy configuration of all load balancing nodes under a cluster is static and consistent, all load balancing nodes will initiate health checks at the same time point. If there are n load balancing nodes simultaneously initiating health checks, each server in the backend will receive nQPS request pressure, thereby causing a large number of health check requests to cause considerable performance consumption to the backend server, and also limiting the expansion of the load balancer cluster. SUMMARY

[0004] In view of the problems in the prior art, the present application provides a distributed load balancing system data processing method and device, which can transform the deep health check into an asynchronous processing mode without affecting the isolation effect and efficiency of the load balancing health check, and dynamically adjust the health check request of the load balancing node according to the number of load balancing servers, the number of backend servers, the health check request response time and other parameters through a specific algorithm, thereby reducing the health check pressure of the distributed load balancing system on the backend business system, providing a health check automatic fuse degradation mode, and improving the overall operation stability and business processing capacity of the system.

[0005] In order to solve at least one of the above problems, the present application provides the following technical solutions:

[0006] In a first aspect, the present application provides a distributed load balancing system data processing method, comprising:

[0007] determining a health check sending rate according to load balancing server information and background server information to be health checked;

[0008] According to the health check sending rate, a health check signal is sent to a corresponding background server, so that the background server performs a health check according to the health check signal and returns a result of the health check.

[0009] Further, the health check sending rate is determined according to the load balancing server information and the background server information to be health checked, and includes:

[0010] According to the number of background servers to be health checked, a preset health check period, and a health check average response time determined by historical data, the health check sending rate is determined.

[0011] According to the health check sending rate and the number of load balancing servers, a health check sending interval period of each load balancing server is determined.

[0012] Further, the health check signal is sent to the corresponding background server according to the health check sending rate, and includes:

[0013] If the health check average response time does not exceed the health check sending interval period, a deep health check signal is sent to all corresponding background servers according to the health check sending rate.

[0014] If the health check average response time exceeds the health check sending interval period, it is determined that a fuse degradation mechanism is triggered, and a normal health check signal is sent to all corresponding background servers according to the health check sending rate.

[0015] Further, the health check signal is sent to the corresponding background server according to the health check sending rate, and includes:

[0016] The health check signal is asynchronously cached, and corresponding health check operations are sequentially performed according to the corresponding check types of the health check signal.

[0017] The results of the health check operations are asynchronously cached and sequentially fed back to the load balancing server.

[0018] Further, the health check sending rate is determined according to the number of background servers to be health checked, a preset health check period, and a health check average response time determined by historical data, and includes:

[0019] According to a ratio of twice the number of background servers to be health checked to a total time of a preset health check period and a health check average response time determined by historical data, the health check sending rate is determined.

[0020] Further, the interval determination unit is configured to determine the health check sending interval period of each load balancing server according to the health check sending rate and the number of load balancing servers.

[0021] The load balancing servers are equally divided according to the set number interval, and the health check sending interval period of each load balancing server after the division is determined according to the health check sending rate.

[0022] In a second aspect, the application provides a data processing device of a distributed load balancing system, comprising:

[0023] The check rate determination module is configured to determine the health check sending rate according to the load balancing server information and the background server information to be health checked.

[0024] The server check module is configured to send a health check signal to the corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns the result of the health check.

[0025] Further, the check rate determination module comprises:

[0026] The rate determination unit is configured to determine the health check sending rate according to the number of background servers to be health checked, the preset health check period, and the health check average response time determined by the historical data.

[0027] The interval determination unit is configured to determine the health check sending interval period of each load balancing server according to the health check sending rate and the number of load balancing servers.

[0028] Further, the server check module comprises:

[0029] The deep check unit is configured to control each load balancing server to send a deep health check signal to all corresponding background servers according to the health check sending rate if the health check average response time does not exceed the health check sending interval period.

[0030] The normal check unit is configured to determine to trigger a fuse degradation mechanism and control each load balancing server to send a normal health check signal to all corresponding background servers according to the health check sending rate if the health check average response time exceeds the health check sending interval period.

[0031] Further, the server check module further comprises:

[0032] The request asynchronous caching unit is configured to asynchronously cache the health check signal and sequentially perform corresponding health check operations according to the check type corresponding to the health check signal.

[0033] The result asynchronous caching unit is configured to asynchronously cache the result of the health check operation and sequentially feed back the result to the load balancing server.

[0034] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the distributed load balancing system data processing method when executing the program.

[0035] In a fourth aspect, the present application provides a computer readable storage medium, which stores a computer program, wherein the computer program is executable on a processor to implement the steps of the distributed load balancing system data processing method.

[0036] In a fifth aspect, the present application provides a computer program product, comprising computer programs / instructions, wherein the computer programs / instructions are executable on a processor to implement the steps of the distributed load balancing system data processing method.

[0037] According to the above technical solution, the present application provides a distributed load balancing system data processing method and device, which determines a health check sending rate according to load balancing server information and information of a background server to be subjected to health check, sends a health check signal to a corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns a result of the health check, thereby being capable of transforming a deep health check into an asynchronous processing mode without affecting the health check isolation effect and efficiency of load balancing, dynamically adjusting health check requests of load balancing nodes according to the number of load balancing servers, the number of backend servers, health check request response time and other parameters through a specific algorithm, reducing the health check pressure of a distributed load balancing system health check on a backend business system, and providing a health check automatic fuse degradation mode to improve the overall operation stability and business processing capacity of the system. BRIEF DESCRIPTION OF DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0039] Figure 1 It is one of the flowcharts of the distributed load balancing system data processing method in the embodiments of the present application;

[0040] Figure 2Figure 2 is a flowchart of a data processing method of a distributed load balancing system according to an embodiment of the present application;

[0041] Figure 3 Figure 3 is a flowchart of a data processing method of a distributed load balancing system according to an embodiment of the present application;

[0042] Figure 4 Figure 4 is a flowchart of a data processing method of a distributed load balancing system according to an embodiment of the present application;

[0043] Figure 5 Figure 5 is a structural diagram of a data processing device of a distributed load balancing system according to an embodiment of the present application;

[0044] Figure 6 Figure 6 is a structural diagram of a data processing device of a distributed load balancing system according to an embodiment of the present application;

[0045] Figure 7 Figure 7 is a structural diagram of a data processing device of a distributed load balancing system according to an embodiment of the present application;

[0046] Figure 8 Figure 8 is a structural diagram of a data processing device of a distributed load balancing system according to an embodiment of the present application;

[0047] Figure 9 Figure 9 is a structural diagram of a data processing system of a distributed load balancing system according to an embodiment of the present application;

[0048] Figure 10 Figure 10 is a structural diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0049] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be described below in detail with reference to the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0050] The acquisition, storage, use, processing and the like of data in the technical solutions of the present application comply with relevant provisions of national laws and regulations.

[0051] In view of the problems in the prior art, the application provides a distributed load balancing system data processing method and device. The health check sending rate is determined according to the load balancing server information and the background server information to be health checked. The health check signal is sent to the corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns the result of the health check. Thus, the deep health check can be transformed into an asynchronous processing mode without affecting the isolation effect and efficiency of load balancing health check. The health check request of the load balancing node is dynamically adjusted according to the number of load balancing servers, the number of backend servers, the health check request response time and other parameters through a specific algorithm, the health check pressure of the distributed load balancing system health check on the backend business system is reduced, and the health check automatic fuse is provided.

[0052] In order to be able to transform the deep health check into an asynchronous processing mode without affecting the isolation effect and efficiency of load balancing health check, and dynamically adjust the health check request of the load balancing node according to the number of load balancing servers, the number of backend servers, the health check request response time and other parameters through a specific algorithm, reduce the health check pressure of the distributed load balancing system health check on the backend business system, and provide a way of health check automatic fuse degradation, improve the overall operation stability and business processing capacity of the system, the application provides an embodiment of a distributed load balancing system data processing method, as shown in Figure 1 , the distributed load balancing system data processing method specifically includes the following contents:

[0053] Step S101: determining a health check sending rate according to load balancing server information and background server information to be health checked.

[0054] Optionally, in the application, the health check sending frequency control module of the load balancing server dynamically calculates and controls the health check sending rate by configuring the health check period T and the number of load balancing cluster servers N in the configuration module, and dynamically obtaining the number of background servers M and the average response time t in the response time processing module. The number of backend servers and the average response time determine: V=2M / (T+t). At the same time, the sending interval period Q=(T+t) / 2M is divided according to the number of load balancing servers N, each load balancing server is configured with a different integer number n(1<=n<=N), and the server initiates health check at the interval Q*(1-n / N) time.

[0055] In an embodiment of the application, when t In an embodiment of the application, when t

[0056] In an embodiment of the present application, when t >= T, the deep health check cannot be guaranteed to be initiated to all backend servers within T period of time, and then a fuse degradation mechanism is triggered to automatically degrade the deep health check mode to a normal port-based health check mode.

[0057] Step S102: according to the health check sending rate, a health check signal is sent to the corresponding background server, so that the background server performs health check according to the health check signal and returns the result of the health check.

[0058] Optionally, in the present application, the health check processing module of the backend application server is optimized to an asynchronous processing mode, and the module initiates asynchronous health check without relying on the health request trigger of the upstream load balancing server, but initiates the check according to the health check mechanism configured by the SV configuration module (for details, refer to the mechanism in the optimization of the load balancing server). At the same time, a new health check and cache module is added to save the health check result, and the health check result of the upstream load balancer is directly obtained from the cache and returned. Through the hierarchical asynchronous decoupling health check model, the health check pressure of external dependent services is reduced as a whole. By analogy, the deep health check pressure problem of multi-layer architecture nested calls under the distributed system can be solved.

[0059] From the above description, it can be seen that the distributed load balancing system data processing method provided by the embodiments of the present application can determine the health check sending rate according to the load balancing server information and the background server information to be health checked, and send a health check signal to the corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns the result of the health check. Therefore, the deep health check can be transformed into an asynchronous processing mode without affecting the isolation effect and efficiency of load balancing health check, and the health check request of the load balancing node is dynamically adjusted according to the number of load balancing servers, the number of backend servers, the health check request response time and other parameters through a specific algorithm, thereby reducing the health check pressure of the distributed load balancing system on the health check of the backend business system, and providing health check automatic fuse.

[0060] In an embodiment of the distributed load balancing system data processing method of the present application, referring to Figure 2 It can also specifically include the following contents:

[0061] Step S201: according to the number of background servers to be health checked, the preset health check period and the health check average response time determined by historical data, the health check sending rate is determined.

[0062] Step S202: determining the health check sending interval period of each load balancing server according to the health check sending rate and the number of load balancing servers.

[0063] Optionally, in the present application, the health check sending frequency control module of the load balancing server dynamically calculates and controls the health check sending rate by configuring the health check period T and the number of load balancing cluster servers N in the configuration module, and dynamically obtaining the number of background servers M and the average response time t of the health check response time processing module, and the health check sending rate is determined by the number of background servers and the average response time: V=2M / (T+t), and the sending interval period Q=(T+t) / 2M is divided according to the number of load balancing servers N, each load balancing server is configured with a different integer number n (1<=n<=N), and the server initiates a health check at the interval Q*(1-n / N) time.

[0064] In an embodiment of the data processing method of the distributed load balancing system of the present application, referring to Figure 3 The method can further include the following contents:

[0065] Step S301: if the average response time of the health check does not exceed the health check sending interval period, controlling each load balancing server to send a deep health check signal to all corresponding background servers according to the health check sending rate.

[0066] Step S302: if the average response time of the health check exceeds the health check sending interval period, determining to trigger a fuse degradation mechanism and controlling each load balancing server to send a normal health check signal to all corresponding background servers according to the health check sending rate.

[0067] In an embodiment of the present application, when t

[0068] In an embodiment of the present application, when t>=T, it is impossible to guarantee that a deep health check is initiated to all background servers within the T period of time, so the fuse degradation mechanism is triggered to automatically degrade the deep health check mode to a normal port-based health check mode.

[0069] In an embodiment of the data processing method of the distributed load balancing system of the present application, referring to Figure 4 The method can further include the following contents:

[0070] Step S401: asynchronously caching the health check signal and sequentially performing corresponding health check operations according to the corresponding check types of the health check signal.

[0071] Step S402: Asynchronously cache the result of the health check operation and sequentially feed back the result to the load balancing server.

[0072] Optionally, in the present application, the backend application server optimizes the health check processing module to an asynchronous processing mode, which initiates asynchronous health check without relying on the health request trigger of the upstream load balancing server, but initiates the check according to the health check mechanism configured by the SV configuration module (for details, refer to the mechanism in the optimization of the load balancing server). At the same time, a new health check and cache module is added to save the health check result, and the health check result of the upstream load balancing server is directly obtained from the cache and returned. Through the hierarchical asynchronous decoupling health check model, the health check pressure of external dependent services is reduced as a whole. By analogy, the depth health check pressure problem of multi-layer architecture nested calls under the distributed system can be solved.

[0073] In order to be able to transform the depth health check into an asynchronous processing mode without affecting the isolation effect and efficiency of the load balancing health check, and through a specific algorithm, the health check request of the load balancing node is dynamically adjusted according to the number of load balancing servers, the number of backend servers, the health check request response time and other parameters, reduces the health check pressure of the distributed load balancing system health check on the backend business system, and provides a health check automatic fuse degradation mode, improves the overall operation stability and business processing capacity of the system, the present application provides an embodiment of a distributed load balancing system data processing device for realizing all or part of the contents of the distributed load balancing system data processing method, see Figure 5 , the distributed load balancing system data processing device specifically contains the following contents:

[0074] The check rate determination module 10 is configured to determine the health check sending rate according to the load balancing server information and the background server information to be health checked.

[0075] The server check module 20 is configured to send a health check signal to the corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns the result of the health check.

[0076] From the above description, the distributed load balancing system data processing device provided by the embodiment of the application can determine a health check sending rate according to load balancing server information and background server information to be health checked, send a health check signal to a corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns a result of the health check, thereby being capable of transforming a deep health check into an asynchronous processing mode without affecting a load balancing health check isolation effect and efficiency, dynamically adjusting health check requests of load balancing nodes according to a load balancing server quantity, a backend server quantity, a health check request response time and other parameters through a specific algorithm, reducing health check pressure of a distributed load balancing system health check on a backend business system, and providing health check automatic fusing.

[0077] In an embodiment of the distributed load balancing system data processing device of the application, referring to Figure 6 , the check rate determining module 10 comprises:

[0078] The rate determining unit 11 is configured to determine a health check sending rate according to a background server quantity to be health checked, a preset health check period and a health check average response time determined by historical data.

[0079] The interval determining unit 12 is configured to determine a health check sending interval period of each load balancing server according to the health check sending rate and a load balancing server quantity.

[0080] In an embodiment of the distributed load balancing system data processing device of the application, referring to Figure 7 , the server checking module 20 comprises:

[0081] The deep checking unit 21 is configured to control each load balancing server to send a deep health check signal to all corresponding background servers according to the health check sending rate if the health check average response time does not exceed the health check sending interval period.

[0082] The normal checking unit 22 is configured to determine to trigger a fusing degradation mechanism and control each load balancing server to send a normal health check signal to all corresponding background servers according to the health check sending rate if the health check average response time exceeds the health check sending interval period.

[0083] In an embodiment of the distributed load balancing system data processing device of the application, referring to Figure 8 , the server checking module 20 further comprises:

[0084] Request asynchronous caching unit 23 is used for asynchronously caching the health check signal and sequentially performing corresponding health check operation according to the corresponding check type of the health check signal.

[0085] Result asynchronous caching unit 24 is used for asynchronously caching the result of the health check operation and sequentially feeding back the result to the load balancing server.

[0086] Referring to Figure 9 In order to further illustrate the scheme, the application further provides a specific application example of a distributed load balancing system data processing method using the above distributed load balancing system data processing device, which specifically includes the following contents:

[0087] (1) Load balancing server 100: Distributed load balancing server, which is composed of multiple servers and inherits the load balancing routing capability of the backend server.

[0088] LB configuration module 101: Configuration function of load balancing health check strategy, which can configure health check period T, load balancing cluster server quantity N, and N value will be automatically and dynamically updated according to the quantity of load balancing cluster. At the same time, it supports configuring health check mode as deep health check or ordinary health check, and health check after automatic degradation as ordinary health check or no health check.

[0089] Health check sending control module 102: According to the specific algorithm, the sending rate of health check can be controlled according to LB configuration module 101 and response time processing module 105.

[0090] Health check request sending module 103: According to LB configuration module 101 and sending rate control module 102, health check for backend server is sent.

[0091] Health check result processing module 104: Responsible for receiving health check processing result, matching processing, confirming whether the backend service is normal or not, and isolating if abnormal.

[0092] Response time processing module 105: The response time t of health check platform is obtained by calculating the recent M health check request times, and the parameter is transmitted to sending control module 102.

[0093] (2) Backend server 200: Application server, responsible for processing application transaction request and health check request.

[0094] Health check receiving module 201: Responsible for receiving health check request of load balancing server.

[0095] Health check asynchronous processing module 202: According to SV configuration module 205, health check is initiated for the backend server itself and external dependent services, and the health check result is written to the check result cache module 203.

[0096] Check result cache module 203: Used to save the health check result of the backend server, provided for health check return module call 204.

[0097] Health check return module 204: Responsible for returning the health check result to the load balancing server 100.

[0098] External dependent service 300: Refers to the external dependent service provided to the backend server 200, including third-party services, database services, etc.

[0099] (3) Third-party dependent service 301: Refers to a service that is not inherently backend server function, but needs to be called by the backend server.

[0100] Database service 302: Refers to the database service that needs to be called by the backend server during operation.

[0101] The specific processing process is as follows:

[0102] Step 301: The load balancing server obtains the health check period T and the number of load balancing cluster servers N through the LB configuration module 101, and N is automatically dynamically updated according to the number of load balancing servers.

[0103] Step 302: The response time processing module 105 calculates the recent M health check request times to obtain the health check average response time t, and passes the parameter to the sending control module 102.

[0104] Step 303: The sending control module dynamically calculates the control health check sending rate through the health check period T and the number of load balancing cluster servers N in the configuration module 101, and dynamically obtains the number of backend servers M and the health check average response time t in the response time processing module 105. The sending rate is determined by the number of backend servers and the average response time: V=2M / (T+t), and the sending interval period Q=(T+t) / 2M is divided according to the number of load balancing servers N, each load balancing server is configured with a different integer number n(1<=n<=N), and the server initiates health check at the interval Q*(1-n / N) time.

[0105] At this time, when t < T, it can be ensured that the deep health check is initiated to all backend servers within T period of time, and the health interval time is dynamically dispersed according to the rate, thereby reducing the pressure of the backend servers at the same time. When t >= T, the fuse degradation mechanism is triggered, and the deep health check mode is automatically degraded to the ordinary port-based health check mode.

[0106] Step 304, the health check request sending module 103 sends a health request to the backend server 200 according to the instruction of the sending control module 102.

[0107] Step 305, in the backend server, the health check asynchronous processing module 202 performs health check on the backend server itself and the external dependent service according to the health check configuration in the SV configuration module, and updates the health check result to the result cache module 203.

[0108] Step 306, after the backend server health check receiving module 201 receives the request, the health check returning module 204 is used for processing.

[0109] Step 307, the health check result is obtained from the check result cache module 203 and returned to the health check processing module 104 of the load balancing server 100.

[0110] Step 308, the health check processing module 104 processes the returned result, and if it is abnormal, the server is isolated, and if it is normal, the health check operation is continuously cycled.

[0111] As known from the above, the deep health is transformed into an asynchronous processing mode without affecting the isolation effect and efficiency of the load balancing health check, and the health check request of the load balancing node is dynamically adjusted according to the number of load balancing servers, the number of backend servers, the health check request response time and other parameters through a specific algorithm, thereby reducing the health check pressure of the distributed load balancing system health check on the backend business system, and providing a health check automatic fuse degradation mode, thereby improving the overall operation stability and business processing capacity of the system.

[0112] From the hardware level, in order to be able to change the deep health check into an asynchronous processing mode without affecting the load balancing health check isolation effect and efficiency, and through a specific algorithm, the health check request of the load balancing node is dynamically adjusted according to the number of load balancing servers, the number of backend servers, the health check request response time and other parameters, reduce the health check pressure of the distributed load balancing system health check on the backend business system, and provide a way of health check automatic fuse degradation, improve the overall operation stability and business processing capacity of the system, the present application provides an embodiment of an electronic device for implementing all or part of the contents of the distributed load balancing system data processing method, the electronic device specifically includes the following contents:

[0113] A processor, a memory, a communications interface and a bus; wherein the processor, the memory, the communications interface complete the communication among each other through the bus; the communications interface is used to realize the information transmission between the distributed load balancing system data processing device and the core business system, the user terminal and the related database and other related devices; the logic controller can be a desktop computer, a tablet computer and a mobile terminal, etc., and the embodiment is not limited thereto. In the embodiment, the logic controller can be implemented with reference to the embodiments of the distributed load balancing system data processing method and the embodiments of the distributed load balancing system data processing device, the contents of which are incorporated herein, and the repeated parts will not be described.

[0114] It can be understood that the user terminal can include a smart phone, a tablet electronic device, a network set-top box, a portable computer, a desktop computer, a personal digital assistant (PDA), a vehicle-mounted device, a smart wearable device, etc. The smart wearable device can include smart glasses, a smart watch, a smart bracelet, etc.

[0115] In actual application, part of the distributed load balancing system data processing method can be executed on the electronic device as described above, or all operations can be completed in the client device. Specifically, the processing capacity of the client device and the use scene of the user can be selected. The present application is not limited thereto. If all operations are completed in the client device, the client device can also include a processor.

[0116] The aforementioned client device may have a communication module (i.e., a communication unit) that can communicate with a remote server to achieve data transmission. The server may include a server on the task scheduling center side; in other implementation scenarios, it may also include a server on an intermediate platform, such as a server on a third-party server platform that has a communication link with the task scheduling center server. The server may include a single computer device, a server cluster consisting of multiple servers, or a distributed server structure.

[0117] Figure 10 This is a schematic block diagram illustrating the system configuration of the electronic device 9600 according to an embodiment of this application. Figure 10 As shown, the electronic device 9600 may include a central processing unit 9100 and a memory 9140; the memory 9140 is coupled to the central processing unit 9100. It is worth noting that... Figure 10 This is an example; other types of structures can also be used to supplement or replace this structure to achieve telecommunications functions or other functions.

[0118] In one embodiment, the data processing method function of the distributed load balancing system can be integrated into the central processing unit 9100. The central processing unit 9100 can be configured to perform the following control:

[0119] Step S101: Determine the health check sending rate based on the load balancer server information and the backend server information to be health checked.

[0120] Step S102: Send a health check signal to the corresponding backend server according to the health check sending rate, so that the backend server performs a health check according to the health check signal and returns the result of the health check.

[0121] As described above, the electronic device provided in this application determines the health check sending rate based on the load balancing server information and the backend server information to be health checked; it sends a health check signal to the corresponding backend server according to the health check sending rate, so that the backend server performs a health check according to the health check signal and returns the result of the health check. This allows deep health checks to be transformed into an asynchronous processing mode without affecting the isolation effect and efficiency of the load balancing health check. Furthermore, a specific algorithm dynamically adjusts the health check requests of the load balancing nodes based on parameters such as the number of load balancing servers, the number of backend servers, and the health check request response time, reducing the health check pressure of the distributed load balancing system on the backend business system, and providing automatic circuit breaking for health checks.

[0122] In another embodiment, the distributed load balancing system data processing device can be configured separately from the central processing unit 9100. For example, the distributed load balancing system data processing device can be configured as a chip connected to the central processing unit 9100, and the distributed load balancing system data processing method function can be implemented through the control of the central processing unit.

[0123] like Figure 10 As shown, the electronic device 9600 may further include: a communication module 9110, an input unit 9120, an audio processor 9130, a display 9160, and a power supply 9170. It is worth noting that the electronic device 9600 does not necessarily need to include these components. Figure 10 All components shown; in addition, the electronic device 9600 may also include Figure 10 For components not shown, please refer to existing technologies.

[0124] like Figure 10 As shown, the central processing unit 9100, sometimes also referred to as a controller or operating control, may include a microprocessor or other processor device and / or logic device, which receives inputs and controls the operation of various components of the electronic device 9600.

[0125] The memory 9140 may be, for example, one or more of a cache, flash memory, hard drive, removable media, volatile memory, non-volatile memory, or other suitable devices. It may store the aforementioned failure-related information, and also store a program for executing that information. The central processing unit 9100 may execute the program stored in the memory 9140 to perform information storage or processing, etc.

[0126] Input unit 9120 provides input to central processing unit 9100. Input unit 9120 may be, for example, a keypad or touch input device. Power supply 9170 provides power to electronic device 9600. Display 9160 displays images and text. Display may be, for example, an LCD display, but is not limited thereto.

[0127] The memory 9140 can be a solid-state memory, such as a read-only memory (ROM), random access memory (RAM), a SIM card, etc. It can also be a memory that retains information even when power is off, can be selectively erased, and contains more data; examples of this type of memory are sometimes referred to as EPROMs. The memory 9140 can also be some other type of device. The memory 9140 includes a buffer memory 9141 (sometimes referred to as a buffer). The memory 9140 may include an application / function storage unit 9142 for storing application programs and function programs or processes for executing the operation of the electronic device 9600 via the central processing unit 9100.

[0128] The memory 9140 can further include a data storage 9143 for storing data such as contacts, digital data, pictures, sounds, and / or any other data used by the electronic device. A driver storage 9144 of the memory 9140 can include various drivers of the electronic device for communication functions and / or for performing other functions of the electronic device (e.g., a messaging application, a phonebook application, etc.).

[0129] The communication module 9110 is a transmitter / receiver 9110 that transmits and receives signals via an antenna 9111. The communication module (transmitter / receiver) 9110 is coupled to the central processor 9100 to provide input signals and receive output signals, as in the case of a conventional mobile communication terminal.

[0130] Based on different communication technologies, a plurality of communication modules 9110, such as a cellular network module, a Bluetooth module, and / or a wireless local area network module, etc., can be provided in the same electronic device. The communication module (transmitter / receiver) 9110 is further coupled to a speaker 9131 and a microphone 9132 via an audio processor 9130 to provide audio output via the speaker 9131 and receive audio input from the microphone 9132, thereby implementing a conventional telecommunication function. The audio processor 9130 can include any suitable buffer, decoder, amplifier, etc. In addition, the audio processor 9130 is coupled to the central processor 9100, thereby enabling recording on the local device via the microphone 9132 and playing stored sounds on the local device via the speaker 9131.

[0131] The embodiment of the present application further provides a computer readable storage medium capable of implementing all steps of the distributed load balancing system data processing method in which the execution subject is the server or the client in the above-mentioned embodiment, wherein the computer program is stored on the computer readable storage medium, and the computer program is executed by the processor to implement all steps of the distributed load balancing system data processing method in which the execution subject is the server or the client in the above-mentioned embodiment, for example, the processor executes the computer program to implement the following steps:

[0132] Step S101: determining a health check sending rate according to the load balancing server information and the background server information to be subjected to health check.

[0133] Step S102: sending a health check signal to the corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns the result of the health check.

[0134] From the above description, the computer readable storage medium provided by the embodiments of the application can determine a health check sending rate according to load balancing server information and background server information to be health checked, send a health check signal to a corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns a result of the health check, thereby being capable of transforming a deep health check into an asynchronous processing mode without affecting the isolation effect and efficiency of load balancing health check, dynamically adjusting health check requests of load balancing nodes according to parameters such as the number of load balancing servers, the number of backend servers, and health check request response time by a specific algorithm, reducing health check pressure of a distributed load balancing system on a backend business system, and providing health check automatic fusing.

[0135] The embodiments of the application further provide a computer program product capable of implementing all steps in the distributed load balancing system data processing method in which the execution subject is the server or the client in the above embodiments. The computer program / instruction is executed by the processor to implement the steps of the distributed load balancing system data processing method, for example, the computer program / instruction implements the following steps:

[0136] Step S101: determining a health check sending rate according to load balancing server information and background server information to be health checked.

[0137] Step S102: sending a health check signal to a corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns a result of the health check.

[0138] From the above description, the computer program product provided by the embodiments of the application can determine a health check sending rate according to load balancing server information and background server information to be health checked, send a health check signal to a corresponding background server according to the health check sending rate, so that the background server performs health check according to the health check signal and returns a result of the health check, thereby being capable of transforming a deep health check into an asynchronous processing mode without affecting the isolation effect and efficiency of load balancing health check, dynamically adjusting health check requests of load balancing nodes according to parameters such as the number of load balancing servers, the number of backend servers, and health check request response time by a specific algorithm, reducing health check pressure of a distributed load balancing system on a backend business system, and providing health check automatic fusing.

[0139] Those skilled in the art will appreciate that embodiments of the present application can be readily used as software, hardware, or a combination of software and hardware. In a software embodiment, the methods can be tangibly embodied in a machine-readable storage medium having stored thereon instructions that can be used to program a computer to perform any of the operations described herein. The software implementation can be for example, in the form of a computer program product. The software implementation can be implemented in a centralized fashion in one computer system or network, or be distributed over a network such computer systems, some of which can implement the

[0140] The present application is described in relation to flow diagrams and / or block diagrams of methods, apparatus (devices) and computer program products according to embodiments of the application. It is understood that each block of the flow diagrams and / or block diagrams, and combinations of blocks in the flow diagrams and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flow diagrams and / or block diagrams block or blocks. Figure 1 one or more functions specified in the flow diagram and / or block diagram block or blocks. Figure 1 one or more functions specified in the flow diagram and / or block diagram block or blocks.

[0141] These computer program instructions can also be stored in a computer- readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instructions which implement the flow diagram and / or block diagram block or blocks. Figure 1 one or more functions specified in the flow diagram and / or block diagram block or blocks. Figure 1 one or more functions specified in the flow diagram and / or block diagram block or blocks.

[0142] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the flow diagram and / or block diagram block or blocks. Figure 1 one or more functions specified in the flow diagram and / or block diagram block or blocks. Figure 1 one or more functions specified in the flow diagram and / or block diagram block or blocks.

[0143] The principles and implementation of the present application are described in the embodiments. The above description of the embodiments is only to help understand the method of the present application and its core idea; meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation and application range can be changed; in summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A data processing method for a distributed load balancing system, characterized in that, The method includes: The health check sending rate is determined based on the load balancer server information and the backend server information to be health checked. According to the health check sending rate, a health check signal is sent to the corresponding backend server, so that the backend server performs a health check based on the health check signal and returns the result of the health check. The step of determining the health check sending rate based on the load balancing server information and the backend server information to be health checked includes: The health check sending rate is determined by the ratio of twice the number of backend servers to be checked to the total time of the preset health check cycle and the average response time of the health check determined by historical data. Based on the health check sending rate and the number of load balancer servers, the health check sending interval for each load balancer server is determined.

2. The data processing method for a distributed load balancing system according to claim 1, characterized in that, Sending a health check signal to the corresponding backend server according to the health check sending rate includes: If the average response time of the health check does not exceed the health check sending interval, then each load balancer server is controlled to send a deep health check signal to all corresponding backend servers according to the health check sending rate. If the average response time of the health check exceeds the health check sending interval, the circuit breaker degradation mechanism is triggered, and each load balancer server is controlled to send a normal health check signal to all corresponding backend servers according to the health check sending rate.

3. The data processing method for a distributed load balancing system according to claim 1, characterized in that, The backend server performs a health check based on the health check signal and returns the results of the health check, including: The health check signals are asynchronously cached, and the corresponding health check operations are executed sequentially according to the check type corresponding to the health check signals. The results of the health check operation are asynchronously cached and then sequentially fed back to the load balancer server.

4. The data processing method for a distributed load balancing system according to claim 1, characterized in that, The step of determining the health check sending interval period for each load balancer based on the health check sending rate and the number of load balancer servers includes: The load balancing servers are divided into equal groups according to a set interval, and the health check sending interval period of each load balancing server after division is determined according to the health check sending rate.

5. A data processing device for a distributed load balancing system, characterized in that, include: The health check rate determination module is used to determine the health check sending rate based on the load balancer server information and the backend server information to be health checked. The server check module is used to send a health check signal to the corresponding backend server according to the health check sending rate, so that the backend server performs a health check according to the health check signal and returns the result of the health check. The inspection rate determination module includes: The rate determination unit is used to determine the health check sending rate based on the ratio of twice the number of backend servers to be health checked to the total time of the preset health check cycle and the average response time of the health check determined by historical data. The interval determination unit is used to determine the health check sending interval period for each load balancer based on the health check sending rate and the number of load balancer servers.

6. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the distributed load balancing system data processing method according to any one of claims 1 to 4.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the steps of the distributed load balancing system data processing method according to any one of claims 1 to 4.

8. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instruction is executed by the processor, it implements the steps of the distributed load balancing system data processing method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Health check method and heath check system for application program

    CN105589787A

  • Method and device for determining cloud short message platform during SSLVPN authentication and electronic equipment

    CN111901298A