System capacity overload verification method and device, storage medium and electronic equipment

Abstract

The invention provides a system capacity overload verification method and apparatus, a storage medium and an electronic device. The method comprises the steps of determining a flow type of each flow; on the basis of the traffic type of each traffic, blocking the online asynchronous traffic in the plurality of traffic in an asynchronous queue, and distributing the online synchronous traffic in the plurality of traffic to a first machine room included in the online service system, so that the first machine room bears the online synchronous traffic; distributing the online asynchronous traffic in the asynchronous queue to a second machine room included in the online service system according to a target traffic consumption rate increasing strategy, so that the second machine room bears the online asynchronous traffic; and performing system capacity overload verification on the online service system in the isolated consumption process of the online traffic under the machine room dimension to obtain a system capacity overload performance indication result of the online service system. According to the embodiment of the invention, the system capacity overload verification can be carried out under the condition of avoiding the loss of the online flow, so that the stability of the system is improved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular, to a method, device, storage medium and electronic device for verifying system capacity overload. Background Art

[0002] Currently, the underlying technologies of various APPs (Applications) and WEB (World Wide Web) website services used by users are all jointly realized through the cooperation of multiple different services. To ensure that product functions can be continuously provided to users without interruption, even if there is an unexpected sudden increase in online traffic, each service will be deployed in the form of multiple replica instances on multiple servers. However, it is difficult to evaluate how many replica instances of each type of service should be deployed to ensure that the capacity requirements of online traffic are met; moreover, the underlying services need to access each other, and the number of accesses and the content of accesses are not standard-rated, so system capacity overload verification is required. In this regard, related technologies usually perform system capacity overload verification by simulating traffic, which will cause losses to normal business traffic (i.e., online traffic), resulting in poor system stability. Based on this, there is currently no good solution for how to perform system capacity overload verification without causing losses to online traffic to improve system stability. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a method, device, storage medium and electronic device for verifying system capacity overload to solve problems such as poor system stability caused by related technologies; that is, embodiments of the present invention can enable the first computer room to carry online synchronous traffic, and enable the second computer room to consume the online asynchronous traffic in the asynchronous queue according to the target traffic consumption rate increase strategy, so as to realize system capacity overload verification. That is, through the dual-computer-room deployment feature of the online service and the design of the asynchronous queue in the system, the online asynchronous traffic can be blocked, and the system capacity overload performance can be effectively verified by adopting the method of progressively consuming the queue traffic. In this case, system capacity overload verification can be realized through online traffic (including online synchronous traffic and online asynchronous traffic), without introducing simulated traffic, and thus system capacity overload verification can be performed without causing losses to online traffic, so as to effectively improve the stability of the system.

[0004] According to one aspect of the embodiments of the present invention, a method for verifying system capacity overload is provided, and the method includes:

[0005] Receiving a plurality of traffic flows, and determining the traffic flow type of each traffic flow in the plurality of traffic flows, where the traffic flow type of a traffic flow is used to indicate that the corresponding traffic flow is online asynchronous traffic or online synchronous traffic;

[0006] Based on the traffic types of the respective traffic, block the online asynchronous traffic among the multiple traffic in an asynchronous queue, and distribute the online synchronous traffic among the multiple traffic to a first computer room included in the online service system, so that the first computer room bears the online synchronous traffic;

[0007] According to the target traffic consumption rate increase strategy, distribute the online asynchronous traffic in the asynchronous queue to a second computer room included in the online service system, so that the second computer room bears the online asynchronous traffic;

[0008] During the isolated consumption process of the online traffic in terms of computer room dimension, perform system capacity overload verification on the online service system to obtain the system capacity overload performance indication result of the online service system.

[0009] According to another aspect of the embodiments of the present invention, there is provided a system capacity overload verification device, and the device includes:

[0010] A receiving unit, configured to receive multiple traffic;

[0011] A processing unit, configured to determine the traffic type of each traffic among the multiple traffic, and the traffic type of a traffic is used to indicate that the corresponding traffic is online asynchronous traffic or online synchronous traffic;

[0012] The processing unit is further configured to block the online asynchronous traffic among the multiple traffic in an asynchronous queue based on the traffic types of the respective traffic, and distribute the online synchronous traffic among the multiple traffic to a first computer room included in the online service system, so that the first computer room bears the online synchronous traffic;

[0013] The processing unit is further configured to distribute the online asynchronous traffic in the asynchronous queue to a second computer room included in the online service system according to the target traffic consumption rate increase strategy, so that the second computer room bears the online asynchronous traffic;

[0014] The processing unit is further configured to perform system capacity overload verification on the online service system during the isolated consumption process of the online traffic in terms of computer room dimension to obtain the system capacity overload performance indication result of the online service system.

[0015] According to another aspect of the embodiments of the present invention, there is provided an online service system, and the online service system includes a system capacity overload verification device, a first computer room, a second computer room, and multiple service clusters. A service cluster includes a service sub-cluster located in the first computer room and a service sub-cluster located in the second computer room; wherein, the system capacity overload verification device is configured to enable the online service system to execute the method mentioned above.

[0016] According to another aspect of the embodiments of the present invention, an electronic device is provided. The electronic device includes a processor and a memory storing a program. Wherein, the program includes instructions that, when executed by the processor, cause the processor to execute the method mentioned above.

[0017] According to another aspect of the embodiments of the present invention, a non-transitory computer-readable storage medium storing computer instructions is provided. The computer instructions are used to cause a computer to execute the method mentioned above.

[0018] In the embodiments of the present invention, after receiving multiple traffic flows, the traffic type of each traffic flow among the multiple traffic flows can be determined. The traffic type of a traffic flow is used to indicate that the corresponding traffic flow is an online asynchronous traffic flow or an online synchronous traffic flow. Based on this, the online asynchronous traffic flows among the multiple traffic flows can be blocked in the asynchronous queue according to the traffic type of each traffic flow, and the online synchronous traffic flows among the multiple traffic flows can be distributed to the first computer room included in the online service system, so that the first computer room bears the online synchronous traffic flows. Further, according to the target traffic consumption rate increase strategy, the online asynchronous traffic flows in the asynchronous queue can be distributed to the second computer room included in the online service system, so that the second computer room bears the online asynchronous traffic flows. Then correspondingly, during the isolated consumption process of the online traffic flows in terms of computer rooms, the system capacity overload verification of the online service system can be performed to obtain the indication result of the system capacity overload performance of the online service system. It can be seen that the embodiments of the present invention can make the first computer room bear the online synchronous traffic flows and make the second computer room consume the online asynchronous traffic flows in the asynchronous queue according to the target traffic consumption rate increase strategy, thereby realizing the system capacity overload verification. That is to say, the embodiments of the present invention can utilize the online service dual-computer room deployment feature and the asynchronous queue design in the system to block the online asynchronous traffic flows, and effectively verify the system capacity overload performance by adopting the progressive consumption of the queue traffic flows. Based on this, the embodiments of the present invention can realize the system capacity overload verification through the online traffic flows (including online synchronous traffic flows and online asynchronous traffic flows), without introducing simulated traffic flows, and further can perform the system capacity overload verification without causing losses to the online traffic flows, so as to effectively improve the stability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In the following description of the exemplary embodiments in conjunction with the drawings, more details, features and advantages of the present invention are disclosed. In the drawings:

[0020] Figure 1 A flowchart showing a method for verifying system capacity overload according to an exemplary embodiment of the present invention is shown;

[0021] Figure 2 A schematic diagram of an online service system according to an exemplary embodiment of the present invention is shown;

[0022] Figure 3 The flowchart shows another method for verifying system capacity overload according to an exemplary embodiment of the present invention;

[0023] Figure 4 The schematic block diagram shows a system capacity overload verification device according to an exemplary embodiment of the present invention;

[0024] Figure 5 The structural block diagram shows an exemplary electronic device that can be used to implement the embodiments of the present invention. Detailed implementation manners

[0025] Embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Instead, these embodiments are provided to more thoroughly and completely understand the present invention. It should be understood that the drawings and embodiments of the present invention are only for exemplary purposes and are not used to limit the protection scope of the present invention.

[0026] It should be understood that the steps recited in the method embodiments of the present invention can be executed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this regard.

[0027] As used herein, the term "including" and its variations are open-ended, that is, "including but not limited to". The term "based on" is "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description. It should be noted that the concepts such as "first" and "second" mentioned in the present invention are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependent relationships.

[0028] It should be noted that the modifications of "one" and "multiple" mentioned in the present invention are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise clearly specified in the context, it should be understood as "one or more".

[0029] The names of the messages or information exchanged between multiple devices in the embodiments of the present invention are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0030] It should be noted that the execution subject of the system capacity overload verification method provided in the embodiments of the present invention can be one or more electronic devices, and the embodiments of the present invention do not limit this; among them, the electronic device can be a terminal (i.e., a client) or a server. Then, when the execution subject includes multiple electronic devices, and at least one terminal and at least one server are included in the multiple electronic devices, the system capacity overload verification method provided in the embodiments of the present invention can be jointly executed by the terminal and the server. Optionally, one or more electronic devices for executing the system capacity overload verification method can form a system capacity overload verification device, then the execution subject of the system capacity overload verification method provided in the embodiments of the present invention can be the system capacity overload verification device. Correspondingly, the terminals mentioned here can include but are not limited to: smart phones, tablet computers, laptop computers, desktop computers, intelligent voice interaction devices, and so on. The servers mentioned here can be independent physical servers, or a server cluster or distributed system composed of multiple physical servers, or cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms, and so on.

[0031] Optionally, the embodiments of the present invention may relate to an online service system, which includes a system capacity overload verification device, a first computer room, a second computer room, and multiple service clusters. A service cluster includes a service sub-cluster located in the first computer room and a service sub-cluster located in the second computer room. Optionally, the system capacity overload verification device may include but is not limited to an online traffic access and forwarding platform (which can be used as an access point for traffic to access the request traffic accessed by customers through the operator and forward it to the real online services at the back end), etc., and the embodiments of the present invention do not limit this; exemplarily, it may also include a capacity overload performance detection module, etc. At this time, the following system capacity overload verification of the online service system can be executed through the capacity overload performance detection module, that is, the execution subject of the system capacity overload verification method can be the online traffic access and forwarding platform and the capacity overload performance detection module, and so on. Optionally, the online traffic access and forwarding platform can be a BFE platform (Baidu Front End), etc.; the embodiments of the present invention do not limit this. Optionally, the online traffic access and forwarding platform and the capacity overload performance detection module can be located on the same electronic device (such as the capacity overload performance detection module can be located on the online traffic access and forwarding platform, etc.), or on different electronic devices, and the embodiments of the present invention do not limit this.

[0032] Based on the above description, an embodiment of the present invention provides a method for verifying system capacity overload. This method for verifying system capacity overload can be executed by the aforementioned electronic device (terminal or server), that is, by the electronic devices constituting the system capacity overload verification device. In other words, it can be executed by the system capacity overload verification device. For the sake of clarity, hereinafter, the system capacity overload verification method executed by the system capacity overload verification device will be taken as an example for illustration; as Figure 1 shown, the method for verifying system capacity overload may include the following steps S101 - S104:

[0033] S101, Receive multiple traffic flows, and determine the traffic flow type of each traffic flow among the multiple traffic flows. The traffic flow type of a traffic flow is used to indicate whether the corresponding traffic flow is an online asynchronous traffic flow or an online synchronous traffic flow.

[0034] In an embodiment of the present invention, the traffic flow (i.e., the request traffic flow) can be accessed from a client (such as the client being a mobile app or a web access entry, etc.), so that the traffic flow is connected to the online traffic access and forwarding platform. Optionally, the above - mentioned multiple traffic flows can be all the online traffic flows received within a period of time; that is to say, the system capacity overload verification device can receive online traffic flows in real - time through the online traffic access and forwarding platform to receive the above - mentioned multiple traffic flows; and the online traffic access and forwarding platform can continuously receive real - time traffic flows.

[0035] Optionally, a traffic flow type can be an online asynchronous traffic flow type (which can be used to indicate an online asynchronous traffic flow) or an online synchronous traffic flow type (which can be used to indicate an online synchronous traffic flow), etc. The embodiments of the present invention do not limit this. Based on this, when the traffic flow type of a traffic flow is the online asynchronous traffic flow type, the corresponding traffic flow can be determined as an online asynchronous traffic flow; when the traffic flow type of a traffic flow is the online synchronous traffic flow type, the corresponding traffic flow can be determined as an online synchronous traffic flow.

[0036] Optionally, when determining the traffic type of each of the multiple traffic flows, for any one of the multiple traffic flows, the online traffic access and forwarding platform can determine the service type of the service to which any one of the traffic flows belongs (i.e., the online service). If the service type of the service to which any one of the traffic flows belongs is the online synchronous service type, then the traffic type of any one of the traffic flows can be determined to be the online synchronous traffic type; if the service type of the service to which any one of the traffic flows belongs is the online asynchronous service type, then the traffic type of any one of the traffic flows can be determined to be the online asynchronous traffic type. Optionally, the service type of a service can be set according to experience or according to actual requirements, and the embodiments of the present invention do not limit this. It should be noted that a service under an online asynchronous service type allows delayed response, that is, it allows delayed response to the requested traffic; correspondingly, a service under an online synchronous service type does not allow delayed response, that is, it does not allow delayed response to the requested traffic, that is, it is necessary to respond to the requested traffic in real time. Optionally, a service can correspond to a service cluster, and a service cluster can include multiple services of the same type, that is, it can include the same service in multiple computer rooms. Among them, an online service can include one or more programs, which can be accessed by users inside or outside the company and provide one or several functions to users.

[0037] S102, based on the traffic types of each traffic flow, block the online asynchronous traffic among the multiple traffic flows in the asynchronous queue, and distribute the online synchronous traffic among the multiple traffic flows to the first computer room included in the online service system, so that the first computer room bears the online synchronous traffic.

[0038] In the embodiments of the present invention, system capacity overload verification can be performed by the online traffic access and forwarding platform distributing the received traffic to the first computer room and the second computer room, that is, blocking the online asynchronous traffic among the multiple traffic flows in the asynchronous queue for subsequent distribution to the second computer room below, and distributing the online synchronous traffic among the multiple traffic flows to the first computer room included in the online service system.

[0039] Optionally, the first computer room can be any computer room in the online service system, and the second computer room can be a computer room in the online service system other than the first computer room. Based on this, the embodiments of the present invention can block the traffic of the online asynchronous process (i.e., the online asynchronous traffic) in the asynchronous queue through traffic scheduling by computer room, and cut the online synchronous traffic to the first computer room, thereby forming a single computer room to bear the online synchronous traffic.

[0040] S103, according to the target traffic consumption rate increase strategy, distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system, so that the second computer room bears the online asynchronous traffic.

[0041] Optionally, the target traffic consumption rate increase strategy can be set according to experience or according to actual requirements. The embodiments of the present invention do not limit this. Based on this, the embodiments of the present invention can adopt a progressive manner to consume the traffic in the asynchronous queue in the second computer room. The consumption rate of the traffic in the asynchronous queue increases from low to high, so as to implement the following system capacity overload verification, thereby verifying the performance of system capacity overload.

[0042] S104. During the isolated consumption of online traffic in the computer room dimension, perform system capacity overload verification on the online service system to obtain an indication result of the system capacity overload performance of the online service system.

[0043] In the embodiments of the present invention, the online service system may include multiple service clusters; based on the above traffic distribution process, the service cluster corresponds to the BNS of the online service (a domain name service that can translate a domain name into an IP (Internet Protocol), making it more convenient for users to use Internet services, that is, providing a mapping from the service name to the service running instance, and can obtain a list of information of the running instances under the service according to a name, including host name, IP, port, running status, etc. When a service needs to access other services, it can find the IP of the corresponding service through the BNS name of the corresponding service). Optionally, a service cluster may include service sub-clusters located in each computer room of the online service system respectively. A service sub-cluster corresponds to the BNS-A and BNS-B of the online service, etc. That is to say, a service sub-cluster may correspond to one BNS; optionally, a service cluster may be a BFE cluster (a backend cluster). The BFE cluster is compatible with the BNS. Each BNS corresponds to a cluster concept in the BFE cluster. The BFE cluster name is generally the same as the BNS, that is, one-to-one correspondence; optionally, a BFE cluster may correspond to multiple BFE sub-clusters (that is, a service sub-cluster). That is, the BFE sub-cluster is a refined concept based on the BFE cluster, that is, it is refined by computer room. For example, the BFE cluster corresponds to BFE sub-cluster A and BFE sub-cluster B, and A and B are different computer room attributes, etc. Based on this, the embodiments of the present invention can isolate the traffic according to the computer room dimension, which is the basis for the online system capacity overload verification.

[0044] Exemplarily, such as Figure 2As shown in the figure, assume that the first computer room is computer room A, the second computer room is computer room B, and the multiple service clusters include service cluster 1 (including multiple services 1), service cluster 2 (including multiple services 2), service cluster 3 (including multiple services 3), etc.; in this case, service cluster 1 may include service sub-cluster 1-A (i.e., the service sub-cluster 1 in computer room A, which may include service 1 in computer room A and may correspond to the BNS named BNS1-A) and service sub-cluster 1-B (i.e., the service sub-cluster 1 in computer room B, which may include service 1 in computer room B and may correspond to the BNS named BNS1-B), service cluster 2 may include service sub-cluster 2-A (i.e., the service sub-cluster 2 in computer room A, which may include service 2 in computer room A and may correspond to the BNS named BNS2-A) and service sub-cluster 2-B (i.e., the service sub-cluster 2 in computer room B, which may include service 2 in computer room B and may correspond to the BNS named BNS2-B), service cluster 3 may include service sub-cluster 3-A (i.e., the service sub-cluster 3 in computer room A, which may include service 3 in computer room A and may correspond to the BNS named BNS3-A) and service sub-cluster 3-B (i.e., the service sub-cluster 3 in computer room B, which may include service 3 in computer room B and may correspond to the BNS named BNS3-B), and so on.

[0045] In summary, the embodiments of the present invention can fully verify the system capacity overload by adjusting the consumption rate of online asynchronous traffic. Optionally, during the system capacity overload verification, if there is a capacity risk for one or more services in the second computer room, the failed requests (i.e., request traffic) can be retried and completed; at the same time, the online synchronous traffic is processed in another computer room (i.e., the first computer room). Therefore, from the perspective of the stability of online services, the embodiments of the present invention can also ensure that the functions of online service products can be continuously provided to users without interruption.

[0046] Optionally, in other embodiments, the asynchronous queue may also be located in any device in the second computer room. At this time, the online asynchronous traffic can be distributed to the device in the second computer room that contains the asynchronous queue, so that the device containing the asynchronous queue blocks the online asynchronous traffic in the asynchronous queue, and then in the subsequent process, the second computer room consumes the traffic in the asynchronous queue according to the target traffic consumption rate increase strategy, and so on; the embodiments of the present invention do not limit this. In this case, the system capacity overload verification device may also include the device in the second computer room that contains the asynchronous queue, and so on.

[0047] Optionally, during actual application (i.e., during the process where system capacity overload verification is not implemented), after receiving traffic, the online traffic access and forwarding platform can, according to the traffic ratio of each service cluster in the multiple service clusters included in the online service cluster (i.e., configured according to the traffic ratio of each service sub-cluster in each service cluster), direct the traffic to the corresponding service sub-cluster through a polling algorithm, and the service corresponding to a service sub-cluster actually processes client requests.

[0048] In an embodiment of the present invention, after receiving multiple traffic flows, the traffic flow type of each traffic flow among the multiple traffic flows can be determined. The traffic flow type of a traffic flow is used to indicate that the corresponding traffic flow is online asynchronous traffic or online synchronous traffic. Based on this, the online asynchronous traffic among the multiple traffic flows can be blocked in the asynchronous queue, and the online synchronous traffic among the multiple traffic flows can be distributed to the first computer room included in the online service system, so that the first computer room bears the online synchronous traffic; further, according to the target traffic consumption rate increase strategy, the online asynchronous traffic in the asynchronous queue can be distributed to the second computer room included in the online service system, so that the second computer room bears the online asynchronous traffic. Then correspondingly, during the isolated consumption process of the online traffic in terms of computer room dimension, system capacity overload verification can be performed on the online service system to obtain an indication result of the system capacity overload performance of the online service system. It can be seen that the embodiment of the present invention can enable the first computer room to bear the online synchronous traffic and enable the second computer room to consume the online asynchronous traffic in the asynchronous queue according to the target traffic consumption rate increase strategy, thereby realizing system capacity overload verification. That is to say, the embodiment of the present invention can, through the online service dual-computer room deployment feature, utilize the asynchronous queue design in the system to block the online asynchronous traffic, and effectively verify the system capacity overload performance by adopting a progressive consumption queue traffic method; based on this, the embodiment of the present invention can realize system capacity overload verification through online traffic (including online synchronous traffic and online asynchronous traffic), without introducing simulated traffic, and further can perform system capacity overload verification without causing losses to the online traffic, so as to effectively improve the stability of the system.

[0049] Based on the above description, another system capacity overload verification method is also proposed in an embodiment of the present invention. Correspondingly, this system capacity overload verification method can be executed by the above-mentioned electronic device (terminal or server), that is, can be executed by the electronic device constituting the system capacity overload verification device. That is to say, it can be executed by the system capacity overload verification device. For the convenience of description, hereinafter, the system capacity overload verification device executing this system capacity overload verification method will be taken as an example for description; please refer to Figure 3 , this system capacity overload verification method may include the following steps S301 - S305:

[0050] S301. Receive multiple traffic flows and determine the traffic type of each traffic flow in the multiple traffic flows. The traffic type of a traffic flow is used to indicate that the corresponding traffic flow is an online asynchronous traffic flow or an online synchronous traffic flow.

[0051] S302. Based on the traffic types of the respective traffic flows, block the online asynchronous traffic flows among the multiple traffic flows in an asynchronous queue, and distribute the online synchronous traffic flows among the multiple traffic flows to the first computer room included in the online service system, so that the first computer room bears the online synchronous traffic flows.

[0052] In an embodiment of the present invention, the online asynchronous traffic flows in the asynchronous queue can be consumed after the traffic volume accumulates to a target traffic threshold. That is to say, the online asynchronous traffic flows can be blocked in the asynchronous queue until the traffic volume in the asynchronous queue accumulates to the target traffic threshold, thereby triggering the following steps to perform capacity overload verification in ascending order of consumption rate, and gradually discover the service capacity shortcoming in the system and the performance of each service after overload.

[0053] S303. Determine a consumption rate sequence from low to high according to a target traffic consumption rate increase strategy.

[0054] Among them, the target traffic consumption rate increase strategy is used to indicate the change process of the traffic consumption rate from low to high.

[0055] Optionally, the target traffic consumption rate increase strategy may include, but is not limited to, an initial traffic consumption rate and traffic increase indication information, etc. The embodiments of the present invention do not limit this. Optionally, the traffic increase indication information may be a traffic increase ratio (such as 10% or 15%, etc.), and the next traffic consumption rate is obtained by increasing according to the traffic increase ratio on the basis of the previous traffic consumption rate (which can be simply referred to as the consumption rate). For example, the first consumption rate in the consumption rate sequence may be the initial traffic consumption rate, and the second consumption rate may be the first consumption rate + the first consumption rate × the traffic increase ratio; or, the traffic increase indication information may be a traffic increase quantity (such as 10 or 20, etc.), and the next traffic consumption rate is obtained by adding the traffic increase quantity to the previous traffic consumption rate. For example, the first consumption rate in the consumption rate sequence may be the initial traffic consumption rate, and the second consumption rate may be the first consumption rate + the traffic increase quantity, and so on; the embodiments of the present invention do not limit this. Optionally, both the initial traffic consumption rate and the traffic increase indication information may be set according to experience or according to actual requirements. The embodiments of the present invention do not limit this.

[0056] Optionally, the target traffic consumption rate increase strategy may further include a consumption rate threshold; in this case, multiple consumption rates from low to high may be determined based on the initial traffic consumption rate and the traffic increase indication information and added to the consumption rate sequence in turn until the last consumption rate in the consumption rate sequence is greater than or equal to the consumption rate threshold, such as taking the consumption rate threshold as the last consumption rate in the consumption rate sequence, or completing the determination of the consumption rate sequence when the last consumption rate is greater than or equal to the consumption rate threshold; wherein, the consumption rate after any consumption rate in the consumption rate sequence is greater than any consumption rate. Based on this, the embodiments of the present invention can determine the consumption rate sequence based on the initial traffic consumption rate, the traffic increase indication information, and the consumption rate threshold.

[0057] S304, in sequence according to each consumption rate in the consumption rate sequence, distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system until the capacity overload verification suspension condition is reached, so that the second computer room bears the online asynchronous traffic.

[0058] S305, during the isolated consumption of the online traffic in the computer room dimension, perform system capacity overload verification on the online service system in the order of consumption rate from low to high to obtain the system capacity overload performance indication result of the online service system.

[0059] Wherein, the isolated consumption of the online traffic in the computer room dimension may refer to the isolated consumption of the online synchronous traffic and the online asynchronous traffic in the computer room dimension.

[0060] Optionally, after all the online asynchronous traffic in the asynchronous queue has been consumed, if no system capacity overload is detected (i.e., no system capacity overload manifestation is detected), the target traffic threshold can be adjusted to obtain an adjusted target traffic threshold, where the adjusted target traffic threshold is greater than the target traffic threshold; then, the received online asynchronous traffic can continue to be blocked in the asynchronous queue until the traffic quantity in the asynchronous queue accumulates to the adjusted target traffic threshold, so as to trigger the execution of the target traffic consumption rate increase strategy, and distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system, thereby verifying the system capacity overload of the online service system. Based on this, the target traffic threshold can be continuously adjusted until a system capacity overload manifestation is detected. Optionally, if no system capacity overload is detected after all the online asynchronous traffic in the asynchronous queue has been consumed, the target traffic consumption rate increase strategy can also be adjusted according to the consumption rate increase adjustment strategy, such as increasing the traffic increase indication information and / or the consumption rate threshold to implement the adjustment of the target traffic consumption rate increase strategy, so as to distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system according to the adjusted target traffic consumption rate increase strategy, and verify the system capacity overload according to the adjusted consumption rate sequence until a system capacity overload manifestation is detected, etc.; it should be noted that the consumption rate increase adjustment strategy can be set according to experience or according to actual requirements, and the embodiments of the present invention do not limit this.

[0061] Optionally, after detecting a system capacity overload manifestation, the target traffic consumption rate increase strategy can also be updated according to the consumption rate decrease strategy (such as reducing the traffic increase indication information, etc.), so as to distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system according to the updated target traffic consumption rate increase strategy, thereby consuming the traffic in the asynchronous queue according to the updated consumption rate sequence. Optionally, the consumption rate decrease strategy can be set according to experience or according to actual requirements, and the embodiments of the present invention do not limit this.

[0062] Optionally, when the system capacity overload verification device detects that a traffic processing exception problem occurs in the first computer room, it can suspend the system capacity overload verification, so as to switch the online synchronization traffic to the second computer room for handling. Optionally, the system capacity overload verification device can detect whether a traffic processing exception problem occurs in the first computer room through the capacity overload performance detection module, etc.; the embodiments of the present invention do not limit this. Optionally, it can be determined that a traffic processing exception problem is detected when the traffic in the first computer room has no response (i.e., the request has no response), or it can be determined that a traffic processing exception problem is detected when the traffic in the first computer room has a timeout response (such as the response duration is greater than the preset synchronization traffic response duration threshold), etc.; the embodiments of the present invention do not limit this. Optionally, the preset synchronization traffic response duration threshold can be set according to experience or according to actual requirements, and the embodiments of the present invention do not limit this.

[0063] Optionally, when the system capacity overload verification device detects an unexpected problem caused by system capacity overload, it can also suspend the system capacity overload verification; thereby determining the safe consumption rate, and consuming the remaining traffic in the asynchronous queue at the safe consumption rate to restore the service with problems to normal; after the traffic in the asynchronous queue is consumed, the first computer room and the second computer room can resume consuming the online traffic according to the target traffic ratio, that is, the actual application process of the online service system can be restored (i.e., the overall online traffic resumes the dual-computer room), that is to say, the process of system capacity overload verification can be exited, and then through the polling algorithm, the traffic can be diverted to the corresponding service sub-clusters according to the target traffic ratio, that is, diverted to the corresponding service sub-clusters in the corresponding computer room, and then the system capacity overload verification can be completed. Optionally, the system capacity overload verification device can detect whether the system capacity overload causes an unexpected problem through the capacity overload performance detection module to detect whether there is an unexpected problem with the service in the second computer room. Optionally, the unexpected problem can be set according to experience or according to actual requirements, and the embodiments of the present invention do not limit this; exemplarily, the unexpected problem can include blocking other service processes (i.e., the service that blocks other service processes can be regarded as the service with problems), and can also include stimulating downstream services (i.e., the service that stimulates downstream services can be regarded as the service with problems), and so on; the embodiments of the present invention do not limit this. Optionally, when an expected problem caused by system capacity overload is detected, the system capacity overload verification can continue until the traffic in the asynchronous queue is consumed, so as to complete the system capacity overload verification; optionally, the expected problem can include excessive memory usage (such as exceeding the preset memory usage threshold), and can also include excessive CPU (Central Processing Unit) usage (such as exceeding the preset CPU usage threshold), and so on; the embodiments of the present invention do not limit this. Optionally, the expected problem, the preset memory usage threshold, and the preset CPU usage threshold can all be set according to experience or according to actual requirements, and the embodiments of the present invention do not limit this.

[0064] Optionally, the safe consumption rate can be set according to experience or according to actual requirements, and the embodiments of the present invention do not limit this. In the embodiments of the present invention, the safe consumption rate can be a safe low consumption rate, so as to consume the remaining traffic in the asynchronous queue at a lower consumption rate. Optionally, the system capacity overload performance indication result can include but is not limited to service overload problems (which can reflect why there is an overload, such as memory and other resources reaching the upper limit, etc.) and / or overload performance (such as affecting business metrics, etc.) in the system capacity overload verification, and so on, and the embodiments of the present invention do not limit this; exemplarily, the system capacity overload performance indication result can include the above-mentioned unexpected problems and / or expected problems.

[0065] Based on this, in the process of capacity overload verification in the embodiments of the present invention, when dealing with emergencies, loss prevention takes precedence to ensure the stability of the system service quality; that is to say, in the system capacity overload verification of the embodiments of the present invention, sudden abnormal situations can be fully handled to ensure the normal acceptance of user online traffic. Correspondingly, the indication results of the system capacity overload performance can be analyzed to optimize and solve the problems and performances that occur. It can be seen that the embodiments of the present invention can verify the true and effective performance of capacity overload according to the actual capacity overload verification target requirements, eliminate the risk of the test simulation traffic affecting the online traffic, and at the same time solve the problem of low simulation degree of the test traffic, handle emergencies efficiently and stably, and the overall risk is controllable.

[0066] Correspondingly, the above-mentioned target traffic ratio may include the traffic ratios of each service cluster in multiple service clusters, and the traffic ratio of one service cluster is used to indicate the traffic ratio of each service sub-cluster in the corresponding service cluster; wherein, one service cluster includes a service sub-cluster located in the first computer room and a service sub-cluster located in the second computer room. Based on this, through the polling algorithm, the traffic can be diverted to the corresponding service sub-clusters according to the target traffic ratio (that is, the traffic ratios of each service cluster) to achieve the consumption of online traffic in the first computer room and the second computer room according to the target traffic ratio. Exemplarily, assuming that the traffic ratio between service sub-cluster 1-A (i.e., service sub-cluster 1 in the first computer room) and service sub-cluster 1-B (i.e., service sub-cluster 1 in the second computer room) is 6:4, then through the polling algorithm, the traffic can be diverted to service sub-cluster 1 in the first computer room with a probability of 60% and to service sub-cluster 1 in the second computer room with a probability of 40%.

[0067] Optionally, the target object (such as the system administrator, etc.) can configure the traffic ratios of each service cluster through the online traffic access and forwarding platform, such as configuring traffic ratios of 5:5, 10:0, etc.; where 5:5 represents that the online service traffic is undertaken by both computer rooms, and at this time the probability of diverting to any computer room is 50%; 10:0 represents that the online service traffic is undertaken by a single computer room, and at this time the online traffic will be all diverted to the same computer room, and so on. In the embodiments of the present invention, the traffic ratios of each service cluster can be set according to experience or according to actual needs, and the embodiments of the present invention do not make any limitations in this regard.

[0068] Embodiments of the present invention can receive multiple traffic flows and determine the traffic type of each traffic flow among the multiple traffic flows. The traffic type of a traffic flow is used to indicate whether the corresponding traffic flow is an online asynchronous traffic flow or an online synchronous traffic flow. Then, based on the traffic type of each traffic flow, the online asynchronous traffic flows among the multiple traffic flows can be blocked in an asynchronous queue, and the online synchronous traffic flows among the multiple traffic flows can be distributed to the first computer room included in the online service system, so that the first computer room bears the online synchronous traffic flows. Based on this, a consumption rate sequence from low to high can be determined according to the target traffic consumption rate increase strategy; and in turn, according to each consumption rate in the consumption rate sequence, the online asynchronous traffic flows in the asynchronous queue can be distributed to the second computer room included in the online service system until the capacity overload verification suspension condition is reached, so that the second computer room bears the online asynchronous traffic flows. Correspondingly, during the isolated consumption process of the online traffic at the computer room dimension, the system capacity overload verification of the online service system can be performed in the order of consumption rate from low to high, and an indication result of the system capacity overload performance of the online service system can be obtained. It can be seen that the embodiments of the present invention can effectively verify the performance of system capacity overload by taking a progressive consumption queue traffic method based on the characteristics of dual-computer room deployment of online services, combining with the actual scenario, and using the asynchronous queue design in the system, realizing a true and effective verification of the overall system capacity overload, discovering and solving the unexpected performance after service capacity overload in advance; eliminating the risk that the test simulated traffic affects the online traffic, solving the problem of low simulation degree of the test traffic, and at the same time ensuring that the online service product functions of the system can be continuously provided to users without interruption; that is to say, the embodiments of the present invention can utilize the asynchronous queue design in the system based on the characteristics of dual-computer room deployment of online services, block the online asynchronous traffic to accumulate the traffic to the target traffic threshold, and then take a progressive consumption queue traffic method to effectively verify the performance of system capacity overload, and can perform system capacity overload verification without causing losses to the online traffic, so as to effectively improve the stability of the system.

[0069] Based on the description of the related embodiments of the above system capacity overload verification method, embodiments of the present invention also propose a system capacity overload verification device. The system capacity overload verification device can be a computer program (including program code) running in an electronic device; as Figure 4 shown, the system capacity overload verification device can include a receiving unit 401 and a processing unit 402. The system capacity overload verification device can execute Figure 1 or Figure 3 the system capacity overload verification method shown, that is, the system capacity overload verification device can run the above units:

[0070] The receiving unit 401 is configured to receive multiple traffic flows;

[0071] A processing unit 402 is configured to determine the traffic type of each traffic among the multiple traffics, where the traffic type of a traffic is used to indicate whether the corresponding traffic is an online asynchronous traffic or an online synchronous traffic;

[0072] The processing unit 402 is further configured to block the online asynchronous traffic among the multiple traffics in an asynchronous queue based on the traffic types of the respective traffics, and distribute the online synchronous traffic among the multiple traffics to a first computer room included in the online service system, so that the first computer room bears the online synchronous traffic;

[0073] The processing unit 402 is further configured to distribute the online asynchronous traffic in the asynchronous queue to a second computer room included in the online service system according to a target traffic consumption rate increasing policy, so that the second computer room bears the online asynchronous traffic;

[0074] The processing unit 402 is further configured to perform system capacity overload verification on the online service system during the isolated consumption process of the online traffic in terms of computer room dimension, and obtain an indication result of the system capacity overload performance of the online service system.

[0075] In one implementation manner, the target traffic consumption rate increasing policy is used to indicate the change process of the traffic consumption rate from low to high. When the processing unit 402 distributes the online asynchronous traffic in the asynchronous queue to a second computer room included in the online service system according to the target traffic consumption rate increasing policy, it may specifically be configured to:

[0076] Determine a consumption rate sequence from low to high according to the target traffic consumption rate increasing policy;

[0077] Sequentially distribute the online asynchronous traffic in the asynchronous queue to a second computer room included in the online service system according to each consumption rate in the consumption rate sequence until a capacity overload verification pause condition is reached;

[0078] When the processing unit 402 performs system capacity overload verification on the online service system, it may specifically be configured to:

[0079] Perform system capacity overload verification on the online service system in the order of consumption rate from low to high.

[0080] In another implementation manner, the online asynchronous traffic in the asynchronous queue is consumed after the traffic quantity accumulates to a target traffic threshold. The processing unit 402 may further be configured to:

[0081] When all the online asynchronous traffic in the asynchronous queue is consumed, if no system capacity overload is detected, adjust the target traffic threshold to obtain an adjusted target traffic threshold, where the adjusted target traffic threshold is greater than the target traffic threshold;

[0082] Continue to block the received online asynchronous traffic in the asynchronous queue until the amount of traffic in the asynchronous queue accumulates to the adjusted target traffic threshold, so as to trigger the execution of the strategy of increasing according to the target traffic consumption rate, and distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system, thereby verifying the system capacity overload of the online service system.

[0083] In another embodiment, the processing unit 402 can also be used for:

[0084] When detecting that a traffic processing abnormal problem occurs in the first computer room, suspend the system capacity overload verification;

[0085] Switch the online synchronous traffic to the second computer room for acceptance.

[0086] In another embodiment, the processing unit 402 can also be used for:

[0087] When detecting an unexpected problem caused by system capacity overload, suspend the system capacity overload verification;

[0088] Determine the safe consumption rate, and consume the remaining traffic in the asynchronous queue according to the safe consumption rate;

[0089] After the traffic in the asynchronous queue is consumed, resume the consumption of online traffic in the first computer room and the second computer room according to the target traffic ratio.

[0090] In another embodiment, the target traffic ratio includes the traffic ratios of each service cluster in multiple service clusters, and the traffic ratio of a service cluster is used to indicate the traffic ratio of each service sub-cluster in the corresponding service cluster; wherein, a service cluster includes a service sub-cluster located in the first computer room and a service sub-cluster located in the second computer room.

[0091] According to an embodiment of the present invention, Figure 4 Each unit in the system capacity overload verification device shown can be respectively or all combined into one or several other units to form, or a certain (some) unit can be further split into multiple smaller units in terms of function to form, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present invention. The above units are divided based on logical functions. In practical applications, the function of one unit can also be realized by multiple units, or the functions of multiple units are realized by one unit. In other embodiments of the present invention, any system capacity overload verification device can also include other units. In practical applications, these functions can also be assisted by other units and can be realized by the cooperation of multiple units.

[0092] According to another embodiment of the present invention, it can be achieved by running a computer program (including program code) capable of executing the respective steps involved in the corresponding method shown in, for example, a general-purpose electronic device such as a computer including processing elements and storage elements such as a central processing unit (CPU), a random access storage medium (RAM), a read-only storage medium (ROM), etc., to construct a system capacity overload verification device as shown in, and to implement the model training method of the embodiment of the present invention. The computer program can be recorded on, for example, a computer storage medium, loaded into the above-mentioned electronic device through the computer storage medium, and run therein. Figure 1 or Figure 3 shown in, to implement the system capacity overload verification device as shown in, and to implement the model training method of the embodiment of the present invention. The computer program can be recorded on, for example, a computer storage medium, loaded into the above-mentioned electronic device through the computer storage medium, and run therein. Figure 4 shown in, to implement the system capacity overload verification device as shown in, and to implement the model training method of the embodiment of the present invention. The computer program can be recorded on, for example, a computer storage medium, loaded into the above-mentioned electronic device through the computer storage medium, and run therein.

[0093] In the embodiment of the present invention, after receiving multiple traffic flows, the traffic flow type of each traffic flow among the multiple traffic flows can be determined. The traffic flow type of a traffic flow is used to indicate that the corresponding traffic flow is an online asynchronous traffic flow or an online synchronous traffic flow. Based on this, the online asynchronous traffic flows among the multiple traffic flows can be blocked in the asynchronous queue based on the traffic flow type of each traffic flow, and the online synchronous traffic flows among the multiple traffic flows can be distributed to the first computer room included in the online service system, so that the first computer room bears the online synchronous traffic flows; further, according to the target traffic consumption rate increase strategy, the online asynchronous traffic flows in the asynchronous queue can be distributed to the second computer room included in the online service system, so that the second computer room bears the online asynchronous traffic flows. Then correspondingly, during the isolated consumption process of the online traffic flows in terms of computer room dimension, the system capacity overload verification of the online service system can be performed to obtain an indication result of the system capacity overload performance of the online service system. It can be seen that the embodiment of the present invention can enable the first computer room to bear the online synchronous traffic flows, and enable the second computer room to consume the online asynchronous traffic flows in the asynchronous queue according to the target traffic consumption rate increase strategy, thereby realizing the system capacity overload verification. That is to say, the embodiment of the present invention can utilize the online service dual-computer room deployment feature and the asynchronous queue design in the system to block the online asynchronous traffic flows, and effectively verify the system capacity overload performance by adopting the progressive consumption of the queue traffic flows; based on this, the embodiment of the present invention can realize the system capacity overload verification through the online traffic flows (including online synchronous traffic flows and online asynchronous traffic flows), without introducing simulated traffic flows, and thus can perform the system capacity overload verification without causing losses to the online traffic flows, so as to effectively improve the stability of the system.

[0094] Based on the descriptions of the above method embodiments and device embodiments, an exemplary embodiment of the present invention further provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor. The memory stores a computer program that can be executed by the at least one processor, and when the computer program is executed by the at least one processor, it is used to cause the electronic device to execute the method according to the embodiment of the present invention.

[0095] An exemplary embodiment of the present invention also provides a non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor of a computer, is configured to cause the computer to execute the method according to the embodiment of the present invention.

[0096] An exemplary embodiment of the present invention also provides a computer program product including a computer program, wherein the computer program, when executed by a processor of a computer, is configured to cause the computer to execute the method according to the embodiment of the present invention.

[0097] An exemplary embodiment of the present invention also provides an online service system, which includes a system capacity overload verification device, a first computer room, a second computer room, and a plurality of service clusters. A service cluster includes a service sub-cluster located in the first computer room and a service sub-cluster located in the second computer room; wherein, the system capacity overload verification device is configured to cause the online service system to execute the method according to the embodiment of the present invention.

[0098] Reference Figure 5 , a block diagram of an electronic device 500 that can be used as a server or a client of the present invention will now be described. It is an example of a hardware device that can be applied to various aspects of the present invention. The electronic device is intended to represent various forms of digital electronic computer devices, such as, a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as, a personal digital processor, a cellular phone, a smart phone, a wearable device, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0099] As Figure 5 shown, the electronic device 500 includes a computing unit 501, which can execute various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 502 or a computer program loaded from a storage unit 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 can also be stored. The computing unit 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0100] Multiple components in the electronic device 500 are connected to the I / O interface 505, including: an input unit 506, an output unit 507, a storage unit 508, and a communication unit 509. The input unit 506 can be any type of device capable of inputting information into the electronic device 500. The input unit 506 can receive input digital or character information, and generate key signal inputs related to the user settings and / or function controls of the electronic device. The output unit 507 can be any type of device capable of presenting information, and can include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. The storage unit 508 can include, but is not limited to, magnetic disks and optical discs. The communication unit 509 allows the electronic device 500 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks, and can include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0101] The computing unit 501 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 501 executes the various methods and processes described above. For example, in some embodiments, the system capacity overload verification method can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 508. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 500 via the ROM 502 and / or the communication unit 509. In some embodiments, the computing unit 501 can be configured to execute the system capacity overload verification method in any other suitable manner (e.g., by means of firmware).

[0102] The program code for implementing the method of the present invention can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the program codes are executed by the processor or controller, the functions / operations specified in the flowchart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, executed partially on the machine as an independent software package and partially on a remote machine, or executed entirely on a remote machine or server.

[0103] In the context of the present invention, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0104] As used in the present invention, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., a disk, an optical disk, a memory, a programmable logic device (PLD)) used to provide machine instructions and / or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and / or data to a programmable processor.

[0105] To provide for interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can also be used to provide for interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, speech input, or tactile input).

[0106] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected to each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), and the Internet.

[0107] A computer system can include a client and a server. The client and the server are generally remote from each other and typically interact through a communication network. The client-server relationship is created by computer programs that run on the respective computers and have a client-server relationship with each other.

[0108] Moreover, it should be understood that the above-disclosed are only the preferred embodiments of the present invention, and of course cannot be used to limit the scope of rights of the present invention. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope covered by the present invention.

Claims

1. A system capacity overload verification method, characterized in that: include: Receiving a plurality of flows, and determining a flow type of each flow in the plurality of flows, the flow type of a flow being used to indicate that the corresponding flow is an online asynchronous flow or an online synchronous flow; Based on the traffic type of each traffic, the online asynchronous traffic among the multiple traffics is blocked in an asynchronous queue, and the online synchronous traffic among the multiple traffics is distributed to a first computer room included in the online service system, so that the first computer room carries the online synchronous traffic; According to the target traffic consumption rate increase strategy, the online asynchronous traffic in the asynchronous queue is distributed to the second computer room included in the online service system, so that the second computer room carries the online asynchronous traffic; During the isolated consumption of online traffic in the computer room dimension, a system capacity overload verification is performed on the online service system to obtain a system capacity overload performance indication result of the online service system.

2. The method according to claim 1, characterized in that The target traffic consumption rate increase strategy is used to indicate a change process of the traffic consumption rate from low to high. The online asynchronous traffic in the asynchronous queue is distributed to the second computer room included in the online service system according to the target traffic consumption rate increase strategy, including: According to the target traffic consumption rate increase strategy, determine the consumption rate sequence from low to high; Distributing the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system according to each consumption rate in the consumption rate sequence in sequence until a capacity overload verification suspension condition is reached; The performing system capacity overload verification on the online service system includes: The system capacity overload verification is performed on the online service system in the order of consumption rate from low to high.

3. The method according to claim 2, characterized in that The online asynchronous traffic in the asynchronous queue is consumed after the traffic amount accumulates to a target traffic threshold, and the method further includes: When all the online asynchronous traffic in the asynchronous queue is consumed, if no system capacity overload is detected, the target traffic threshold is adjusted to obtain an adjusted target traffic threshold, and the adjusted target traffic threshold is greater than the target traffic threshold; Continue to block the received online asynchronous traffic in the asynchronous queue until the amount of traffic in the asynchronous queue accumulates to the adjusted target traffic threshold, so as to trigger the execution of the strategy of increasing the target traffic consumption rate, and distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system, thereby performing system capacity overload verification on the online service system.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: When abnormal traffic processing is detected in the first computer room, suspending the system capacity overload verification; Switch the online synchronization traffic to the second computer room for handling.

5. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: When unexpected problems caused by system capacity overload are detected, system capacity overload verification is suspended; Determine a safe consumption rate, and consume the remaining traffic in the asynchronous queue at the safe consumption rate; After the traffic consumption in the asynchronous queue is completed, the first computer room and the second computer room are restored to consume online traffic according to the target traffic ratio.

6. The method according to claim 5, characterized in that The target traffic ratio includes the traffic ratio of each service cluster in multiple service clusters, and the traffic ratio of a service cluster is used to indicate the traffic ratio of each service sub-cluster in the corresponding service cluster; wherein, a service cluster includes a service sub-cluster located in the first computer room and a service sub-cluster located in the second computer room.

7. A system capacity overload verification device, characterized in that: The device comprises: A receiving unit, used for receiving a plurality of flows; A processing unit, configured to determine a traffic type of each of the plurality of traffics, wherein the traffic type of a traffic is used to indicate that the corresponding traffic is an online asynchronous traffic or an online synchronous traffic; The processing unit is further configured to block the online asynchronous traffic among the multiple traffics in an asynchronous queue based on the traffic type of each traffic, and distribute the online synchronous traffic among the multiple traffics to the first computer room included in the online service system, so that the first computer room carries the online synchronous traffic; The processing unit is further configured to distribute the online asynchronous traffic in the asynchronous queue to the second computer room included in the online service system according to the target traffic consumption rate increase strategy, so that the second computer room carries the online asynchronous traffic; The processing unit is further used to perform system capacity overload verification on the online service system during the isolated consumption of online traffic in the computer room dimension, and obtain a system capacity overload performance indication result of the online service system.

8. An online service system, characterized in that: The online service system includes a system capacity overload verification device, a first computer room, a second computer room and multiple service clusters, a service cluster includes a service sub-cluster located in the first computer room and a service sub-cluster located in the second computer room; wherein the system capacity overload verification device is used to enable the online service system to execute the method according to any one of claims 1-6.

9. An electronic device, characterized in that: include: processor; as well as Memory for storing programs, The program includes instructions, which, when executed by the processor, cause the processor to perform the method according to any one of claims 1 to 6.

10. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to make a computer execute the method according to any one of claims 1-6.

Images