Pressure Testing Method and Device

Abstract

The present application provides a pressure testing method and apparatus. The pressure testing method includes: receiving a pressure testing task, where the pressure testing task includes an expected queries per second rate and a thread adjustment rate; determining a set of container groups corresponding to the pressure testing task in a container group cluster based on the thread adjustment rate; increasing the number of threads of the set of container groups based on the thread adjustment rate within a current test cycle, and obtaining the current queries per second rate of the set of container groups; determining a thread adjustment strategy for the set of container groups in a next test cycle according to the current queries per second rate and the expected queries per second rate; and adjusting the number of threads of the set of container groups in the next test cycle based on the thread adjustment strategy and the thread adjustment rate until the pressure testing task ends. By dynamically adjusting the number of threads of the container group according to the expected queries per second rate and the actual queries per second rate, the pressure testing effect is made more in line with expectations.

Description

Technical Field

[0001] This application relates to the field of computer technology, and particularly to a stress testing method. This application also relates to a stress testing device, a computing device, and a computer-readable storage medium. Background Art

[0002] Stress testing is an important means for software quality assurance. Currently, the mainstream stress testing implementation plans are mainly based on open-source tools such as jmeter and loadrunner. Under high-concurrency requirements, a single machine node is limited by resources such as CPU and network card bandwidth, and the stress generation ability may not meet the requirements. Therefore, a distributed stress testing plan based on a multi-machine cluster has emerged. With the gradual maturity of containerization technology and container orchestration capabilities, a distributed stress testing plan based on k8s containerized scheduling has been proposed. Usually, according to the concurrency number requirements of the stress test, new pods are scheduled to start, and each pod will execute Jmeter (or other tools) instructions to generate stress according to the specified number of concurrent threads.

[0003] However, how to obtain more accurate stress testing results has become a technical problem that needs to be solved urgently by technical personnel. Summary of the Invention

[0004] In view of this, an embodiment of this application provides a stress testing method. This application also relates to a stress testing device, a computing device, and a computer-readable storage medium, so as to solve the technical problem in the prior art that the stress test needs to specify the number of concurrent threads and cannot be dynamically adjusted.

[0005] According to the first aspect of the embodiment of this application, a stress testing method is provided, including:

[0006] Receiving a stress testing task, where the stress testing task includes an expected queries per second rate and a thread adjustment rate;

[0007] Determining a set of container groups corresponding to the stress testing task in a container group cluster based on the thread adjustment rate;

[0008] Increasing the number of threads of the set of container groups based on the thread adjustment rate within the current test cycle, and obtaining the current queries per second rate of the set of container groups;

[0009] Determining a thread adjustment strategy for the set of container groups in the next test cycle according to the current queries per second rate and the expected queries per second rate;

[0010] Adjusting the number of threads of the set of container groups in the next test cycle based on the thread adjustment strategy and the thread adjustment rate until the stress testing task ends.

[0011] According to a second aspect of the embodiments of the present application, a pressure testing device is provided, including:

[0012] A receiving module, configured to receive a pressure testing task, where the pressure testing task includes an expected queries per second rate and a thread adjustment rate;

[0013] A first determination module, configured to determine a set of container groups corresponding to the pressure testing task in a container group cluster based on the thread adjustment rate;

[0014] An acquisition module, configured to increase the number of threads of the set of container groups based on the thread adjustment rate within a current test cycle, and acquire the current queries per second rate of the set of container groups;

[0015] A second determination module, configured to determine a thread adjustment strategy for the set of container groups in a next test cycle according to the current queries per second rate and the expected queries per second rate;

[0016] An adjustment module, configured to adjust the number of threads of the set of container groups in the next test cycle based on the thread adjustment strategy and the thread adjustment rate until the pressure testing task ends.

[0017] According to a third aspect of the embodiments of the present application, a computing device is provided, including a memory, a processor, and computer instructions stored on the memory and executable on the processor. When the processor executes the computer instructions, the steps of the pressure testing method are implemented.

[0018] According to a fourth aspect of the embodiments of the present application, a computer-readable storage medium is provided, which stores computer instructions. When the computer instructions are executed by a processor, the steps of the pressure testing method are implemented.

[0019] The pressure testing method provided by the present application includes: receiving a pressure testing task, where the pressure testing task includes an expected queries per second rate and a thread adjustment rate; determining a set of container groups corresponding to the pressure testing task in a container group cluster based on the thread adjustment rate; increasing the number of threads of the set of container groups based on the thread adjustment rate within a current test cycle, and acquiring the current queries per second rate of the set of container groups; determining a thread adjustment strategy for the set of container groups in a next test cycle according to the current queries per second rate and the expected queries per second rate; adjusting the number of threads of the set of container groups in the next test cycle based on the thread adjustment strategy and the thread adjustment rate until the pressure testing task ends.

[0020] In one embodiment of the present application, by determining a thread adjustment strategy for a set of container groups according to the current queries per second and the expected queries per second, dynamic adjustment of the number of threads and full utilization of the container groups are achieved. Further, it is convenient for users to make real-time adjustments to the stress test tasks, and more accurate stress test results can be obtained. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 is a flowchart of a stress test method provided by one embodiment of the present application;

[0022] Figure 2 is a processing flowchart of a stress test method applied to a game software provided by one embodiment of the present application;

[0023] Figure 3 is a schematic diagram of a stress test method provided by one embodiment of the present application;

[0024] Figure 4 is a schematic structural diagram of a stress test device provided by one embodiment of the present application;

[0025] Figure 5 is a structural block diagram of a computing device provided by one embodiment of the present application. DETAILED DESCRIPTION

[0026] In the following description, many specific details are set forth in order to provide a thorough understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar generalizations without departing from the spirit of the present application. Therefore, the present application is not limited by the specific implementations disclosed below.

[0027] The terms used in one or more embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit one or more embodiments of the present application. The singular forms "a", "the", and "said" used in one or more embodiments of the present application and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to any and all possible combinations of one or more of the associated listed items.

[0028] It should be understood that although the terms first, second, etc. may be used in one or more embodiments of the present application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".

[0029] First, explain the noun terms involved in one or more embodiments of the present application.

[0030] Kubernetes: An orchestration and management system for containers, abbreviated as k8s.

[0031] Pod: The smallest unit managed in k8s, which is a combination of one or more containers, that is, a container group.

[0032] QPS: Queries Per Second, which is a measure of how much traffic a specific query server processes within a specified time.

[0033] In current stress testing technologies, since it is unknown how many concurrent threads a single pod can support, this is related to the resources (CPU / memory, etc.) allocated to the pod itself and also related to the complexity of the script for performing stress testing. Therefore, fixing the number of concurrent threads during startup is likely to cause resource surplus or overload in the pod. Resource surplus will result in resources being occupied but the pressure not being applied effectively, and resource overload will lead to inaccurate stress testing data. Moreover, open-source tools such as Jmeter require specifying the number of concurrent threads during startup and do not support dynamic adjustment after startup. Controlling the stress generation magnitude based on the number of concurrent threads is not intuitive, and stress testing pays more attention to the QPS metric of the stress testing object.

[0034] The present application proposes an adaptive stress generation scheduling method based on expected QPS and pod load monitoring, which can solve the problem of unreasonable utilization of stress testing resources and also support the stress generation mode based on expected QPS. Specifically, the following effects can be achieved:

[0035] 1) Generate stress according to the preset QPS value and support dynamic adjustment after stress generation starts;

[0036] 2) Abandon open-source tools and develop a self-developed stress generation module that supports dynamic adjustment (increase or decrease) of the number of threads;

[0037] 3) Monitor the CPU utilization rate of each pod, and when it reaches a certain threshold, automatically schedule to a new pod to add threads and increase pressure.

[0038] In the present application, a stress testing method is provided. The present application also relates to a stress testing device, a computing device, and a computer-readable storage medium, which will be described in detail one by one in the following embodiments.

[0039] Figure 1 The flowchart of a stress testing method provided according to an embodiment of the present application is shown, which specifically includes the following steps:

[0040] Step 102: Receive a stress test task, where the stress test task includes an expected queries per second rate and a thread adjustment rate.

[0041] In practical applications, to test software quality, stress testing methods are usually adopted. Specifically, a stress test task for stress testing the software is sent to the server. The stress test task includes an expected queries per second rate and a thread adjustment rate. Among them, the expected queries per second rate refers to the rate of requests sent per second that the stress test task is expected to reach, and the queries per second rate is QPS.

[0042] The thread adjustment rate refers to the rate of increasing the number of threads in the stress test task. The expected queries per second rate and the thread adjustment rate can be set based on the actual stress test task requirements. Specifically, the values of the expected queries per second rate and the thread adjustment rate can be obtained by calculating based on stress test task data, or directly input by the user based on actual stress test requirements.

[0043] In a specific embodiment of the present application, taking the stress testing of Software A as an example, the server receives a stress test task for Software A, where the stress test task includes the expected queries per second rate and the thread adjustment rate input by the user based on the stress test requirements for Software A.

[0044] By stress testing the software, it is determined whether the software will report errors under high concurrency, and by estimating the software's bearing capacity, it can provide a basis for operation and maintenance personnel to expand capacity.

[0045] Step 104: Determine the set of container groups corresponding to the stress test task in the container group cluster based on the thread adjustment rate.

[0046] Among them, the container group cluster refers to a cluster composed of container groups. Each container group in the container group cluster is correspondingly provided with a pressure generating module. During the execution of the stress test task, idle container groups can be determined in the container group cluster for stress testing; the set of container groups refers to a set composed of container groups. In the container group cluster, the container groups used for the stress test task are determined to form a set of container groups for subsequent overall evaluation of the container groups used for the stress test task.

[0047] In practical applications, the specific method for determining the set of container groups corresponding to the stress test task in the container group cluster based on the thread adjustment rate includes:

[0048] Determine the thread threshold of the container groups in the container group cluster;

[0049] Obtain the set of container groups corresponding to the stress test task in the container group cluster based on the thread threshold of the container groups and the thread adjustment rate.

[0050] Among them, the thread threshold of the container group refers to the maximum number of threads that the container group can increase each time, and the thread threshold of the container group can be set based on the actual situation of the container group.

[0051] Specifically, a client for the user to input the expected query rate per second and the thread adjustment rate can be provided. For example, a web page for the user to input the expected query rate and the thread adjustment rate of the current stress test task is provided. The user inputs the expected query rate per second and the thread adjustment rate of the client into the web page, and the web page submits it to the corresponding server. The container group scheduling controller in the server receives the expected query rate per second and the thread adjustment rate, obtains the thread threshold of the container group in the container group cluster, and schedules the container group set in the container group cluster based on the thread threshold of the container group and the thread adjustment rate.

[0052] In a specific embodiment of the present application, taking the thread threshold of the container group as 30 as an example, it is determined that the thread threshold of the container group is 30. Based on the thread threshold of the container group and the thread adjustment rate of 90 threads / time, the container group set corresponding to the stress test task is obtained in the container group cluster.

[0053] After determining the thread threshold of the container group, the method for obtaining the container group set corresponding to the stress test task in the container group cluster based on the thread threshold of the container group and the thread adjustment rate includes:

[0054] Calculate the number of container groups according to the thread adjustment rate and the thread threshold of the container group;

[0055] Determine the container groups corresponding to the number of container groups in the container group cluster to form a container group set.

[0056] Among them, the number of container groups refers to the minimum number of container groups required to reach the thread adjustment rate.

[0057] Specifically, after the scheduling controller receives the thread adjustment policy and obtains the thread threshold of the container group, after determining the number of threads that each container group can increase each time based on the thread threshold of the container group, determine at least how many container groups need to be scheduled concurrently to reach the thread adjustment rate based on the thread adjustment rate.

[0058] In a specific embodiment of the present application, taking the thread threshold of the container group as 50 as an example, the thread adjustment rate is 200 threads / time, the thread threshold of the container group is 50, and a container group can increase at most 50 threads per pressure application. Then, parallelly scheduling 4 container groups with a thread threshold of 50 can reach the thread adjustment rate of 200 threads per pressure application, that is, the determined number of container groups is 4. Determine 4 idle container groups in the container group cluster to form a container group set.

[0059] By determining the minimum number of container groups used to reach the preset thread rate, a stress test can be first performed based on the number of pressurizations that each preset container group can perform each time, so as to make full use of the pressure - sending performance of the container groups, thereby improving the accuracy of the stress test.

[0060] Step 106: Increase the number of threads in the container group set based on the thread adjustment rate within the current test cycle, and obtain the current queries - per - second rate of the container group set.

[0061] Among them, the test cycle refers to the time period for adjusting the number of threads in the container group set. The current test situation of the container groups used for the stress test task is determined every one or more preset time periods, which is convenient for subsequent adjustment of the number of threads in the container group set based on the current test situation of the container groups. For example, the current container group test situation is obtained every 5 - second time period; the number of threads in the container group set refers to the sum of the number of threads increased each time for each container group in the container group set.

[0062] Specifically, the method for increasing the number of threads in the container group set based on the thread adjustment rate within the current test cycle includes:

[0063] Increase the number of threads for each container group in the container group set based on the thread threshold of the container group.

[0064] Specifically, each container group in the container group set is determined. Since the thread adjustment rate can only be reached when each container group is called concurrently, the number of threads for each container group in the container group set is increased according to the thread threshold of the container group.

[0065] In a specific embodiment of the present application, taking the thread threshold of the container group as 30 as an example, three container groups in the container group set are called in parallel, that is, the number of threads for each container group is increased based on the thread threshold of the container group of 30. Then, each time the pressure is increased, each of the three container groups increases 30 threads, and the thread adjustment rate reaches 90 threads per time when the pressure is increased each time.

[0066] In practical applications, since the load rate of each container group is unknown, it is related to the resource allocation of the container group itself and also related to the complexity of the stress test task being executed, so it is impossible to accurately determine the actual loadable situation of each container group, that is, there is a situation where the container cannot increase the number of threads according to the thread threshold of the container group.

[0067] At this time, in order to enable the stress test task to reach the thread adjustment rate, the number of container groups used for the stress test task in the container group set can be adjusted so that the stress test task can reach the thread adjustment rate. Since the actual load increase of each container group is different, the situation of increasing the number of threads in the container group set based on the thread adjustment rate can be that the number of threads increased for each container group is different, but the sum of the number of threads increased for each container group each time can meet the requirements of the thread adjustment rate.

[0068] Since the number of threads increased for each container group may be different in actual situations each time, the current queries per second rate of each container group in the obtained container group set may be different. The specific method for obtaining the current queries per second rate of the container group set includes:

[0069] Obtain the current queries per second rate of each container group in the container group set in the stress test statistics database;

[0070] Accumulate the current queries per second rate of each container group to obtain the current queries per second rate of the container group set.

[0071] Among them, the stress test statistics database refers to the database used to record the data generated during the stress test. For example, the stress test statistics database can record data such as the real-time queries per second rate, the number of query request errors, and the average response time of each container group. The queries per second rate in the stress test statistics database can be calculated using the following formula 1:

[0072]

[0073] Among them, the number of concurrent requests refers to the total number of concurrent requests, and the response time is the response time of the concurrent requests. For example, if 30 concurrent threads are added to a container group within 5 seconds, and each thread contains 20 requests, then the total number of concurrent requests is 600, the response time is 5 seconds, and the QPS value is 120 requests / second. The number of requests contained in the threads can be different, and finally, the total number of requests corresponding to all threads is determined as the number of concurrent requests.

[0074] The data in the stress test statistics database can not only be used for the stress test task, but also be displayed to the user in a visual way, so that the user can observe the real-time data of the stress test, so that the user can make real-time adjustments to the stress test.

[0075] In a specific embodiment of the present application, taking the container group set A as an example, the container group set A {container group 1, container group 2, container group 3} is determined. The real-time queries per second rate of each container group in the container group set A at the current moment is obtained in the pressure measurement statistics database, including: the real-time queries per second rate of container group 1 is 18 threads / second, the real-time queries per second rate of container group 2 is 20 threads / second, and the real-time queries per second rate of container group 3 is 20 threads / second. The queries per second rates of container group 1, container group 2, and container group 3 are accumulated to obtain the queries per second rate of the container group set A as 58 threads / second.

[0076] The queries per second rate of the container group set is obtained by obtaining the real-time queries per second rate of each container group in the pressure measurement statistics database, and it is judged whether the number of threads of the container group needs to be adjusted based on the queries per second rate of the container group set subsequently.

[0077] Step 108: Determine the thread adjustment strategy of the container group set in the next test cycle according to the current queries per second rate and the expected queries per second rate.

[0078] Specifically, the current queries per second rate of the container group set is determined in the above step 106. After determining the current queries per second rate, the current queries per second rate can be compared with the expected queries per second rate to determine whether the queries per second rate of the container group set reaches the expectation, so as to determine the adjustment strategy for the container group set based on the comparison result, and make the current queries per second rate of the container group set closer to or equal to the expected queries per second rate through the adjustment strategy.

[0079] In practical applications, the thread adjustment strategy for the container group in the next test cycle is determined by comparing the current queries per second rate with the expected queries per second rate; when the current queries per second rate is less than the expected queries per second rate, the number of threads of the container group needs to be increased to make the current queries per second rate of the container group set closer to the expected queries per second rate; when the current queries per second rate is greater than the expected queries per second rate, the number of threads of the container group needs to be reduced to make the current queries per second rate of the container group closer to the expected queries per second rate; when the current queries per second rate is within the preset range of the expected queries per second rate, it can be considered that the current queries per second rate has reached the expected queries per second rate.

[0080] The method for specifically determining the thread adjustment strategy of the container group set in the next test cycle according to the current queries per second rate and the expected queries per second rate includes:

[0081] Determine a preset queries per second rate range based on the expected queries per second rate, where the preset queries per second rate range includes the maximum queries per second rate and the minimum queries per second rate;

[0082] When the current queries per second rate is less than the minimum queries per second rate, determine that the thread adjustment policy for the set of container groups is the thread increase policy;

[0083] When the current queries per second rate is greater than the maximum queries per second rate, determine that the thread adjustment policy for the set of container groups is the thread decrease policy;

[0084] When the current queries per second rate is greater than or equal to the minimum queries per second rate and less than or equal to the maximum queries per second rate, determine that the thread adjustment policy for the set of container groups is the thread stability policy.

[0085] Among them, the preset queries per second rate range refers to the range of queries per second rate values set according to the expected queries per second rate. It can be considered that the queries per second rate within the preset queries per second rate range conforms to the expected queries per second rate; the maximum queries per second rate refers to the queries per second rate with the largest value within the preset queries per second rate range; the minimum queries per second rate refers to the queries per second rate with the smallest value within the preset queries per second rate range; the thread increase policy is the policy of increasing the number of threads of the container group; the thread decrease policy is the policy of reducing the number of threads of the container group; the thread stability policy is the policy of keeping the number of threads of the container group unchanged.

[0086] In a specific embodiment of the present application, taking the set of container groups C as an example, the expected queries per second rate is determined to be 100 threads / second and the acceptable error rate is determined to be 5%, that is, the preset queries per second rate range is from 95 threads / second to 105 threads / second. The queries per second rate of container group 8 in the set of container groups C {container group 8, container group 7, container group 9..} is determined to be 30 threads / second, the queries per second rate of container group 7 is determined to be 32 threads / second, and the queries per second rate of container group 9 is determined to be 35 threads / second. The current queries per second rate of the set of container groups C is obtained as 97 threads / second, then the thread adjustment policy for the set of container groups C is determined to be the thread stability policy.

[0087] Step 110: Based on the thread adjustment policy of each container group and the thread adjustment rate, adjust the number of threads of each container group in the next test cycle until the stress test task ends.

[0088] In step 108, the adjustment policy of the number of threads of each container group is determined, then based on the determined adjustment policy of the number of threads corresponding to each container group, the number of threads of each container group in the next test cycle is adjusted.

[0089] After determining the thread adjustment policy for the set of container groups, the method for adjusting the number of threads of the set of container groups in the next test cycle based on the thread adjustment policy and the thread adjustment rate includes:

[0090] Determine the target container group in the set of container groups and the thread threshold of the target container group;

[0091] When the thread adjustment policy is the thread increase policy, increase the number of threads of the target container group based on the thread threshold of the target container group;

[0092] When the thread adjustment policy is the thread decrease policy, decrease the number of threads of the target container group based on the thread threshold of the target container group;

[0093] When the thread adjustment policy is the thread stability policy, keep the number of threads of the target container group unchanged.

[0094] Among them, the target container group refers to one of the container groups in the set of container groups, and the adjustment of the number of threads of the set of container groups refers to the synchronous adjustment of the number of threads of each container group in the set of container groups.

[0095] In a specific embodiment of the present application, taking the thread adjustment policy as the thread decrease policy as an example, determine the thread decrease policy for the set of container groups D {container group 2, container group 7, container group 4}, and the current number of threads of container group 2 is 30, the number of threads of container group 7 is 30, and the number of threads of container group 4 is 20; according to the thread threshold 10 of the container group, simultaneously decrease the number of threads of each container group in the set of container groups D according to the container group threshold, and the obtained thread numbers after policy adjustment are: the number of threads of container group 2 is 20, the number of threads of container group 7 is 20, and the number of threads of container group 4 is 10.

[0096] In practical applications, when the thread adjustment policy is the thread increase policy, after increasing the number of threads of the target container group based on the thread threshold of the target container group, it further includes:

[0097] Monitor the load value of the target container group;

[0098] When the load value exceeds the maximum load value, change the container group status of the target container group to the stable state and add the target container group to the list of stable container groups, and determine a new container group to be added to the target container group in the container group cluster, and the new container group continues to execute the thread increase policy.

[0099] Among them, the load value refers to the resource occupancy value of the target container group; the maximum load value refers to the upper limit of the resource occupancy of the container group. When the maximum load value is exceeded, abnormal situations such as running errors or termination may occur in the container group; the container group status includes a stable state and an active state. Among them, the stable state refers to the state where the number of threads in the container group remains stable, and the active state refers to the state where the number of threads in the container group increases or decreases; the stable container group list refers to the list storing the container groups in the stable state; the new container group refers to the newly determined container group in the container group set.

[0100] In practical applications, the pressure testing module of each container group detects the resource occupancy rate of the container group where it is located, and the scheduling controller determines whether to schedule a new container group based on the resource occupancy rate of the container group recorded in the pressure testing statistical database.

[0101] Specifically, during the process of increasing the number of threads in the container group, it is possible that the resource occupancy rate of a certain container group in the container group set has reached the upper limit and the number of threads cannot be increased continuously. However, at this time, the current queries per second rate of the container group set has not reached the expected value. Therefore, a new container group can be determined again in the container group cluster and added to the container group set, and the new container group executes the process of increasing the number of threads.

[0102] In a specific embodiment of the present application, taking container group 2 as an example, the preset resource occupancy rate is 90%. It is determined that the resource occupancy rate of container group 2 in the container group set exceeds the expected 90%. At this time, the current queries per second rate of the container group set has not reached the expected queries per second rate. Then, the idle container group 8 in the container group cluster is determined as the new container group and added to the container group set, and container group 8 continues to execute the thread increasing strategy; the status of container group 2 is modified to the stable state and the adjustment of the number of threads is no longer performed on it.

[0103] In practical applications, when the thread adjustment strategy is the thread decreasing strategy, after reducing the number of threads of the target container group based on the thread threshold of the target container group, it further includes

[0104] Monitoring the number of threads of the target container group;

[0105] When the number of threads of the target container group is reduced to the minimum threshold, select the to-be-processed container group in the stable container group list and change the container group status of the to-be-processed container group to the active state, and the to-be-processed container group continues to execute the thread decreasing strategy.

[0106] Among them, the minimum threshold refers to the minimum number of threads of the target container group. For example, the minimum threshold can be 0; the to-be-processed container group refers to any stable state container group determined in the stable container list.

[0107] Specifically, after determining the thread reduction strategy for the container group set, based on the thread reduction strategy, first reduce the number of threads of the container groups in the active state in the container group set. When it is detected that the number of threads of the container groups in the active state has decreased to the minimum threshold, randomly determine a container group in the stable state container group list and change its state to the active state, and then continue to execute the thread reduction strategy.

[0108] In a specific embodiment of the present application, taking container group 3 as an example, determine the thread reduction strategy for the container group set, reduce the number of threads of each container group in the container group set according to the thread threshold of the container group. When it is detected that the number of threads of container group 3 has been reduced to 0, that is, reduced to the minimum threshold. At this time, select container group 9 in the stable state list and change the stable state of container group 9 to the active state, and let container group 9 continue to execute the thread reduction strategy.

[0109] Specifically, the method for adjusting the number of threads of the container group set in the next test cycle based on the thread adjustment strategy and the thread adjustment rate until the stress test task ends includes:

[0110] Receive the stress test task end instruction;

[0111] End the stress test task based on the stress test task end instruction.

[0112] Among them, the stress test task end instruction refers to the instruction to end the stress test task, which can be generated by the user's need to end the stress test, or a preset time period can be set, and the stress test task end instruction is automatically generated after the preset time period is reached.

[0113] In practical applications, based on a preset time period, every one or more preset time periods, judge the resource occupancy rate of each container group in the container group set. When the resource occupancy rate does not reach the upper limit, obtain the current queries per second of each container group in the container group set from the stress statistics database, and determine the current queries per second of the container group set based on the current queries per second of each container group; determine the thread number adjustment strategy for the container group set in the next test cycle based on the expected queries per second and the current queries per second of the container group set, and continuously adjust the number of threads of the container group set based on the determined thread number adjustment strategy until receiving the stress test task end instruction, ending the test cycle and the stress test task.

[0114] In a specific embodiment of the present application, taking the stress test of a social software as an example, during the stress test of the social software, receive the stress test task end instruction; end the stress test of the social software based on the stress test task end instruction.

[0115] The stress testing method of the present application determines a set of container groups according to the thread adjustment rate in the stress testing task, and determines a thread adjustment strategy for the set of container groups to adjust the number of threads in the set of container groups, so that the actual queries per second rate of the stress testing task is closer to the expected queries per second rate, thereby improving the accuracy of software stress testing.

[0116] The following combines the attached Figure 2 , taking the application of the stress testing method provided by the present application in game software as an example, to further illustrate the stress testing method. Among them, Figure 2 shows a processing flow chart of a stress testing method applied to game software provided by an embodiment of the present application, which specifically includes the following steps:

[0117] Step 202: Receive a stress testing task including the expected queries per second rate and the thread adjustment rate.

[0118] In a specific embodiment of the present application, taking game software as an example, as Figure 3 shown, Figure 3 is a schematic diagram of a stress testing method provided by an embodiment of the present application. The user inputs the expected queries per second rate and the thread adjustment rate to the stress testing platform client for testing the game software; after the platform receives the expected queries per second rate of 180 requests / second and the thread adjustment rate of 90 threads / time input by the user, it is transmitted to the scheduling controller.

[0119] Step 204: Determine the set of container groups corresponding to the stress testing task in the container group cluster based on the thread adjustment rate.

[0120] Specifically, determine the thread threshold of the container groups in the container group cluster, calculate the number of container groups according to the thread adjustment rate and the thread threshold of the container groups, and determine the container groups corresponding to the number of container groups in the container group cluster to form a set of container groups.

[0121] In a specific embodiment of the present application, continuing with the above example, the scheduling controller calculates the number of container groups scheduled in parallel from the container group cluster according to the thread threshold of 30 for the container groups in the container group cluster and the thread adjustment rate; calculates the number of container groups as 3 according to the thread threshold of 30 and the thread adjustment rate of 90 threads / time; determines the idle container groups 3, 5, and 9 in the container group cluster, and the container groups 3, 5, and 9 form a set of container groups.

[0122] Step 206: Increase the number of threads in the set of container groups based on the thread adjustment rate within the current test cycle.

[0123] In a specific embodiment of the present application, following the previous example, the pressure - sending module of each container group performs a pressure - sending operation for each container group in the container group set based on a thread adjustment rate; within the current test cycle of 5 seconds, the number of threads in the container group set is increased based on a thread adjustment rate of 90 threads per time. Specifically, within the current cycle, according to a thread threshold of 30, the number of threads of each container group in the container group set is increased. If the original number of threads of the container group is 0, then after the increase, the number of threads of container group 3, container group 5, and container group 9 is 30 each. So, within 5 seconds, a total of 90 threads are added to the container group set, that is, the container group set increases the number of threads based on a thread adjustment rate of 90 threads per time, and the number of threads in the container group set in the current test cycle is 90.

[0124] Step 208: Obtain the current queries per second of each container group in the container group set, and determine the current queries per second of the container group set based on the current queries per second of each container group.

[0125] Specifically, obtain the current queries per second of each container group in the container group set from the pressure - testing statistical database; accumulate the current queries per second of each container group to obtain the current queries per second of the container group set.

[0126] In a specific embodiment of the present application, following the previous example, the pressure - sending module of each container group monitors the resource occupancy rate of the container in real - time. When the resource occupancy rate of the container group is greater than the maximum threshold, that is, 90%, through the scheduling server, the scheduling server schedules a new container group for pressure testing; the pressure - testing statistical database records real - time data such as queries per second and the number of request errors during the pressure - testing process. The current queries per second of each container group in the container group set obtained from the pressure - testing statistical database are: container group 3: 60 requests per second, container group 5: 60 requests per second, and container group 9: 50 requests per second. Accumulating the current queries per second of each container group, the queries per second of the container group set is 170 requests per second.

[0127] Step 210: Determine the thread adjustment strategy of the container group set in the next test cycle according to the current queries per second and the expected queries per second.

[0128] Specifically, determine a preset queries - per - second range based on the expected queries per second, where the preset queries - per - second range includes the maximum queries per second and the minimum queries per second;

[0129] When the current queries per second is less than the minimum queries per second, determine the thread adjustment strategy of the container group set as a thread - increasing strategy;

[0130] When the current queries per second is greater than the maximum queries per second, determine that the thread adjustment policy for the set of container groups is the thread reduction policy;

[0131] When the current queries per second is greater than or equal to the minimum queries per second and less than or equal to the maximum queries per second, determine that the thread adjustment policy for the set of container groups is the thread stability policy.

[0132] In a specific embodiment of the present application, following the above example, based on an expected queries per second of 180 requests / second and an error of 5%, the preset queries per second range is calculated to be from 171 requests / second to 189 requests / second; the current queries per second of the set of container groups is determined to be 170 requests / second, which is less than the minimum queries per second, so it is determined to adopt a thread increase policy for the set of container groups.

[0133] Step 212: Adjust the number of threads of the set of container groups in the next test cycle based on the thread adjustment policy and the thread adjustment rate.

[0134] Specifically, determine the target container group in the set of container groups and the thread threshold of the target container group; when the thread adjustment policy is the thread increase policy, increase the number of threads of the target container group based on the thread threshold of the target container group; when the thread adjustment policy is the thread reduction policy, reduce the number of threads of the target container group based on the thread threshold of the target container group;

[0135] When the thread adjustment policy is the thread stability policy, keep the number of threads of the target container group unchanged.

[0136] During the periodic adjustment of the number of threads of the set of container groups, monitor the load value of the container group; when the load value exceeds the maximum load value, change the container group status of the container group to the stable state and add the container group to the stable container group list, and determine a new container group to be added to the set of container groups in the container group cluster, and the new container group continues to execute the thread increase policy; and monitor the number of threads of the target container group in real time; when the number of threads of the target container group is reduced to the minimum threshold, select the container group to be processed in the stable container group list and change the container group status of the container group to be processed to the active state, and the container group to be processed continues to execute the thread reduction policy.

[0137] In a specific embodiment of the present application, following the above example, a thread increase strategy is determined. Based on the thread threshold of 30 for the container group, the number of threads is increased for each container group, and the number of threads in the container group in the next test cycle is 60. After 5 seconds, based on the queries per second rate of the container group set at this moment, the thread adjustment strategy for the container group set is determined again, and the number of threads in the container group set is adjusted based on the thread adjustment strategy until the loop is stopped after receiving the pressure test task end instruction.

[0138] Step 214: Receive the pressure test task end instruction, and end the pressure test task based on the pressure test task end instruction.

[0139] In a specific embodiment of the present application, following the above example, a pressure test task end instruction is received based on the user's pressure test end request; the server receives the pressure test task end instruction and ends the pressure test task for the game software.

[0140] The pressure test method of the present application determines the container group set according to the thread adjustment rate in the pressure test task, and determines the thread adjustment strategy for the container group set to adjust the number of threads in the container group set, so that the actual queries per second rate of the pressure test task is closer to the expected queries per second rate, thereby improving the accuracy of the software pressure test.

[0141] Corresponding to the above method embodiment, the present application also provides a pressure test device embodiment. Figure 4 The structural schematic diagram of a pressure test device provided by an embodiment of the present application is shown. As Figure 4 shown, the device includes:

[0142] A receiving module 402, configured to receive a pressure test task, where the pressure test task includes an expected queries per second rate and a thread adjustment rate;

[0143] A first determination module 404, configured to determine the container group set corresponding to the pressure test task in the container group cluster based on the thread adjustment rate;

[0144] An obtaining module 406, configured to increase the number of threads in the container group set based on the thread adjustment rate in the current test cycle, and obtain the current queries per second rate of the container group set;

[0145] A second determination module 408, configured to determine the thread adjustment strategy for the container group set in the next test cycle according to the current queries per second rate and the expected queries per second rate;

[0146] An adjustment module 410, configured to adjust the number of threads of the set of container groups in the next test cycle based on the thread adjustment policy and the thread adjustment rate until the stress test task ends.

[0147] In a specific embodiment of the present application, the first determination module 404 is further configured to:

[0148] Determine the thread threshold of the container groups in the container group cluster;

[0149] Obtain the set of container groups corresponding to the stress test task in the container group cluster based on the thread threshold of the container groups and the thread adjustment rate.

[0150] Optionally, the first determination module 404 is further configured to:

[0151] Calculate the number of container groups according to the thread adjustment rate and the thread threshold of the container groups;

[0152] Determine the container groups corresponding to the number of container groups in the container group cluster to form a set of container groups.

[0153] Optionally, the obtaining module 406 is further configured to:

[0154] Increase the number of threads of each container group in the set of container groups based on the thread threshold of the container groups.

[0155] Optionally, the obtaining module 406 is further configured to:

[0156] Obtain the current queries per second rate of each container group in the set of container groups in the stress test statistical database;

[0157] Accumulate the current queries per second rate of each container group to obtain the current queries per second rate of the set of container groups.

[0158] Optionally, the second determination module 408 is further configured to:

[0159] Determine a preset queries per second rate range based on the expected queries per second rate, where the preset queries per second rate range includes the maximum queries per second rate and the minimum queries per second rate;

[0160] In the case where the current queries per second rate is less than the minimum queries per second rate, determine the thread adjustment policy of the set of container groups as a thread increase policy;

[0161] In the case where the current queries per second rate is greater than the maximum queries per second rate, determine the thread adjustment policy of the set of container groups as a thread decrease policy;

[0162] When the current queries per second is greater than or equal to the minimum queries per second and less than or equal to the maximum queries per second, determine that the thread adjustment policy for the set of container groups is the thread stability policy.

[0163] Optionally, the adjustment module 410 is further configured to:

[0164] Determine a target container group in the set of container groups and a thread threshold of the target container group;

[0165] When the thread adjustment policy is the thread increase policy, increase the number of threads of the target container group based on the thread threshold of the target container group;

[0166] When the thread adjustment policy is the thread decrease policy, decrease the number of threads of the target container group based on the thread threshold of the target container group;

[0167] When the thread adjustment policy is the thread stability policy, keep the number of threads of the target container group unchanged.

[0168] Optionally, the adjustment module 410 is further configured to:

[0169] Monitor the load value of the target container group;

[0170] When the load value exceeds the maximum load value, change the container group status of the target container group to the stable state and add the target container group to the list of stable container groups, and determine a new container group in the container group cluster to be added to the set of container groups, and the new container group continues to execute the thread increase policy.

[0171] Optionally, the adjustment module 410 is further configured to:

[0172] Monitor the number of threads of the target container group;

[0173] When the number of threads of the target container group is reduced to the minimum threshold, select a to-be-processed container group in the list of stable container groups and change the container group status of the to-be-processed container group to the active state, and the to-be-processed container group continues to execute the thread decrease policy.

[0174] Optionally, the adjustment module 410 is further configured to:

[0175] Receive an instruction to end the stress test task;

[0176] End the stress test task based on the instruction to end the stress test task.

[0177] The pressure testing device of the present application includes a receiving module that receives a pressure testing task, where the pressure testing task includes an expected queries per second rate and a thread adjustment rate; a first determination module that determines a set of container groups corresponding to the pressure testing task in a container group cluster based on the thread adjustment rate; an acquisition module that increases the number of threads of the set of container groups based on the thread adjustment rate during a current test cycle and acquires the current queries per second rate of the set of container groups; a second determination module that determines a thread adjustment strategy for the set of container groups in a next test cycle according to the current queries per second rate and the expected queries per second rate; and an adjustment module that adjusts the number of threads of the set of container groups in the next test cycle based on the thread adjustment strategy and the thread adjustment rate until the pressure testing task ends. The pressure testing device of the present application realizes dynamic adjustment of the number of threads and full utilization of container groups, further facilitating real-time adjustment of the pressure testing task by the user and obtaining a more accurate pressure testing result.

[0178] The above is a schematic solution of a pressure testing device according to this embodiment. It should be noted that the technical solution of this pressure testing device and the technical solution of the above pressure testing method belong to the same concept. For the details not described in the technical solution of the pressure testing device, reference can be made to the description of the technical solution of the above pressure testing method.

[0179] Figure 5 FIG. shows a structural block diagram of a computing device 500 according to an embodiment of the present application. The components of the computing device 500 include, but are not limited to, a memory 510 and a processor 520. The processor 520 is connected to the memory 510 through a bus 530, and a database 550 is used to store data.

[0180] The computing device 500 further includes an access device 540 that enables the computing device 500 to communicate via one or more networks 560. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 540 may include one or more of any type of wired or wireless network interface (e.g., a network interface card (NIC)), such as an IEEE802.11 wireless local area network (WLAN) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, a Near Field Communication (NFC) interface, and so on.

[0181] In an embodiment of the present application, the above components of the computing device 500 and Figure 5 other components not shown in may also be connected to each other, for example, through a bus. It should be understood thatFigure 5 The block diagram of the computing device shown is for illustrative purposes only and is not a limitation on the scope of the present application. Those skilled in the art can add or replace other components as needed.

[0182] The computing device 500 can be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, personal digital assistant, laptop computer, notebook computer, netbook, etc.), a mobile phone (e.g., a smartphone), a wearable computing device (e.g., a smartwatch, smart glasses, etc.) or other types of mobile devices, or a stationary computing device such as a desktop computer or PC. The computing device 500 can also be a mobile or stationary server.

[0183] Wherein, when the processor 520 executes the computer instructions, the steps of the pressure test method are implemented.

[0184] The above is a schematic solution of a computing device in this embodiment. It should be noted that the technical solution of the computing device and the technical solution of the above pressure test method belong to the same concept. For the details not described in detail in the technical solution of the computing device, reference can be made to the description of the technical solution of the above pressure test method.

[0185] An embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions that, when executed by a processor, implement the steps of the pressure test method as described above.

[0186] The above is a schematic solution of a computer-readable storage medium in this embodiment. It should be noted that the technical solution of the storage medium and the technical solution of the above pressure test method belong to the same concept. For the details not described in detail in the technical solution of the storage medium, reference can be made to the description of the technical solution of the above pressure test method.

[0187] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the acts or steps recited in the claims can be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the figures do not necessarily require the particular order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0188] The computer instructions include computer program code, which may be in the form of source code, object code, executable files, or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, external hard drives, magnetic disks, optical discs, computer memories, read-only memories (ROMs), random access memories (RAMs), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice within the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.

[0189] It should be noted that for the foregoing method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described order of actions, because according to this application, certain steps may be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0190] In the above embodiments, the descriptions of the respective embodiments have their own focuses. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0191] The preferred embodiments of the present application disclosed above are only used to help explain the present application. The alternative embodiments do not describe all the details in detail, nor do they limit the invention to the specific embodiments described. Obviously, many modifications and variations can be made according to the content of this application. The present application selects and specifically describes these embodiments to better explain the principle and practical application of the present application, so that those skilled in the art can well understand and utilize the present application. The present application is only limited by the claims and their full scope and equivalents.

Claims

1. A stress testing method, characterized in that, comprising: Receiving a stress testing task, wherein the stress testing task includes an expected queries per second rate and a thread adjustment rate; Determining a set of container groups corresponding to the stress testing task in a container group cluster based on the thread adjustment rate; Increasing the number of threads of the set of container groups based on the thread adjustment rate within a current test cycle, and obtaining the current queries per second rate of the set of container groups; Determining a thread adjustment strategy for the set of container groups in a next test cycle according to the current queries per second rate and the expected queries per second rate; Adjusting the number of threads of the set of container groups within the next test cycle based on the thread adjustment strategy and the thread adjustment rate until the stress testing task ends; Wherein, determining the set of container groups corresponding to the stress testing task in the container group cluster based on the thread adjustment rate includes: Determining a thread threshold of container groups in the container group cluster; Obtaining the set of container groups corresponding to the stress testing task in the container group cluster based on the thread threshold of the container groups and the thread adjustment rate; Wherein, obtaining the set of container groups corresponding to the stress testing task in the container group cluster based on the thread threshold of the container groups and the thread adjustment rate includes: Calculating the number of container groups according to the thread adjustment rate and the thread threshold of the container groups; Determining container groups corresponding to the number of container groups in the container group cluster to form a set of container groups; Wherein, the thread adjustment rate refers to the rate of increasing the number of threads in a stress testing task, the thread threshold of a container group refers to the maximum number of threads that a container group can increase each time, and the number of container groups refers to the minimum number of container groups required to reach the thread adjustment rate.

2. The stress testing method according to claim 1, characterized in that, Increasing the number of threads of the set of container groups based on the thread adjustment rate within a current test cycle includes: Increasing the number of threads of each container group in the set of container groups based on the thread threshold of the container groups.

3. The stress testing method according to claim 1, characterized in that, Obtaining the current queries per second rate of the set of container groups includes: Obtaining the current queries per second rate of each container group in the set of container groups in a stress testing statistical database; Accumulating the current queries per second rate of each container group to obtain the current queries per second rate of the set of container groups.

4. The stress testing method according to claim 1, characterized in that, Determining a thread adjustment strategy for the set of container groups in a next test cycle according to the current queries per second rate and the expected queries per second rate includes: Determining a preset queries per second rate range based on the expected queries per second rate, wherein the preset queries per second rate range includes a maximum queries per second rate and a minimum queries per second rate; In the case where the current queries per second rate is less than the minimum queries per second rate, determining the thread adjustment strategy for the set of container groups as a thread increasing strategy; In the case where the current queries per second rate is greater than the maximum queries per second rate, determining the thread adjustment strategy for the set of container groups as a thread decreasing strategy; When the current queries per second rate is greater than or equal to the minimum queries per second rate and less than or equal to the maximum queries per second rate, determine that the thread adjustment policy for the set of container groups is the thread stability policy.

5. The stress testing method according to claim 4, wherein, adjusting the number of threads of the set of container groups in the next test cycle based on the thread adjustment policy and the thread adjustment rate includes: determining a target container group in the set of container groups and a thread threshold of the target container group; when the thread adjustment policy is the thread increase policy, increasing the number of threads of the target container group based on the thread threshold of the target container group; when the thread adjustment policy is the thread decrease policy, decreasing the number of threads of the target container group based on the thread threshold of the target container group; when the thread adjustment policy is the thread stability policy, keeping the number of threads of the target container group unchanged.

6. The stress testing method according to claim 5, wherein, after increasing the number of threads of the target container group based on the thread threshold of the target container group when the thread adjustment policy is the thread increase policy, further includes: monitoring the load value of the target container group; when the load value exceeds the maximum load value, changing the container group status of the target container group to the stable state and adding the target container group to the stable container group list, and determining a new container group in the container group cluster to be added to the set of container groups, and the new container group continues to execute the thread increase policy.

7. The stress testing method according to claim 6, wherein, after decreasing the number of threads of the target container group based on the thread threshold of the target container group when the thread adjustment policy is the thread decrease policy, further includes monitoring the number of threads of the target container group; when the number of threads of the target container group decreases to the minimum threshold, selecting a to-be-processed container group from the stable container group list and changing the container group status of the to-be-processed container group to the active state, and the to-be-processed container group continues to execute the thread decrease policy.

8. The stress testing method according to any one of claims 1-7, wherein, adjusting the number of threads of the set of container groups in the next test cycle based on the thread adjustment policy and the thread adjustment rate until the stress testing task ends, includes: receiving a stress testing task end instruction; ending the stress testing task based on the stress testing task end instruction.

9. A stress testing device, wherein, comprises: a receiving module, configured to receive a stress testing task, wherein the stress testing task includes an expected queries per second rate and a thread adjustment rate; a first determination module, configured to determine a set of container groups corresponding to the stress testing task in a container group cluster based on the thread adjustment rate; an acquisition module, configured to increase the number of threads of the set of container groups based on the thread adjustment rate in the current test cycle, and acquire the current queries per second rate of the set of container groups; A second determination module, configured to determine a thread adjustment policy for the set of container groups in the next test cycle according to the current queries per second rate and the expected queries per second rate; An adjustment module, configured to adjust the number of threads of the set of container groups in the next test cycle based on the thread adjustment policy and the thread adjustment rate until the stress test task ends; Wherein, determining the set of container groups corresponding to the stress test task in the container group cluster based on the thread adjustment rate includes: Determining the thread threshold of the container groups in the container group cluster; Obtaining the set of container groups corresponding to the stress test task in the container group cluster based on the thread threshold of the container groups and the thread adjustment rate; Wherein, obtaining the set of container groups corresponding to the stress test task in the container group cluster based on the thread threshold of the container groups and the thread adjustment rate includes: Calculating the number of container groups according to the thread adjustment rate and the thread threshold of the container groups; Determining the container groups corresponding to the number of container groups in the container group cluster to form a set of container groups; Wherein, the thread adjustment rate refers to the rate of increasing the number of threads in the stress test task, the thread threshold of the container group refers to the maximum number of threads that the container group can increase each time, and the number of container groups refers to the minimum number of container groups required to reach the thread adjustment rate.

10. A computing device, including a memory, a processor, and computer instructions stored on the memory and executable on the processor, wherein, when the processor executes the computer instructions, the steps of the method according to any one of claims 1-8 are implemented.

11. A computer-readable storage medium, which stores computer instructions, wherein, when the computer instructions are executed by the processor, the steps of the method according to any one of claims 1-8 are implemented.

12. A computer program product, which includes computer instructions, wherein, when the computer instructions are executed by the processor, the steps of the method according to any one of claims 1-8 are implemented.

Images