High-concurrency pressure test method and related device based on elastic expansion and contraction

Abstract

The invention discloses a high-concurrency pressure test method based on elastic expansion and contraction and a related device. The method comprises the following steps: determining a test target; designing a test scene; configuring an elastic telescopic environment; under the designed test scene, a pressure test task is executed on the to-be-tested system, in the process of executing the pressure test task, performance indexes of the to-be-tested system are detected, resource configuration of the test scene is automatically adjusted according to the detected performance indexes of the to-be-tested system and a preset elastic scaling strategy, and a test result is obtained; the test result is compared with the test target, the high-concurrency pressure test of the to-be-tested system is completed, and the method and the related device can improve the accuracy and the reliability of the test.

Description

Technical Field

[0001] The present invention belongs to the technical field of software testing, and relates to a testing method and related device for high-concurrency stress testing based on elastic scaling. Background Art

[0002] In today's Internet era, many systems and applications need to face high-concurrency access requests. In order to ensure the stable operation of the system under high concurrency and meet the needs of users, it is very necessary to conduct high-concurrency stress testing. Traditional high-concurrency stress testing methods often have problems such as fixed resource configuration and inability to dynamically adjust according to the actual pressure situation, resulting in inaccurate test results and unable to truly reflect the performance of the system in high-concurrency scenarios. Summary of the Invention

[0003] The purpose of the present invention is to overcome the above-mentioned disadvantages of the prior art, and provide a testing method and related device for high-concurrency stress testing based on elastic scaling, which can improve the accuracy and reliability of testing.

[0004] To achieve the above purpose, the present invention discloses a testing method for high-concurrency stress testing based on elastic scaling, including:

[0005] Determine the test target;

[0006] Design the test scenario;

[0007] Configure the elastic scaling environment;

[0008] Under the designed test scenario, execute the stress testing task on the system to be tested. During the execution of the stress testing task, detect the performance indicators of the system to be tested, and automatically adjust the resource configuration of the test scenario according to the detected performance indicators of the system to be tested and the preset elastic scaling strategy to obtain the test results;

[0009] Compare the test results with the test target to complete the high-concurrency stress testing of the system to be tested.

[0010] A further improvement of the testing method for high-concurrency stress testing based on elastic scaling according to the present invention is as follows:

[0011] Further, the process of determining the test target is as follows:

[0012] Determine the function and performance requirements of the system to be tested;

[0013] Determine the performance indicators to be tested;

[0014] Set the expected target.

[0015] Further, the process of designing the test scenario is as follows:

[0016] Analyze the business processes and user behaviors of the system to be tested, and determine the types of operations and requests;

[0017] Design different test scenarios according to the determined types of operations and requests.

[0018] Furthermore, the process of configuring the elastic scaling environment is as follows:

[0019] Select a cloud computing platform or an elastic scaling tool;

[0020] Set the policies and thresholds for elastic scaling;

[0021] Configure a monitoring system to monitor the performance metrics of the system to be tested in real time through the monitoring system.

[0022] Furthermore, the process of executing the stress testing task is as follows:

[0023] Select a stress testing tool;

[0024] Configure the parameters of the stress testing tool according to the designed test scenarios;

[0025] Start the stress testing tool and send high-concurrency requests to the system to be tested to simulate an actual high-concurrency scenario.

[0026] Furthermore, the process of automatically adjusting the resource configuration of the test scenario according to the performance metrics of the system to be tested obtained through detection and the preset elastic scaling policies is as follows:

[0027] When the load of the system to be tested is too high, automatically increase the resources of the server to improve the processing capacity of the system to be tested; when the load of the system to be tested is low, automatically reduce the resources of the server.

[0028] Furthermore, it also includes:

[0029] Give optimization and improvement suggestions according to the comparison results.

[0030] The present invention discloses a test system for high-concurrency stress testing based on elastic scaling, including:

[0031] A determination module for determining the test objectives;

[0032] A design module for designing test scenarios;

[0033] A configuration module for configuring the elastic scaling environment;

[0034] A test module is used to perform a stress test task on a system under test in a designed test scenario. During the execution of the stress test task, the performance metrics of the system under test are detected, and according to the detected performance metrics of the system under test and the preset elastic scaling policy, the resource configuration of the test scenario is automatically adjusted to obtain a test result.

[0035] A comparison module is used to compare the test result with the test target to complete the high-concurrency stress test of the system under test.

[0036] The present invention discloses a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the test method for high-concurrency stress testing based on elastic scaling are implemented.

[0037] The present invention discloses a computer-readable storage medium storing a computer program, and when the computer program is executed by a processor, the steps of the test method for high-concurrency stress testing based on elastic scaling are implemented.

[0038] The present invention has the following beneficial effects:

[0039] When the test method for high-concurrency stress testing based on elastic scaling and related devices of the present invention are specifically operated, by automatically adjusting the resource configuration according to the actual load condition of the system under test, a high-concurrency scenario can be more realistically simulated, the accuracy and reliability of the test can be improved, the performance problems and bottlenecks of the system under high-concurrency conditions can be effectively discovered, providing a basis for the optimization and improvement of the system, helping enterprises save test costs, improve test efficiency, and shorten the product launch time. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The accompanying drawings forming a part of the present invention are used to provide a further understanding of the present invention. The schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0041] Figure 1 is the schematic diagram of the method of the present invention;

[0042] Figure 2 is the basic schematic diagram of elastic scaling. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0043] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0044] In the description of the present invention, it should be understood that the terms "comprising" and "including" indicate the presence of the described features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or their combinations.

[0045] It should also be understood that the terms used in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates otherwise, the singular forms "a", "an", and "the" are intended to include the plural forms.

[0046] It should be further understood that the term "and / or" used in the specification of the present invention and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations. For example, A and / or B can represent three cases: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " in the present invention generally represents an "or" relationship between the contextually related objects.

[0047] It should be understood that although the terms first, second, third, etc. may be used in the embodiments of the present invention to describe preset ranges, etc., these preset ranges should not be limited to these terms. These terms are only used to distinguish the preset ranges from each other. For example, without departing from the scope of the embodiments of the present invention, the first preset range may also be referred to as the second preset range, and similarly, the second preset range may also be referred to as the first preset range.

[0048] Depending on the context, the word "if" as used herein can be interpreted as "when" or "while" or "in response to determining" or "in response to detecting". Similarly, depending on the context, the phrase "if determined" or "if detected (stated condition or event)" can be interpreted as "when determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)".

[0049] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. Usually, the components described and shown in the accompanying drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the claimed present invention, but merely represents selected embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts belong to the scope of protection of the present invention.

[0050] Various structural schematic diagrams according to the disclosed embodiments of the present invention are shown in the drawings. These figures are not drawn to scale, where some details are enlarged for the purpose of clear expression, and some details may be omitted. The shapes of various regions and layers shown in the figures, as well as their relative sizes and positional relationships, are merely exemplary. In practice, there may be deviations due to manufacturing tolerances or technical limitations, and those skilled in the art can design regions / layers with different shapes, sizes, and relative positions according to actual needs.

[0051] Embodiment 1

[0052] The test method for high-concurrency stress testing based on elastic scaling according to the present invention includes the following steps:

[0053] 1) Determine the test objective;

[0054] 11) Determine the function and performance requirements of the system or application to be tested.

[0055] 12) Determine the performance indicators to be tested, and the performance indicators include but are not limited to: response time, throughput, and error rate.

[0056] 13) Set the expected goals according to the business requirements and system characteristics.

[0057] 2) Design the test scenario;

[0058] 21) Analyze the business process and user behavior of the system to be tested, and determine the operation and request types.

[0059] 22) Design different test scenarios according to the determined operation and request types, including parameters such as different numbers of concurrent users, request frequencies, and data volumes.

[0060] 23) Ensure that the test scenario can cover the main functions of the system and possible high-concurrency situations.

[0061] 3) Configure the elastic scaling environment;

[0062] 31) Select a cloud computing platform or elastic scaling tool, such as AWS Auto Scaling, public cloud elastic scaling, etc.

[0063] 32) Set the elastic scaling policy and thresholds. For example, when the CPU utilization rate exceeds 80%, the resources of the server are automatically increased; when the CPU utilization rate is below 30%, the resources of the server are automatically decreased.

[0064] 33) Configure a monitoring system to monitor the performance metrics of the system in real time, such as CPU utilization rate, memory utilization rate, and network bandwidth utilization rate, so that the elastic scaling system can adjust resources according to the performance metrics.

[0065] 4) Execute a stress testing task;

[0066] 41) Select a stress testing tool, such as JMeter, LoadRunner.

[0067] 42) Configure the parameters of the stress testing tool according to the designed test scenario. The parameters of the stress testing tool include but are not limited to: the number of concurrent users, request types, and duration.

[0068] 43) Start the stress testing tool and send high-concurrency requests to the system under test to simulate an actual high-concurrency scenario.

[0069] 5) Monitor the testing process;

[0070] 51) During the stress testing process, monitor the performance metrics of the system under test in real time through the monitoring system, such as: response time, throughput, error rate, server load.

[0071] 52) Observe the running state of the system under test and promptly discover possible problems, such as performance bottlenecks and resource shortages.

[0072] 6) Elastic scaling adjustment;

[0073] 61) According to the performance metrics feedback by the monitoring system and the preset elastic scaling policy, the elastic scaling system automatically adjusts the resource configuration of the test environment.

[0074] 62) When the load of the system under test is too high, the resources of the server are automatically increased to improve the processing capacity of the system under test; when the load of the system under test is low, the resources of the server are automatically decreased to save costs.

[0075] 7) Analyze the test results;

[0076] 71) After the stress testing is completed, collect and organize the performance data generated during the testing process;

[0077] 72) Use data analysis tools and methods to analyze the collected and sorted performance data to evaluate the performance of the system under test under high concurrency.

[0078] 73) Compare the test results with the test objectives to determine whether the system under test meets the performance requirements.

[0079] 8) Optimization and improvement suggestions;

[0080] 81) Based on the analysis of the test results, identify the performance problems and bottlenecks existing in the system under test.

[0081] 82) For the performance problems and bottlenecks, put forward corresponding optimization and improvement suggestions, such as code optimization, database optimization, server configuration optimization, etc.

[0082] 83) Retest the optimized system to verify the optimization effect.

[0083] Example 2

[0084] In this example, an e-commerce website is taken as an example to conduct high-concurrency stress testing based on elastic scaling.

[0085] 1) Determine the test objectives:

[0086] 11) Performance indicators: The response time is less than 3 seconds, the throughput reaches 1000 transactions per second, and the error rate is lower than 0.1%.

[0087] 12) Expected goal: Under high concurrency, the system can run stably and meet the shopping needs of users.

[0088] 2) Design the test scenario:

[0089] 21) Simulate operations such as user login, browsing products, adding to the shopping cart, and placing orders.

[0090] 22) Set the number of concurrent users to 300, 500, 800, 1000, and 2000 respectively for testing.

[0091] 23) For each number of concurrent users, continuously test for 20 minutes.

[0092] 3) Configure the elastic scaling environment:

[0093] 31) Use the public cloud elastic scaling service and set the CPU utilization threshold to 80%.

[0094] 32) When the CPU utilization exceeds 80%, automatically add 3 servers; when the CPU utilization is lower than 30%, automatically reduce 1 server.

[0095] 33) Configure the public cloud monitoring service to monitor performance metrics such as CPU utilization, memory utilization, and network bandwidth utilization of the system in real time.

[0096] 4) Execute the stress testing task;

[0097] Use JMeter as the stress testing tool, configure parameters such as the number of concurrent users, request types, and duration of JMeter, and conduct stress testing according to the designed test scenarios.

[0098] 5) Monitor the testing process;

[0099] During the stress testing process, view the performance metrics of the system in real time through the public cloud monitoring service. When it is found that the CPU utilization exceeds 80%, the public cloud elastic scaling service automatically increases the resources of the server to ensure the processing ability of the system.

[0100] 6) Elastic scaling adjustment;

[0101] According to the performance metrics feedback by the monitoring system and the preset elastic scaling strategy, the public cloud elastic scaling service automatically adjusts the resource configuration of the test environment. During the stress testing process, as the number of concurrent users increases, the system load gradually rises, and the public cloud elastic scaling service timely increases the server resources to ensure the stable performance of the system.

[0102] 7) Analyze the test results;

[0103] 71) After the stress testing is completed, collect the performance data generated by JMeter, including response time, throughput, error rate, etc.

[0104] 72) Use Excel and chart tools to analyze the performance data, and draw response time curves, throughput curves, and error rate curves.

[0105] 73) Compare the test results with the expected goals. It is found that when the number of concurrent users is 2000, the response time exceeds 3 seconds and needs to be optimized.

[0106] 8) Optimization and improvement suggestions;

[0107] 81) Optimize the system's database, add indexes, and improve query efficiency.

[0108] 82) Optimize the system's code to reduce unnecessary calculations and data processing.

[0109] 83) Adjust the server configuration, increase memory and the number of CPU cores.

[0110] After optimization and improvement, the system was tested again to verify the optimization effect. The results showed that when the number of concurrent users was 2,000, the response time reached 1.5 seconds, the throughput reached 800 transactions per second, and the error rate was lower than 0.01%, meeting the expected goals.

[0111] Embodiment III

[0112] The test system for high-concurrency stress testing based on elastic scaling according to the present invention includes:

[0113] A determination module for determining a test target;

[0114] A design module for designing a test scenario;

[0115] A configuration module for configuring an elastic scaling environment;

[0116] A test module for performing a stress testing task on the system under test in the designed test scenario. During the execution of the stress testing task, the performance metrics of the system under test are detected, and according to the detected performance metrics of the system under test and the preset elastic scaling policy, the resource configuration of the test scenario is automatically adjusted to obtain a test result;

[0117] A comparison module for comparing the test result with the test target to complete the high-concurrency stress testing of the system under test.

[0118] The division of modules in the embodiments of the present application is illustrative, merely a logical function division. In actual implementation, there may be other division methods. In addition, in each embodiment of the present application, the functional modules may be integrated in a processor, may exist separately physically, or two or more modules may be integrated in one module. The above integrated modules may be implemented in the form of hardware or in the form of software function modules.

[0119] Embodiment IV

[0120] A computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the testing method for high-concurrency stress testing based on elastic scaling are implemented. For example, it includes: determining a test target; designing a test scenario; configuring an elastic scaling environment; under the designed test scenario, performing a stress testing task on the system to be tested. During the process of performing the stress testing task, performance indicators of the system to be tested are detected, and according to the detected performance indicators of the system to be tested and a preset elastic scaling policy, the resource configuration of the test scenario is automatically adjusted to obtain a test result; comparing the test result with the test target to complete the high-concurrency stress testing of the system to be tested. Among them, the memory may include internal memory, such as high-speed random access memory, and may also include non-volatile memory, such as at least one disk memory, etc.; the processor, network interface, and memory are interconnected through an internal bus, which can be an Industry Standard Architecture bus, a Peripheral Component Interconnect standard bus, an Extended Industry Standard Architecture bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. The memory is used to store programs. Specifically, the program may include program code, and the program code includes computer operation instructions. The memory may include internal memory and non-volatile memory, and provides instructions and data to the processor.

[0121] Embodiment Five

[0122] A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the steps of the testing method for high-concurrency stress testing based on elastic scaling are implemented. For example, it includes: determining a test target; designing a test scenario; configuring an elastic scaling environment; under the designed test scenario, performing a stress testing task on the system to be tested. During the process of performing the stress testing task, performance indicators of the system to be tested are detected, and according to the detected performance indicators of the system to be tested and a preset elastic scaling policy, the resource configuration of the test scenario is automatically adjusted to obtain a test result; comparing the test result with the test target to complete the high-concurrency stress testing of the system to be tested. Specifically, the computer-readable storage medium includes, but is not limited to, for example, volatile memory and / or non-volatile memory. The volatile memory may include random access memory (RAM) and / or cache memory, etc. The non-volatile memory may include read-only memory (ROM), hard disk, flash memory, optical disc, magnetic disk, etc.

[0123] Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0124] The present application is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, as well as the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one or more of the processes or multiple processes and / or blocks Figure 1 one or more of the blocks or multiple blocks.

[0125] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including instruction means that implement the functions specified in Figure 1 one or more of the processes or multiple processes and / or blocks Figure 1 one or more of the blocks or multiple blocks.

[0126] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in Figure 1 one or more of the processes or multiple processes and / or blocks Figure 1 one or more of the blocks or multiple blocks.

[0127] After considering the specification and the disclosure of the invention, those skilled in the art will readily think of other embodiments of the present invention. The present application is intended to cover any variations, uses, or adaptations of the present invention, which follow the general principles of the present invention and include common general knowledge or conventional technical means in the technical field not disclosed in the present invention. The specification and embodiments are only regarded as exemplary, and the true scope and spirit of the present invention are pointed out by the following claims.

[0128] It should be understood that the present invention is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present invention is only limited by the appended claims.

[0129] The above are only the preferred embodiments of the present invention, and do not impose any limitation on the present invention. Any simple modifications, changes, and equivalent structural changes made to the above embodiments according to the technical essence of the present invention still fall within the scope of protection of the technical solution of the present invention.

Claims

1. A testing method for high-concurrency stress testing based on elastic scaling, characterized in that, Including: Determine the test objectives; Design the test scenarios; Configure the elastic scaling environment; Under the designed test scenarios, perform the stress test task on the system to be tested. During the process of performing the stress test task, detect the performance metrics of the system to be tested, and automatically adjust the resource configuration of the test scenarios according to the detected performance metrics of the system to be tested and the preset elastic scaling policies, to obtain the test results; Compare the test results with the test objectives to complete the high-concurrency stress test of the system to be tested.

2. The test method for high-concurrency stress testing based on elastic scaling according to claim 1, wherein The process of determining the test objectives is as follows: Determine the function and performance requirements of the system to be tested; Determine the performance metrics to be tested; Set the expected objectives.

3. The test method for high-concurrency stress testing based on elastic scaling according to claim 1, characterized in that, The process of designing the test scenarios is as follows: Analyze the business processes and user behaviors of the system to be tested to determine the operation and request types; Design different test scenarios according to the determined operation and request types.

4. The test method for high-concurrency stress testing based on elastic scaling according to claim 1, characterized in that, The process of configuring the elastic scaling environment is as follows: Select a cloud computing platform or elastic scaling tool; Set the elastic scaling policies and thresholds; Configure the monitoring system to monitor the performance metrics of the system to be tested in real time through the monitoring system.

5. The test method for high-concurrency stress testing based on elastic scaling according to claim 1, characterized in that, The process of performing the stress test task is as follows: Select a stress test tool; Configure the parameters of the stress test tool according to the designed test scenarios; Start the stress test tool and send high-concurrency requests to the system to be tested to simulate the actual high-concurrency scenario.

6. The test method for high-concurrency stress testing based on elastic scaling according to claim 1, characterized in that The process of automatically adjusting the resource configuration of the test scenarios according to the detected performance metrics of the system to be tested and the preset elastic scaling policies is as follows: When the load of the system to be tested is too high, automatically increase the resources of the server to improve the processing capacity of the system to be tested; when the load of the system to be tested is low, automatically reduce the resources of the server.

7. The test method for high-concurrency stress testing based on elastic scaling according to claim 1, characterized in that It also includes: Give optimization and improvement suggestions according to the comparison results.

8. A test system for high-concurrency stress testing based on elastic scaling, characterized in that, Including: A determination module for determining the test objectives; A design module for designing the test scenarios; A configuration module for configuring the elastic scaling environment; A test module for performing the stress test task on the system to be tested under the designed test scenarios. During the process of performing the stress test task, detect the performance metrics of the system to be tested, and automatically adjust the resource configuration of the test scenarios according to the detected performance metrics of the system to be tested and the preset elastic scaling policies, to obtain the test results; A comparison module for comparing the test results with the test objectives to complete the high-concurrency stress test of the system to be tested.

9. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the high-concurrency stress test method based on elastic scaling according to any one of claims 1-7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the high-concurrency stress test method based on elastic scaling according to any one of claims 1-7.

Images