System performance pressure measurement method, device and equipment, computer readable medium and product

Abstract

The embodiment of the invention discloses a system performance pressure measurement method, device and equipment, a computer readable medium and a product. A specific embodiment of the method comprises: according to pressure measurement data, pressure measurement supervision value information and a pressure measurement script corresponding to a target system, generating a performance pressure measurement task corresponding to the target system, the pressure measurement supervision value information comprising pressurization concurrent number information and resource utilization rate threshold information; in response to determination of execution of the performance pressure test task, executing the following steps according to the pressurization concurrency number information and the resource utilization rate threshold information: performing pressurization processing on the target system according to the pressurization concurrency number information; and in response to determining that the resource utilization rate information of the target system meets a preset limit pressure measurement condition, generating a performance pressure measurement report corresponding to the target system, the preset limit pressure measurement condition corresponding to the resource utilization rate threshold information. The implementation mode is related to system performance pressure measurement, and the pressure measurement efficiency and the pressure measurement quality of the system performance are improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technologies, and in particular, to methods, apparatuses, devices, computer-readable media, and products for system performance stress testing. Background Art

[0002] Stress testing, that is, pressure testing, is a testing method for establishing system stability, and can examine its functional limits and potential problems. Currently, when stress testing a system, the commonly used method is: the stress testing personnel gradually apply pressure while observing the performance changes. When the performance reaches the bottleneck, the extreme stress testing is completed.

[0003] However, the inventors have found that when stress testing a system in the above manner, there are often the following technical problems: Internet software systems are becoming increasingly complex and the iteration frequency is increasing day by day, resulting in low stress testing efficiency and weak control over stress testing quality that highly rely on the stress testing method of stress testing personnel, thus leading to low stress testing quality.

[0004] The above information disclosed in this background art section is only used to enhance the understanding of the background of the inventive concept, and thus, it may include information that does not form the prior art known to those of ordinary skill in the art in this country. Summary of the Invention

[0005] This content part of the present disclosure is used to briefly introduce concepts, which will be described in detail in the following detailed implementation part. This content part of the present disclosure is not intended to identify the key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0006] Some embodiments of the present disclosure propose methods, apparatuses, electronic devices, computer-readable media, and computer program products for system performance stress testing to solve one or more of the technical problems mentioned in the above background art section.

[0007] In a first aspect, some embodiments of the present disclosure provide a method for system performance stress testing. The method includes: generating a performance stress testing task for the target system according to the stress testing data, stress testing supervision value information, and stress testing script corresponding to the target system, where the stress testing supervision value information includes pressurized concurrency number information and resource utilization rate threshold information; in response to determining that the performance stress testing task is executed, according to the pressurized concurrency number information and the resource utilization rate threshold information, perform the following steps: perform a pressurization process on the target system according to the pressurized concurrency number information; in response to determining that the resource utilization rate information of the target system meets a preset extreme stress testing condition, generate a performance stress testing report for the target system, where the preset extreme stress testing condition corresponds to the resource utilization rate threshold information.

[0008] Optionally, after performing the stress test on the target system according to the above stress test concurrent number information, the method further includes: in response to determining that the resource utilization rate information does not meet the above preset extreme stress test condition, re-executing the above steps according to the current concurrent number information of the target system.

[0009] Optionally, the above stress test concurrent number information includes a first concurrent number, and the above resource utilization rate threshold information includes a first resource utilization rate threshold; and performing the stress test on the target system according to the above stress test concurrent number information includes: determining whether the current resource utilization rate of the target system is greater than or equal to the above first resource utilization rate threshold, where the initial concurrent number information of the target system is a preset concurrent number; in response to determining that the current resource utilization rate of the target system is less than the above first resource utilization rate threshold, performing the following first stress test step according to the above first concurrent number: performing the stress test on the target system according to the above first concurrent number; determining the current resource utilization rate of the target system as the first resource utilization rate; in response to determining that the first resource utilization rate is less than the above first resource utilization rate threshold, re-executing the above first stress test step according to the current concurrent number information of the target system.

[0010] Optionally, the above stress test concurrent number information further includes a second concurrent number, the above resource utilization rate threshold information further includes a second resource utilization rate threshold, the second concurrent number is less than or equal to the first concurrent number, and the second resource utilization rate threshold is greater than the first resource utilization rate threshold; and after determining the current resource utilization rate of the target system as the first resource utilization rate, the method further includes: in response to determining that the first resource utilization rate is greater than or equal to the above first resource utilization rate threshold, performing the following second stress test step according to the above second concurrent number: performing the stress test on the target system according to the above second concurrent number; determining the current resource utilization rate of the target system as the second resource utilization rate; in response to determining that the second resource utilization rate is less than the above second resource utilization rate threshold, re-executing the above second stress test step according to the current concurrent number information of the target system.

[0011] Optionally, after determining the current resource utilization rate of the target system as the second resource utilization rate, the method further includes: in response to determining that the second resource utilization rate is greater than or equal to the above second resource utilization rate threshold, determining that the resource utilization rate information of the target system meets the preset extreme stress test condition.

[0012] Optionally, the method further includes: determining whether the second resource utilization rate is greater than or equal to a preset limit utilization rate, where the preset limit utilization rate is greater than the second resource utilization rate threshold; in response to determining that the second resource utilization rate is greater than or equal to the preset limit utilization rate, performing a decompression process on the target system according to the current concurrency number information of the target system.

[0013] Optionally, the performing a pressurization process on the target system according to the first concurrency number includes: determining a pressurization interval duration; in response to determining that the pressurization interval duration is greater than or equal to a preset duration, performing a pressurization process on the target system according to the first concurrency number.

[0014] Optionally, the performing a decompression process on the target system according to the current concurrency number information of the target system includes: performing the following decompression steps according to the current concurrency number information of the target system: performing a decompression process on the target system according to a preset decompression concurrency number; determining the current resource utilization rate information of the target system as third resource utilization rate information; in response to determining that the third resource utilization rate information is greater than or equal to the preset limit utilization rate, performing the above decompression steps again according to the current concurrency number information of the target system.

[0015] In a second aspect, some embodiments of the present disclosure provide a system performance stress testing device, where the device includes: a generating unit configured to generate a performance stress testing task for the target system according to the stress testing data, stress testing supervision value information, and stress testing script corresponding to the target system, where the stress testing supervision value information includes pressurization concurrency number information and resource utilization rate threshold information; an execution unit configured to, in response to determining that the performance stress testing task is executed, perform the following steps according to the pressurization concurrency number information and the resource utilization rate threshold information: performing a pressurization process on the target system according to the pressurization concurrency number information; in response to determining that the resource utilization rate information of the target system meets a preset limit stress testing condition, generating a performance stress testing report for the target system, where the preset limit stress testing condition corresponds to the resource utilization rate threshold information.

[0016] Optionally, the execution unit includes: a re - execution unit configured to, in response to determining that the resource utilization rate information does not meet the preset limit stress testing condition, perform the above steps again according to the current concurrency number information of the target system.

[0017] Optionally, the pressurization concurrency number information includes a first concurrency number, and the resource utilization rate threshold information includes a first resource utilization rate threshold.

[0018] Optionally, the execution unit is further configured to: determine whether the current resource utilization rate of the target system is greater than or equal to the first resource utilization rate threshold, where the initial concurrency number information of the target system is a preset concurrency number; in response to determining that the current resource utilization rate of the target system is less than the first resource utilization rate threshold, according to the first concurrency number, perform the following first pressurization step: pressurize the target system according to the first concurrency number; determine the current resource utilization rate of the target system as the first resource utilization rate; in response to determining that the first resource utilization rate is less than the first resource utilization rate threshold, according to the current concurrency number information of the target system, perform the first pressurization step again.

[0019] Optionally, the pressurized concurrency number information further includes a second concurrency number, the resource utilization rate threshold information further includes a second resource utilization rate threshold, the second concurrency number is less than or equal to the first concurrency number, and the second resource utilization rate threshold is greater than the first resource utilization rate threshold.

[0020] Optionally, the execution unit is further configured to: in response to determining that the first resource utilization rate is greater than or equal to the first resource utilization rate threshold, according to the second concurrency number, perform the following second pressurization step: pressurize the target system according to the second concurrency number; determine the current resource utilization rate of the target system as the second resource utilization rate; in response to determining that the second resource utilization rate is less than the second resource utilization rate threshold, according to the current concurrency number information of the target system, perform the second pressurization step again.

[0021] Optionally, the execution unit is further configured to: in response to determining that the second resource utilization rate is greater than or equal to the second resource utilization rate threshold, determine that the resource utilization rate information of the target system meets the preset extreme stress test condition.

[0022] Optionally, the execution unit is further configured to: determine whether the second resource utilization rate is greater than or equal to a preset extreme utilization rate, where the preset extreme utilization rate is greater than the second resource utilization rate threshold; in response to determining that the second resource utilization rate is greater than or equal to the preset extreme utilization rate, perform a decompression process on the target system according to the current concurrency number information of the target system.

[0023] Optionally, the execution unit is further configured to: determine the pressurization interval duration; in response to determining that the pressurization interval duration is greater than or equal to a preset duration, pressurize the target system according to the first concurrency number.

[0024] Optionally, the execution unit is further configured to: according to the current concurrency number information of the target system described above, perform the following decompression steps: perform decompression processing on the target system according to a preset decompression concurrency number; determine the current resource utilization rate information of the target system as the third resource utilization rate information; in response to determining that the third resource utilization rate information is greater than or equal to the preset limit utilization rate, perform the above decompression steps again according to the current concurrency number information of the target system.

[0025] In a third aspect, some embodiments of the present disclosure provide an electronic device, including: one or more processors; a storage device having stored thereon one or more programs, which when executed by the one or more processors cause the one or more processors to implement the method described in any implementation manner of the first aspect above.

[0026] In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium having stored thereon a computer program, wherein the program, when executed by a processor, implements the method described in any implementation manner of the first aspect above.

[0027] In a fifth aspect, some embodiments of the present disclosure provide a computer program product, including a computer program, which when executed by a processor, implements the method described in any implementation manner of the first aspect above.

[0028] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: Through the system performance stress testing method of some embodiments of the present disclosure, the stress testing efficiency and stress testing quality of the system performance are improved. Specifically, the reasons for the low stress testing efficiency and stress testing quality are as follows: Internet software systems are becoming increasingly complex and the iteration frequency is increasing day by day, resulting in a low stress testing efficiency that highly depends on the stress testing methods of stress testing personnel and a weak control over stress testing quality, thus leading to low stress testing quality. Based on this, the system performance stress testing method of some embodiments of the present disclosure, first, generates a performance stress testing task for the above-mentioned target system according to the stress testing data, stress testing supervision value information, and stress testing script corresponding to the target system. Among them, the above-mentioned stress testing supervision value information includes the information of the concurrent number of pressure application and the information of the resource utilization rate threshold. Thus, a performance stress testing task can be automatically generated. Then, in response to determining the execution of the above-mentioned performance stress testing task, according to the above-mentioned information of the concurrent number of pressure application and the above-mentioned information of the resource utilization rate threshold, the following steps are executed: First, according to the above-mentioned information of the concurrent number of pressure application, pressurize the above-mentioned target system. Thus, automatic pressurization can be realized after the performance stress testing task is executed for automatic testing. Second, in response to determining that the resource utilization rate information of the above-mentioned target system meets the preset extreme stress testing condition, generate a performance stress testing report for the above-mentioned target system. Among them, the above-mentioned preset extreme stress testing condition corresponds to the above-mentioned information of the resource utilization rate threshold. Thus, when the resource utilization rate information of the system meets the preset extreme stress testing condition, automatic pressurization can be stopped and a stress testing report can be generated, so that various performance indicators of the system under certain extreme testing conditions can be automatically recorded. Also, because the performance stress testing task is automatically created by a script and the pressurization is also automatically realized, it is possible to avoid relying on the stress testing methods of stress testing personnel, thereby improving the stress testing efficiency and stress testing quality of the system performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In combination with the accompanying drawings and with reference to the following specific embodiments, the above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the elements and elements are not necessarily drawn to scale.

[0030] Figure 1 is an architectural diagram of an exemplary system to which some embodiments of the present disclosure can be applied;

[0031] Figure 2 is a flowchart according to some embodiments of the system performance stress testing method of the present disclosure;

[0032] Figure 3 is a flowchart according to other embodiments of the system performance stress testing method of the present disclosure;

[0033] Figure 4Schematic structural diagram of some embodiments of the system performance stress testing device according to the present disclosure;

[0034] Figure 5 Schematic structural diagram of an electronic device suitable for implementing some embodiments of the present disclosure. Detailed implementation manners

[0035] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0036] In addition, it should be noted that for the sake of convenience of description, only parts related to the relevant invention are shown in the drawings. Without conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other.

[0037] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence relationship of the functions performed by these devices, modules or units.

[0038] It should be noted that the modifications of "one" and "plural" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0039] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0040] Regarding the user personal information involved in the present disclosure (such as operations of collecting, storing, using stress testing data, etc.), before performing the corresponding operations, relevant organizations or individuals shall fulfill obligations including conducting personal information security impact assessments, fulfilling the obligation of informing the personal information subject, and obtaining the prior authorization and consent of the personal information subject.

[0041] The present disclosure will be described in detail below with reference to the drawings and in combination with embodiments.

[0042] Figure 1 Exemplary system architecture 100 of a system performance stress testing method or a system performance stress testing device to which some embodiments of the present disclosure can be applied is shown.

[0043] As Figure 1As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, etc.

[0044] Users can use the terminal devices 101, 102, 103 to interact with the server 105 via the network 104 to receive or send messages, etc. Various communication client applications may be installed on the terminal devices 101, 102, 103, such as web browser applications, item information display applications, search applications, instant messaging tools, email clients, social platform software, etc.

[0045] The terminal devices 101, 102, 103 can be either hardware or software. When the terminal devices 101, 102, 103 are hardware, they can be various electronic devices with a display screen and supporting information display, including but not limited to smartphones, tablets, e-book readers, laptop computers, and desktop computers, etc. When the terminal devices 101, 102, 103 are software, they can be installed in the above-listed electronic devices. It can be implemented as, for example, multiple software or software modules for providing distributed services, or as a single software or software module. No specific limitation is made here.

[0046] The server 105 can be a server providing various services, such as a backend server that supports the information displayed on the terminal devices 101, 102, 103. The backend server can analyze and process data such as received requests, and feedback the processing results to the terminal devices.

[0047] It should be noted that the system performance stress testing method provided by the embodiments of the present disclosure can be executed by the server 105. Correspondingly, the system performance stress testing device can be set in the server 105.

[0048] It should be noted that the server can be either hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers, or as a single server. When the server is software, it can be implemented as, for example, multiple software or software modules for providing distributed services, or as a single software or software module. No specific limitation is made here.

[0049] It should be understood that Figure 1 the numbers of terminal devices, networks, and servers in are merely illustrative. According to implementation needs, there can be any number of terminal devices, networks, and servers.

[0050] Continue to refer toFigure 2 , which shows a flow 200 of some embodiments of a system performance stress testing method according to the present disclosure. The system performance stress testing method includes the following steps:

[0051] Step 201, generate a performance stress testing task for the corresponding target system according to the stress testing data, stress testing supervision value information, and stress testing script of the corresponding target system.

[0052] In some embodiments, the execution subject of the system performance stress testing method (such as Figure 1 the server shown) can generate a performance stress testing task for the corresponding target system according to the stress testing data, stress testing supervision value information, and stress testing script of the corresponding target system. Among them, the above target system can be a system that needs to perform performance stress testing. For example, the above target system can be a system that can process order generation requests. The above stress testing data can be various data used to simulate the processing tasks of the system. For example, the above stress testing data can be various data used to simulate various order generation requests, and each piece of data can include at least one of the following: client identifier, user identifier, item information set. The item information can include, but is not limited to: item identifier, item quantity. The above stress testing supervision value information can be pre-set numerical related information used during the stress testing process. The above stress testing supervision value information includes pressurization concurrency number information and resource utilization rate threshold information. The pressurization concurrency number information can be the concurrency number for each pressurization. The resource utilization rate threshold information can be used to determine whether the current target system reaches a certain performance threshold. The above stress testing script can be a pre-written script for performing stress testing. It should be noted that the above stress testing script is associated with the above stress testing data and the above stress testing supervision value information. In practice, the above execution subject can run the stress testing script associated with the above stress testing data and the above stress testing supervision value information to generate a performance stress testing task for the corresponding target system. The performance stress testing task can be an automatically executed task for performing performance stress testing. Optionally, the above performance stress testing task can be associated with stress testing interface performance monitoring and MDC monitoring. The performance stress testing task can be executed immediately after creation or after a preset duration.

[0053] Step 202, in response to determining that the performance stress testing task is executed, perform the following steps according to the pressurization concurrency number information and the resource utilization rate threshold information:

[0054] Step 2021, perform pressurization processing on the target system according to the pressurization concurrency number information.

[0055] In some embodiments, the above execution subject can perform pressurization processing on the above target system according to the above pressurization concurrency number information. In practice, the above execution subject can increase the above pressurization concurrency number information of concurrency numbers on the concurrency number of the target system.

[0056] In step 2022, in response to determining that the resource utilization information of the target system meets the preset extreme stress test condition, a performance stress test report corresponding to the target system is generated.

[0057] In some embodiments, the above-mentioned execution entity may, in response to determining that the resource utilization information of the target system meets the preset extreme stress test condition, generate a performance stress test report corresponding to the target system. The resource utilization information may be information related to the resource utilization of the target system, and may include but are not limited to at least one of the following: CPU usage rate, memory usage rate. The resource utilization threshold information may include but is not limited to at least one of the following: preset CPU usage rate threshold, preset memory usage rate threshold. The above-mentioned preset extreme stress test condition corresponds to the resource utilization threshold information. For example, the preset extreme stress test condition may be that the CPU usage rate is greater than the preset CPU usage rate threshold. Another example is that the preset extreme stress test condition may be that the CPU usage rate is greater than the preset CPU usage rate threshold, or the memory usage rate is greater than the preset memory usage rate threshold.

[0058] In practice, the above-mentioned execution entity may record the resource utilization information and the number of concurrent users after the last pressurization process in a blank performance stress test report to obtain a performance stress test report corresponding to the target system. Optionally, the performance stress test report corresponding to the target system may also record but is not limited to at least one of the following: system identifier, number of stress test machines, stress test interface identifier, average TPS, average response time, TP99, name of the stress test person in charge, stress test link. Here, the format of the performance stress test report is not limited. For example, the performance stress test report may be a PDF format report.

[0059] Optionally, the above-mentioned execution entity may also, in response to determining that the resource utilization information does not meet the preset extreme stress test condition, execute the above-mentioned steps again according to the current concurrent user information of the target system. Thus, when the resource utilization information does not meet the preset extreme stress test condition, the target system can continue to be pressurized.

[0060] The above embodiments of the present disclosure have the following beneficial effects: Through the system performance stress testing method of some embodiments of the present disclosure, the stress testing efficiency and stress testing quality of the system performance are improved. Specifically, the reasons for the low stress testing efficiency and stress testing quality are as follows: The Internet software system is becoming increasingly complex and the iteration frequency is increasing day by day, resulting in a low stress testing efficiency that highly depends on the stress testing methods of stress testing personnel and weak control over the stress testing quality, thus leading to low stress testing quality. Based on this, the system performance stress testing method of some embodiments of the present disclosure, first, generates a performance stress testing task corresponding to the target system according to the stress testing data, stress testing supervision value information, and stress testing script of the corresponding target system. Among them, the above stress testing supervision value information includes the pressure application concurrency number information and the resource utilization rate threshold information. Thus, a performance stress testing task can be automatically generated. Then, in response to determining the execution of the above performance stress testing task, the following steps are performed according to the above pressure application concurrency number information and the above resource utilization rate threshold information: First, the target system is pressurized according to the above pressure application concurrency number information. Thus, automatic pressurization can be achieved after the performance stress testing task is executed for automatic testing. Second, in response to determining that the resource utilization rate information of the above target system meets the preset extreme stress testing condition, a performance stress testing report corresponding to the above target system is generated. Among them, the above preset extreme stress testing condition corresponds to the above resource utilization rate threshold information. Thus, when the resource utilization rate information of the system meets the preset extreme stress testing condition, the pressurization can be automatically stopped and the stress testing report can be generated, so that the performance indicators of the system under certain extreme testing conditions can be automatically recorded. Also, because the performance stress testing task is automatically created by the script and the pressurization is also automatically achieved, the stress testing method that depends on the stress testing personnel can be avoided, thereby improving the stress testing efficiency and stress testing quality of the system performance.

[0061] For further reference Figure 3 , which shows the flow 300 of some other embodiments of the system performance stress testing method. The flow 300 of the system performance stress testing method includes the following steps:

[0062] Step 301, generate a performance stress testing task corresponding to the target system according to the stress testing data, stress testing supervision value information, and stress testing script of the corresponding target system.

[0063] In some embodiments, the specific implementation and the technical effects brought by step 301 can be referred to Figure 2 step 201 in the corresponding embodiments, which will not be elaborated here.

[0064] The above pressure application concurrency information may include a first concurrency number. The first concurrency number may represent applying pressure to the first concurrency number of concurrencies. The above resource utilization threshold information may include a first resource utilization threshold. The above pressure application concurrency information may further include a second concurrency number. The above resource utilization threshold information may further include a second resource utilization threshold. For example, the first resource utilization threshold and the second resource utilization threshold may be thresholds of CPU usage. Here, there is no limitation on the resource type defined by the first resource utilization threshold and the second resource utilization threshold. The above second concurrency number is less than or equal to the above first concurrency number. The above second resource utilization threshold is greater than the above first resource utilization threshold.

[0065] Here, the value range of the first concurrency number can be [1, 10], which is used for automatic intelligent pressure application in the first stage. The value range of the second concurrency number can be [1, 3], which is used for automatic intelligent pressure application in the second stage. The first resource utilization threshold may represent the demarcation line for pressure application in the first stage and the second stage. For example, the first resource utilization threshold can be set to 70%. The second resource utilization threshold may represent the maximum value of the resource utilization (such as CPU usage or memory usage) after pressure application in the second stage. For example, the second resource utilization threshold can be set to 85%. It should be noted that the setting of the first resource utilization threshold and the second resource utilization threshold needs to be strictly dependent on the system capabilities. Different systems have different differences in the thresholds of system limits. The purpose of setting this value is to find the performance bottleneck of the system when the resource utilization is expected to be the highest, so as to perform reasonable monitoring threshold setting or optimization. Reasonable threshold setting means that the system is still available before the system reaches the threshold, but if it is above this threshold, the availability of the system will decrease. The purpose of extreme stress testing is to study this threshold of the system. Through performance adaptive extreme stress testing, the present invention can efficiently and accurately identify the system bottleneck of the current system, reduce costs and increase efficiency, and at the same time provide authoritative stress test data support for the availability of the system.

[0066] Step 302, in response to determining the execution of the performance stress test task, according to the pressure application concurrency information and the resource utilization threshold information, perform the following steps:

[0067] Step 3021, determine whether the current resource utilization of the target system is greater than or equal to the first resource utilization threshold.

[0068] In some embodiments, the execution subject of the system performance stress test method (such as Figure 1The server shown can determine whether the current resource utilization rate of the target system is greater than or equal to the first resource utilization rate threshold. For example, the resource utilization rate can be the CPU usage rate. Here, the resource type of the resource utilization rate is not limited. The initial concurrency number information of the target system is a preset concurrency number. The preset concurrency number can be 1 concurrency.

[0069] Step 3022, in response to determining that the current resource utilization rate of the target system is less than the first resource utilization rate threshold, perform the following first pressurization step according to the first concurrency number:

[0070] Step 30221, pressurize the target system according to the first concurrency number.

[0071] In some embodiments, the execution entity can pressurize the target system according to the first concurrency number. In practice, the execution entity can increase the first concurrency number of concurrencies on the basis of the current concurrency number of the target system to pressurize the target system.

[0072] In some optional implementation manners of some embodiments, the execution entity can determine the pressurization interval duration. Wherein, the pressurization interval duration can be the time interval since the last pressurization. The initial value of the pressurization interval duration is 0. Then, in response to determining that the pressurization interval duration is greater than or equal to the preset duration, pressurize the target system according to the first concurrency number. For example, the preset duration can be 2 minutes. Thus, pressurization can be performed every preset duration, so that the system is in a stable request state every time after pressurization and before the next pressurization.

[0073] Step 30222, determine the current resource utilization rate of the target system as the first resource utilization rate.

[0074] In some embodiments, the execution entity can determine the current resource utilization rate of the target system as the first resource utilization rate.

[0075] Step 30223, in response to determining that the first resource utilization rate is less than the first resource utilization rate threshold, perform the first pressurization step again according to the current concurrency number information of the target system.

[0076] In some embodiments, the execution entity can, in response to determining that the first resource utilization rate is less than the first resource utilization rate threshold, perform the first pressurization step again according to the current concurrency number information of the target system. Wherein, the current concurrency number information can include the current concurrency number of the target system.

[0077] Step 3023, in response to determining that the first resource utilization rate is greater than or equal to the first resource utilization rate threshold, perform the following second pressurization steps according to the second concurrency number:

[0078] Step 30231, pressurize the target system according to the second concurrency number.

[0079] In some embodiments, the above-mentioned execution entity may pressurize the above-mentioned target system according to the above-mentioned second concurrency number. In practice, the above-mentioned execution entity may increase the above-mentioned second concurrency number on the basis of the current concurrency number of the above-mentioned target system to pressurize the above-mentioned target system.

[0080] Step 30232, determine the current resource utilization rate of the target system as the second resource utilization rate.

[0081] In some embodiments, the above-mentioned execution entity may determine the current resource utilization rate of the above-mentioned target system as the second resource utilization rate.

[0082] Step 30233, in response to determining that the second resource utilization rate is less than the second resource utilization rate threshold, perform the second pressurization steps again according to the current concurrency number information of the target system.

[0083] In some embodiments, the above-mentioned execution entity may, in response to determining that the above-mentioned second resource utilization rate is less than the above-mentioned second resource utilization rate threshold, perform the above-mentioned second pressurization steps again according to the above-mentioned current concurrency number information of the above-mentioned target system.

[0084] Optionally, the above-mentioned execution entity may also, in response to determining that the above-mentioned second resource utilization rate is greater than or equal to the above-mentioned second resource utilization rate threshold, determine that the resource utilization rate information of the above-mentioned target system meets the preset extreme stress test condition.

[0085] Optionally, the above-mentioned execution entity may also determine whether the above-mentioned second resource utilization rate is greater than or equal to a preset extreme utilization rate. Wherein, the above-mentioned preset extreme utilization rate is greater than the above-mentioned second resource utilization rate threshold. For example, the above-mentioned preset extreme utilization rate may be 95%. Then, in response to determining that the above-mentioned second resource utilization rate is greater than or equal to the above-mentioned preset extreme utilization rate, the above-mentioned target system may be depressurized according to the current concurrency number information of the above-mentioned target system.

[0086] In some alternative implementation manners of some embodiments, the above-mentioned execution entity may perform the following depressurization steps according to the current concurrency number information of the above-mentioned target system:

[0087] The first step is to decompress the target system according to the preset decompression concurrency number. The preset decompression concurrency number may be 1 concurrency. In practice, the execution subject may decompress the target system by subtracting the preset decompression concurrency number from the current concurrency number of the target system.

[0088] In the second step, the current resource utilization information of the target system is determined as the third resource utilization information.

[0089] In the third step, in response to determining that the third resource utilization information is greater than or equal to the preset limit utilization, the decompression step is performed again according to the current concurrency information of the target system. The closer to the system bottleneck, the greater the impact of the pressure increase on the machine, so the decompression process can avoid the value of the second stage pressure setting from causing the machine to hang up.

[0090] Step 3024, in response to determining that the resource utilization information of the target system meets the preset extreme stress testing condition, generate a performance stress testing report corresponding to the target system.

[0091] In some embodiments, the specific implementation of step 3024 and the technical effects brought about can be referred to Figure 2 The corresponding step 2022 in the embodiments will not be described in detail here.

[0092] from Figure 3 It can be seen that Figure 2 Compared with the description of some corresponding embodiments, Figure 3 The process 300 of the system performance stress testing method in some corresponding embodiments reflects the steps of expanding the stress processing. Therefore, the scheme described in these embodiments can perform two-stage intelligent stress testing with performance adaptation. The first stage of automatic intelligent stress testing improves the stress testing efficiency, and the second stage of automatic intelligent stress testing ensures the effectiveness of stress testing, prevents system crashes caused by the stress testing amount in the first stage, and ensures the adaptability of system performance.

[0093] Further references Figure 4 As an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a system performance stress measurement device. These device embodiments are similar to Figure 2 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices.

[0094] like Figure 4As shown, the system performance stress testing device 400 of some embodiments includes: a generating unit 401 and an executing unit 402. Among them, the generating unit 401 is configured to generate a performance stress testing task for the corresponding target system according to the stress testing data, stress testing supervision value information, and stress testing script of the corresponding target system. Among them, the stress testing supervision value information includes pressurization concurrency number information and resource utilization rate threshold information; the executing unit 402 is configured to, in response to determining the execution of the performance stress testing task, according to the pressurization concurrency number information and the resource utilization rate threshold information, perform the following steps: pressurize the target system according to the pressurization concurrency number information; in response to determining that the resource utilization rate information of the target system meets the preset extreme stress testing condition, generate a performance stress testing report for the corresponding target system, where the preset extreme stress testing condition corresponds to the resource utilization rate threshold information.

[0095] Optionally, the executing unit 402 may include: a re-executing unit (not shown in the figure), configured to, in response to determining that the resource utilization rate information does not meet the preset extreme stress testing condition, re-execute the above steps according to the current concurrency number information of the target system.

[0096] Optionally, the pressurization concurrency number information includes a first concurrency number, and the resource utilization rate threshold information includes a first resource utilization rate threshold.

[0097] Optionally, the executing unit 402 may be further configured to: determine whether the current resource utilization rate of the target system is greater than or equal to the first resource utilization rate threshold, where the initial concurrency number information of the target system is a preset concurrency number; in response to determining that the current resource utilization rate of the target system is less than the first resource utilization rate threshold, perform the following first pressurization step according to the first concurrency number: pressurize the target system according to the first concurrency number; determine the current resource utilization rate of the target system as the first resource utilization rate; in response to determining that the first resource utilization rate is less than the first resource utilization rate threshold, re-execute the above first pressurization step according to the current concurrency number information of the target system.

[0098] Optionally, the pressurization concurrency number information further includes a second concurrency number, the resource utilization rate threshold information further includes a second resource utilization rate threshold, the second concurrency number is less than or equal to the first concurrency number, and the second resource utilization rate threshold is greater than the first resource utilization rate threshold.

[0099] Optionally, the execution unit 402 may further be configured to: in response to determining that the above-mentioned first resource utilization rate is greater than or equal to the above-mentioned first resource utilization rate threshold, perform the following second pressurization step according to the above-mentioned second concurrency number: pressurize the above-mentioned target system according to the above-mentioned second concurrency number; determine the current resource utilization rate of the above-mentioned target system as the second resource utilization rate; in response to determining that the above-mentioned second resource utilization rate is less than the above-mentioned second resource utilization rate threshold, perform the above-mentioned second pressurization step again according to the current concurrency number information of the above-mentioned target system.

[0100] Optionally, the execution unit 402 may further be configured to: in response to determining that the above-mentioned second resource utilization rate is greater than or equal to the above-mentioned second resource utilization rate threshold, determine that the resource utilization rate information of the above-mentioned target system meets the preset extreme stress test condition.

[0101] Optionally, the execution unit 402 may further be configured to: determine whether the above-mentioned second resource utilization rate is greater than or equal to a preset extreme utilization rate, where the above-mentioned preset extreme utilization rate is greater than the above-mentioned second resource utilization rate threshold; in response to determining that the above-mentioned second resource utilization rate is greater than or equal to the above-mentioned preset extreme utilization rate, perform a decompression process on the above-mentioned target system according to the current concurrency number information of the above-mentioned target system.

[0102] Optionally, the execution unit 402 may further be configured to: determine the pressurization interval duration; in response to determining that the above-mentioned pressurization interval duration is greater than or equal to a preset duration, pressurize the above-mentioned target system according to the above-mentioned first concurrency number.

[0103] Optionally, the execution unit 402 may further be configured to: perform the following decompression step according to the current concurrency number information of the above-mentioned target system: decompress the above-mentioned target system according to a preset decompression concurrency number; determine the current resource utilization rate information of the above-mentioned target system as the third resource utilization rate information; in response to determining that the above-mentioned third resource utilization rate information is greater than or equal to the above-mentioned preset extreme utilization rate, perform the above-mentioned decompression step again according to the current concurrency number information of the above-mentioned target system.

[0104] It can be understood that the various units described in the apparatus 400 correspond to the respective steps in the method described with reference to Figure 2 Therefore, the operations, features, and beneficial effects described above for the method also apply to the apparatus 400 and the units included therein, and will not be repeated here.

[0105] Next, with reference to Figure 5 which shows a schematic structural diagram of an electronic device 500 (such as Figure 1 the server in Figure 5The illustrated electronic device is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present disclosure.

[0106] As Figure 5 shown, the electronic device 500 may include a processing device 501 (such as a central processing unit, a graphics processing unit, etc.), which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0107] Generally, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 5 the electronic device 500 with various devices is shown, it should be understood that it is not required to implement or include all the shown devices. More or fewer devices may be alternatively implemented or included. Figure 5 Each block shown in

[0108] particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program codes for performing the methods shown in the flowcharts. In such some embodiments, the computer program may be downloaded and installed from a network via the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the methods of some embodiments of the present disclosure are performed.

[0109] It should be noted that the computer-readable media described in some embodiments of the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, which can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0110] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or future-developed networks.

[0111] The above computer-readable medium may be included in the above electronic device; or may exist separately without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the electronic device, the electronic device is caused to: generate a performance stress test task for the above target system according to the stress test data, stress test supervision value information, and stress test script corresponding to the target system, wherein the above stress test supervision value information includes pressurization concurrency number information and resource utilization rate threshold information; in response to determining that the above performance stress test task is executed, according to the above pressurization concurrency number information and the above resource utilization rate threshold information, perform the following steps: perform pressurization processing on the above target system according to the above pressurization concurrency number information; in response to determining that the resource utilization rate information of the above target system meets a preset extreme stress test condition, generate a performance stress test report for the above target system, wherein the above preset extreme stress test condition corresponds to the above resource utilization rate threshold information.

[0112] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages or combinations thereof. The above programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and also include conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, execute as a stand-alone software package, execute partially on the user's computer and partially on a remote computer, or execute entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (for example, by connecting through the Internet service provider via the Internet).

[0113] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the block may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0114] The units described in some embodiments of the present disclosure can be implemented in software or in hardware. The described units can also be provided in a processor. For example, it can be described as: a processor includes a generating unit and an executing unit. Among them, the names of these units do not constitute a limitation to the unit itself in some cases. For example, the generating unit can also be described as "a unit that generates a performance stress test task for the corresponding target system according to the stress test data, stress test supervision value information, and stress test script of the corresponding target system".

[0115] The functions described above herein can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logic Device (CPLD), and so on.

[0116] Some embodiments of the present disclosure also provide a computer program product, including a computer program, which when executed by a processor, implements any one of the above system performance stress test methods.

[0117] The above description is only some preferred embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the technical solutions formed by mutually replacing the above features with the (but not limited to) technical features having similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A method for stress testing system performance, comprising: generating a performance stress testing task for the target system according to the stress testing data, stress testing supervision value information, and stress testing script corresponding to the target system, wherein the stress testing supervision value information includes pressurization concurrency number information and resource utilization rate threshold information; in response to determining the execution of the performance stress testing task, according to the pressurization concurrency number information and the resource utilization rate threshold information, performing the following steps: pressurizing the target system according to the pressurization concurrency number information; in response to determining that the resource utilization rate information of the target system meets the preset extreme stress testing condition, generating a performance stress testing report for the target system, wherein the preset extreme stress testing condition corresponds to the resource utilization rate threshold information.

2. The method according to claim 1, wherein, after pressurizing the target system according to the pressurization concurrency number information, the method further includes: in response to determining that the resource utilization rate information does not meet the preset extreme stress testing condition, according to the current concurrency number information of the target system, performing the step again.

3. The method according to claim 1, wherein, the pressurization concurrency number information includes a first concurrency number, and the resource utilization rate threshold information includes a first resource utilization rate threshold; and pressurizing the target system according to the pressurization concurrency number information includes: determining whether the current resource utilization rate of the target system is greater than or equal to the first resource utilization rate threshold, wherein the initial concurrency number information of the target system is a preset concurrency number; in response to determining that the current resource utilization rate of the target system is less than the first resource utilization rate threshold, according to the first concurrency number, performing the following first pressurization step: pressurizing the target system according to the first concurrency number; determining the current resource utilization rate of the target system as the first resource utilization rate; in response to determining that the first resource utilization rate is less than the first resource utilization rate threshold, according to the current concurrency number information of the target system, performing the first pressurization step again.

4. The method according to claim 3, wherein, the pressurization concurrency number information further includes a second concurrency number, the resource utilization rate threshold information further includes a second resource utilization rate threshold, the second concurrency number is less than or equal to the first concurrency number, and the second resource utilization rate threshold is greater than the first resource utilization rate threshold; and after determining the current resource utilization rate of the target system as the first resource utilization rate, the method further includes: in response to determining that the first resource utilization rate is greater than or equal to the first resource utilization rate threshold, according to the second concurrency number, performing the following second pressurization step: pressurizing the target system according to the second concurrency number; determining the current resource utilization rate of the target system as the second resource utilization rate; in response to determining that the second resource utilization rate is less than the second resource utilization rate threshold, according to the current concurrency number information of the target system, performing the second pressurization step again.

5. The method according to claim 4, wherein, After determining the current resource utilization rate of the target system as the second resource utilization rate, the method further includes: In response to determining that the second resource utilization rate is greater than or equal to the second resource utilization rate threshold, determining that the resource utilization rate information of the target system meets the preset extreme stress test condition.

6. The method according to claim 5, wherein, the method further includes: Determining whether the second resource utilization rate is greater than or equal to a preset extreme utilization rate, where the preset extreme utilization rate is greater than the second resource utilization rate threshold; In response to determining that the second resource utilization rate is greater than or equal to the preset extreme utilization rate, performing a decompression process on the target system according to the current concurrency number information of the target system.

7. The method according to claim 3, wherein, The performing a pressurization process on the target system according to the first concurrency number includes: Determining the pressurization interval duration; In response to determining that the pressurization interval duration is greater than or equal to a preset duration, performing a pressurization process on the target system according to the first concurrency number.

8. The method according to claim 6, wherein, The performing a decompression process on the target system according to the current concurrency number information of the target system includes: Performing the following decompression steps according to the current concurrency number information of the target system: Performing a decompression process on the target system according to a preset decompression concurrency number; Determining the current resource utilization rate information of the target system as the third resource utilization rate information; In response to determining that the third resource utilization rate information is greater than or equal to the preset extreme utilization rate, performing the decompression step again according to the current concurrency number information of the target system.

9. A system performance stress test device, including: A generation unit configured to generate a performance stress test task for the corresponding target system according to the stress test data, stress test supervision value information, and stress test script of the corresponding target system, where the stress test supervision value information includes pressurization concurrency number information and resource utilization rate threshold information; An execution unit configured to, in response to determining that the performance stress test task is executed, perform the following steps according to the pressurization concurrency number information and the resource utilization rate threshold information: performing a pressurization process on the target system according to the pressurization concurrency number information; and generating a performance stress test report for the corresponding target system in response to determining that the resource utilization rate information of the target system meets the preset extreme stress test condition, where the preset extreme stress test condition corresponds to the resource utilization rate threshold information.

10. An electronic device, including: One or more processors; A storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, causing the one or more processors to implement the method according to any one of claims 1-8.

11. A computer-readable medium having a computer program stored thereon, wherein, The computer program, when executed by a processor, implements the method according to any one of claims 1-8.

12. A computer program product including a computer program that, when executed by a processor, implements the method according to any one of claims 1-8.

Images