A method and device for determining system pressure bearing capacity value
Through iterative testing methods, testing pressure is generated based on the performance indicators and actual parameters of the system under test, which solves the time-consuming and labor-consuming problems caused by manual dependence in the existing technology, and improves the testing accuracy and efficiency of the system's pressure-bearing capacity. .
Patent Information
- Application Number
- CN201910193833.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-03-14
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2039-03-14
AI Technical Summary
The prior art relies on manual monitoring and analysis when determining the system pressure bearing capacity value, resulting in time-consuming and labor-consuming, high error rate, poor test repeatability, low efficiency and low accuracy.
Through the iterative testing method, test pressure is generated based on the expected parameters and actual parameters of the performance indicators of the system under test, and the actual parameters are updated until the expected parameters match the actual parameters to determine the pressure bearing capacity value of the system. The method includes judging the system type, establishing a model or determining preset parameters, generating test pressure, updating parameters, and adjusting the pressure adjustment parameters through deviation values until a match is reached.
It improves the accuracy of testing pressure, saves time and cost, improves the efficiency of determining the system's pressure bearing capacity, and avoids errors and repeatability problems caused by artificial dependence.
Smart Images

Figure CN111694717B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a method and device for determining a system pressure bearing capacity value. Background Art
[0002] The existing technology can only determine the system pressure bearing capacity value based on established parameters. In production, the pressure bearing capacity is often determined based on performance indicators. In order to achieve the set performance indicators, it is necessary to continuously adjust the pressure adjustment parameters. The existing technology can only gradually adjust the pressure adjustment parameters through manual monitoring and manual analysis to adjust the pressure.
[0003] In the process of implementing the present invention, the inventors found that there are at least the following problems in the prior art:
[0004] 1. The monitoring and analysis of performance indicators all rely on manual work, which is time-consuming and labor-intensive, prone to errors, and has poor test repeatability.
[0005] 2. The pressure generated by the existing technology cannot be dynamically adjusted according to the actual operating status, and the efficiency is low, the result deviation is large, and the accuracy is low. Summary of the invention
[0006] In view of this, an embodiment of the present invention provides a method for determining the pressure bearing capacity value of the system, which can avoid the technical defects of the existing technology that it relies entirely on manual labor, is prone to errors, has poor test repeatability, low efficiency and low accuracy, and thus achieves the beneficial effects of improving the accuracy of adjusting the test pressure, saving time costs, and improving the efficiency of determining the pressure bearing capacity of the system.
[0007] To achieve the above object, according to one aspect of an embodiment of the present invention, a method for determining a system pressure bearing capacity value is provided, comprising:
[0008] A. Determine the expected parameters of the performance indicators of the system under test;
[0009] B. generating test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test;
[0010] C. Applying the test pressure to the system under test to update actual parameters of the performance indicators of the system under test;
[0011] D. Repeat steps B and C until the actual parameters match the expected parameters. When the actual parameters match the expected parameters, the final test pressure for the system under test is the system pressure bearing capacity value.
[0012] Optionally, before determining the expected parameters of the performance indicators of the system under test, the following steps are included:
[0013] Determine the type of system being tested;
[0014] When the type of the tested system is an iterative system, a model is established based on the operational data to obtain expected parameters;
[0015] When the type of the tested system is a completely new system, the preset parameters are determined according to historical experience values and / or standard values of the relevant system.
[0016] Optionally, the performance indicator of the system under test includes at least one of the following: resource usage data, throughput per unit time, transaction success rate, response time;
[0017] The resource usage data includes: CPU usage data and memory usage data.
[0018] Optionally, generating a test pressure according to the expected parameters and actual parameters of the performance indicator of the system under test includes:
[0019] Determining a deviation value between the expected parameter and an actual parameter of the performance indicator of the system under test;
[0020] Determining a pressure adjustment parameter according to the deviation value;
[0021] A test pressure is generated according to the pressure adjustment parameter.
[0022] Determining the pressure adjustment parameters according to the deviation value includes:
[0023] Determine whether the deviation value is within a first deviation range; if so, do not change the pressure adjustment parameter; if not, determine whether the deviation value is within a second deviation range;
[0024] If so, increase the step size of the pressure regulation parameter and / or shorten the monitoring period; if not, determine whether the sign of the deviation value changes; if so, change the sign of the pressure regulation parameter and / or reduce the step size of the pressure regulation parameter.
[0025] Optionally, before updating the actual parameters of the performance indicator of the system under test and after generating the test pressure, the method includes:
[0026] The pressure performance parameter is used in the pressure generation module to assist the pressure generator in the pressure generation module to generate the test pressure.
[0027] Optionally, the expected parameters include: an expected value and an expected deviation range.
[0028] Optionally, the step of repeatedly iterating step B and step C until the actual parameter matches the expected parameter comprises:
[0029] If the deviation value between the actual parameter and the expected parameter is within the preset deviation range for n consecutive times, the actual parameter matches the expected parameter;
[0030] The n is a preset number of iterations.
[0031] According to another aspect of an embodiment of the present invention, there is provided a device for determining a system pressure bearing capacity value, comprising:
[0032] An expected parameter determination module, used to determine expected parameters of the performance indicators of the system under test;
[0033] A pressure generating module, used for generating a test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test;
[0034] An actual parameter updating module, used for applying the test pressure to the system under test and updating the actual parameters of the performance indicators of the system under test;
[0035] The system pressure bearing capacity determination module is used to repeatedly iterate step B and step C until the actual parameters match the expected parameters; when the actual parameters match the expected parameters, the test pressure finally used for the system under test is the system pressure bearing capacity value.
[0036] According to another aspect of an embodiment of the present invention, there is provided an electronic device for determining a system pressure bearing capacity value, comprising:
[0037] one or more processors;
[0038] a storage device for storing one or more programs,
[0039] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for determining the system pressure bearing capacity value provided by the present invention.
[0040] According to another aspect of an embodiment of the present invention, a computer-readable medium is provided, on which a computer program is stored, and when the program is executed by a processor, the method for determining a system pressure bearing capacity value provided by the present invention is implemented.
[0041] One embodiment of the above invention has the following advantages or beneficial effects:
[0042] The present invention uses the technical means of iteratively testing the actual parameters and expected parameters of the performance indicators of the system under test, avoiding the technical defects of the prior art that all rely on manual labor, are time-consuming and labor-intensive, are prone to errors, have poor test repeatability, are inefficient, and have low precision, thereby achieving the beneficial effects of improving the accuracy of adjusting the test pressure, saving time costs, and improving the efficiency of determining the pressure-bearing capacity of the system.
[0043] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with specific implementation examples. BRIEF DESCRIPTION OF THE DRAWINGS
[0044] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.
[0045] Figure 1 is a schematic diagram of the main process of a method for determining a system pressure bearing capacity value according to an embodiment of the present invention;
[0046] Figure 2 is a general flow chart of determining a system pressure bearing capacity value according to an embodiment of the present invention;
[0047] Figure 3 is an architectural diagram for determining a system pressure bearing capacity value according to an embodiment of the present invention;
[0048] Figure 4 is a flowchart of a specific implementation method of determining a system pressure bearing capacity value according to an embodiment of the present invention;
[0049] Figure 5 is a schematic diagram of main modules of an apparatus for determining a system pressure bearing capacity value according to an embodiment of the present invention;
[0050] Figure 6 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;
[0051] Figure 7 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION
[0052] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0053] Figure 1 FIG. 4 is a schematic diagram of a main flow chart of a method for determining a system pressure bearing capacity value according to an embodiment of the present invention. Figure 1 As shown, including:
[0054] A. Determine the expected parameters of the performance indicators of the system under test;
[0055] B. generating test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test;
[0056] C. Applying the test pressure to the system under test to update actual parameters of the performance indicators of the system under test;
[0057] D. Repeat steps B and C until the actual parameters match the expected parameters. When the actual parameters match the expected parameters, the final test pressure for the system under test is the system pressure bearing capacity value.
[0058] When determining the system pressure bearing capacity value, it is necessary to focus on the performance indicators and determine the expected parameters corresponding to the performance indicators.
[0059] Before determining the expected parameters of the performance indicators of the system under test, the following are included:
[0060] Determine the type of system being tested;
[0061] When the type of the tested system is an iterative system, it is possible to verify whether the performance indicators of the tested system (the performance indicators include but are not limited to: query rate per second QPS, average response time Latency, CPU usage, memory usage ratio) meet the expected requirements. The expected parameters of the performance indicators are generally based on existing indicators, and can be derived by building a model for online operational data, such as the average response time (Latency) TP99 is less than 20ms, the CPU usage is less than 50%, and the memory is less than 1G. The preset parameters can be directly set according to the modeling results;
[0062] Since a new system may not have online operation data, the preset parameters of performance indicators can be formulated based on historical experience or industry standards. Specifically, when the CPU usage rate is higher than 70%, the system performance will enter the nonlinear zone, so 70% can be used as a performance indicator; for example, the latency of querying redis data should be kept at the millisecond level, so the latency can be set at 5-10ms as the preset parameter.
[0063] When the performance indicator is the utilization rate of the central processing unit (CPU), the corresponding expected value can be set to 60%, and the allowed expected deviation range is 5%. That is, it is necessary to determine the pressure bearing capacity value of the system when the CPU utilization rate of the system is 55%-65%.
[0064] In the prior art, when determining the pressure bearing capacity of a system, it is necessary to manually adjust the pressure acting on the system under test. Generally, the time for manual adjustment is relatively long, which may take a week.
[0065] However, the present invention uses the technical means of iteratively testing the actual parameters and expected parameters of the performance indicators of the system under test, and can feedback the difference between the actual parameters and the expected parameters during each iteration, thereby achieving the beneficial effects of improving the accuracy of adjusting the test pressure, saving time costs, and improving the efficiency of determining the pressure bearing capacity of the system.
[0066] When the difference between the actual feedback parameters and the expected parameters is large, the technical solution can adjust the test pressure by a larger amplitude; when the difference between the actual feedback parameters and the expected parameters is small, the test pressure can be adjusted by a smaller amplitude, thereby improving the test accuracy while saving time costs.
[0067] The technical solution of the present invention is also universal and can be used in a variety of application scenarios, avoiding the technical defect of the prior art that the test parameters need to be reconfigured when the test environment is changed, thereby achieving a technical effect with good universality.
[0068] Optionally, the performance indicators of the system under test are determined according to actual needs, including but not limited to one of the following: resource usage data, throughput per unit time, transaction success rate, response time; wherein the resource usage data may include: central processing unit usage data, memory usage data, etc.
[0069] In an optional embodiment of the present invention, generating a test pressure according to the expected parameters and actual parameters of the performance indicator of the system under test includes:
[0070] Determine the deviation value between the expected parameter and the actual parameter of the performance indicator of the system under test; determine the pressure adjustment parameter according to the deviation value; and generate the test pressure according to the pressure adjustment parameter.
[0071] Specifically, the size of the deviation value affects the size of the pressure adjustment parameter. The larger the deviation value, the larger the corresponding pressure adjustment parameter. When the technical solution performs iterative feedback, the larger the value of the pressure adjustment parameter, the greater the change in the generated test pressure relative to the test pressure generated before the iteration. By iteratively changing the pressure adjustment parameter, the technical effect of efficiently adjusting the test pressure can be achieved.
[0072] Specifically, when the iterative step B is repeated, the pressure adjustment parameter is determined according to the deviation value, including:
[0073] Determine whether the deviation value is within the first deviation range; if so, do not change the pressure adjustment parameter. That is, when the deviation value is within the first deviation range, the test pressure is close to the system pressure bearing capacity of the system to be tested under the set performance index. The first deviation range is the expected deviation range.
[0074] Optionally, a conclusion on a specific numerical point of the system's pressure bearing capacity can be drawn through multiple iterations of feedback. Specifically, if the deviation between the actual parameter and the expected parameter is within a preset deviation range for n consecutive times, the actual parameter matches the expected parameter; n is a preset number of iterations.
[0075] If the deviation value is not within the first deviation range, determining whether the deviation value is within the second deviation range; if so, increasing the step size of the pressure adjustment parameter and / or shortening the monitoring period;
[0076] The second deviation range refers to a range that is not within the preset deviation range, but is not particularly different from the preset deviation range. When the deviation value is within the second deviation range, coarse-grained adjustment can be performed by adjusting the step size of the parameter. By coarse-grained adjustment of the pressure adjustment parameters, the test pressure can be adjusted to a greater extent, thereby improving the efficiency of determining the system's pressure bearing capacity value. Since increasing the step size of the pressure adjustment parameter will accelerate the rate of change of the test pressure, technical means of shortening the monitoring cycle can be used to monitor the system under test in real time, thereby improving the efficiency of iterative feedback.
[0077] If the deviation value is not within the second deviation range, it means that the corresponding deviation is large. Optionally, it is determined whether the sign of the deviation value changes; if so, the sign of the pressure adjustment parameter is changed and / or the step size of the pressure adjustment parameter is reduced.
[0078] Optionally, before updating the actual parameters of the performance indicator of the system under test and after generating the test pressure, the method includes:
[0079] The pressure performance parameter is used in the pressure generation module to assist the pressure generator in the pressure generation module to generate the test pressure.
[0080] In actual production, the test pressure may be generated by a pressure generation cluster. The pressure generated by each pressure generator in the pressure generation cluster may be different. By collecting the pressure performance parameters of the pressure generators in the pressure generation cluster, it is convenient to adjust the pressure group when the test pressure is generated in a cyclic iteration, so as to generate the test pressure more stably.
[0081] Since the existing technology uses manual monitoring and analysis to determine the pressure bearing capacity value, it has high requirements on the accuracy of the collected data, the observation time and the experience of the analysts. As a result, when determining the pressure bearing capacity of the system, there are many human uncertain factors, which are prone to errors.
[0082] Figure 2 is a general flow chart of determining a system pressure bearing capacity value according to an embodiment of the present invention;
[0083] In order to achieve the set indicators, the control and regulation module needs to continuously adjust the pressure regulation parameters, and use the pressure regulation parameters to generate the test pressure for the system under test in the pressure generation module. The deviation value between the actual parameters fed back by the system under test and the expected parameters collected by the data acquisition module is used in the control and regulation module, which can further adjust the effect of the pressure regulation parameters, avoiding the problems of low test accuracy, long test time, poor test repeatability, etc. in the prior art, thereby achieving the technical effect of adaptively adjusting the test pressure.
[0084] Figure 2 The control and regulation module and data acquisition model in the system can be regarded as feedback control modules. The data acquisition model mainly collects the flow and capacity data of the system under test. The control and regulation module iterates the collected flow and capacity data and converges to the actual parameters fed back by the system under test to reach the expected parameters.
[0085] The pressure performance parameter may be used in a loop iteration to adjust the pressure generated by the pressure generation cluster in the iteration.
[0086] The solution of the present invention is described in detail below with reference to a specific embodiment.
[0087] Figure 3 is an architectural diagram for determining a system pressure bearing capacity value according to an embodiment of the present invention; Figure 3 In the test, there are mainly three parts: the system under test part, the pressure cluster part and the control part.
[0088] In this embodiment, a data acquisition agent is deployed on each part to receive and process instructions from the control center.
[0089] The control part is responsible for adaptively determining the size of the pressure adjustment parameters and the scheduling of the pressure generation cluster. The control part is mainly composed of a data acquisition module, a performance indicator module, an adjustment algorithm, and an adjustment instruction issuing module. The main logic of the control part is:
[0090] S301, sending instructions to the pressure generation cluster and the system under test through the adjustment instruction issuing module, initializing the pressure cluster, and starting monitoring of resources and traffic of the system under test;
[0091] S302, collecting actual parameters fed back by the system under test through a data acquisition module;
[0092] S303, determining the deviation between the actual parameter and the expected parameter of the performance indicator feedback of the measured system;
[0093] S304, according to the expected parameters, flow information and capacity information of the measured system, the pressure adjustment parameters are calculated by the adjustment algorithm;
[0094] S305, sending a pressure adjustment parameter instruction to the pressure cluster through the adjustment instruction issuing module, thereby adjusting the pressure;
[0095] S306, repeating steps S302 to S305 until the deviation between the actual parameter of the performance indicator and the expected parameter is within the expected error range for n consecutive times, where n is a set value.
[0096] The data acquisition agent on the pressure generation cluster can execute pressure initialization instructions, pressure adjustment instructions, pressure termination instructions, data acquisition instructions, data transmission, data aggregation, instruction transmission and other instructions.
[0097] Specifically, the workflow of the data collection agent is as follows:
[0098] S1. Periodically collect various performance data;
[0099] S2: Combine the collected data into a unified data format and transmit it to the control center master for decision making;
[0100] S3. Determine the adjustment parameters generated by the control center according to the summarized data;
[0101] S4, transmitting the adjustment parameters to each data acquisition agent in the form of instructions, waiting for the return result, and the return result is used to record the log; S5, receiving the instruction, parsing and executing the adjustment operation, and returning the result to the control center, thereby completing an adjustment.
[0102] The technical solution of the present invention is similarly described below with a specific embodiment:
[0103] Figure 4 It is a flowchart of a specific implementation method of determining the system pressure bearing capacity value according to an embodiment of the present invention.
[0104] The adjustment process includes the following steps:
[0105] S401, determining a deviation value e between an expected parameter and an actual parameter calculated within a time t;
[0106] S402, determine whether the deviation value e is within a preset range; if so, execute S404, if not, execute S403;
[0107] S404: The pressure test has entered a stable state. After entering a stable state, the sign of the pressure adjustment parameter does not change, the step length of the adjustment parameter is 0, and the monitoring period does not change. Then execute S406.
[0108] S406: Determine whether the value is still within the preset range in three consecutive loop iterations, and if so, end the test. If not, return to step S401.
[0109] S403, when the e is not within the preset range, determine whether the e exceeds 20% of the preset range; if so, execute S407, if not, execute S405;
[0110] S407, the pressure test enters the convergence state. After entering the convergence state, the sign of the pressure adjustment parameter does not change, the step length s of the adjustment parameter is doubled, and the monitoring period is shortened to half of the original;
[0111] S405, determine whether the sign of e has changed, if so, execute S408;
[0112] S408, the pressure test enters the oscillation state. After entering the oscillation state, the sign of the pressure adjustment parameter changes, the step length s of the adjustment parameter is reduced to half of the original, and the monitoring period remains unchanged.
[0113] Figure 5 Schematic diagram of the main modules of the apparatus for determining the system pressure bearing capacity value according to an embodiment of the present invention. Figure 5 As shown, a device 500 for determining a system pressure bearing capacity value is provided, comprising:
[0114] Module 501, an expected parameter determination module, is used to determine the expected parameters of the performance indicators of the system under test;
[0115] Module 502, a pressure generating module, is used to generate a test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test;
[0116] Module 503, an actual parameter updating module, used for applying the test pressure to the system under test and updating the actual parameters of the performance indicators of the system under test;
[0117] Module 504, a system pressure bearing capacity determination module, is used to iterate step B and step C repeatedly until the actual parameters match the expected parameters; when the actual parameters match the expected parameters, the test pressure finally used for the system under test is the system pressure bearing capacity value.
[0118] Figure 6 An exemplary system architecture 600 is shown to which the method for determining a system pressure bearing capacity value or the apparatus for determining a system pressure bearing capacity value according to the embodiments of the present invention can be applied.
[0119] like Figure 6As shown, system architecture 600 may include terminal devices 601, 602, 603, network 604 and server 605. Network 604 is used to provide a medium for communication links between terminal devices 601, 602, 603 and server 605. Network 604 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.
[0120] Users can use terminal devices 601, 602, and 603 to interact with server 605 through network 604 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 601, 602, and 603, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only examples).
[0121] The terminal devices 601 , 602 , and 603 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers, etc.
[0122] The server 605 may be a server that provides various services, such as a backend management server (only an example) that provides support for shopping websites browsed by users using the terminal devices 601, 602, and 603. The backend management server may analyze and process the received data such as product information query requests, and feed back the processing results (such as target push information, product information - only an example) to the terminal device.
[0123] It should be noted that the method for determining the system pressure bearing capacity value provided in the embodiment of the present invention is generally executed by the server 605 , and accordingly, the device for determining the system pressure bearing capacity value is generally set in the server 605 .
[0124] It should be understood that Figure 6 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to the implementation requirements.
[0125] Reference below Figure 7 , which shows a schematic diagram of the structure of a computer system 700 of a terminal device suitable for implementing an embodiment of the present invention. Figure 7 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0126] like Figure 7As shown, the computer system 700 includes a central processing module (CPU) 701, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 702 or the program loaded from the storage part 708 to the random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the system 700 are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.
[0127] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.
[0128] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the central processing module (CPU) 701, the above-mentioned functions defined in the system of the present invention are executed.
[0129] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0130] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0131] The modules involved in the embodiments of the present invention may be implemented by software or hardware. The modules described may also be set in a processor. For example, they may be described as: a processor includes a sending module, an acquisition module, a determination module, and a first processing module. The names of these modules do not constitute a limitation on the modules themselves under certain data. For example, the sending module may also be described as a "module for sending a picture acquisition request to the connected server."
[0132] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes:
[0133] A. Determine the expected parameters of the performance indicators of the system under test;
[0134] B. generating test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test;
[0135] C. Applying the test pressure to the system under test to update actual parameters of the performance indicators of the system under test;
[0136] D. Repeat steps B and C until the actual parameters match the expected parameters. When the actual parameters match the expected parameters, the final test pressure for the system under test is the system pressure bearing capacity value.
[0137] According to the technical solution of the embodiment of the present invention, the following beneficial effects can be achieved:
[0138] The present invention uses the technical means of iteratively testing the actual parameters and expected parameters of the performance indicators of the system under test, avoiding the technical defects of the prior art that all rely on manual labor, are time-consuming and labor-intensive, are prone to errors, have poor test repeatability, are inefficient, and have low precision, thereby achieving the beneficial effects of improving the accuracy of adjusting the test pressure, saving time costs, and improving the efficiency of determining the pressure-bearing capacity of the system.
[0139] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. A method for determining a system pressure bearing capacity value, characterized in that: include: A. Determine the expected parameters of the performance indicators of the system under test; B. generating test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test; C. Applying the test pressure to the system under test to update the actual parameters of the performance indicators of the system under test; wherein the test pressure is generated by a pressure generation cluster, and the pressure generated by each pressure generator in the pressure generation cluster is different; and there are multiple data acquisition agents on the pressure generation cluster; D. Repeat steps B and C until the actual parameters match the expected parameters. When the actual parameters match the expected parameters, the final test pressure for the system under test is the system pressure bearing capacity value. Generate test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test, including: Determining a deviation value between the expected parameter and an actual parameter of the performance indicator of the system under test; Determining a pressure adjustment parameter according to the deviation value; generating a test pressure according to the pressure adjustment parameter; Determining the pressure adjustment parameters according to the deviation value includes: Determine whether the deviation value is within a first deviation range; if so, do not change the pressure adjustment parameter; if not, determine whether the deviation value is within a second deviation range; If yes, increase the step size of the pressure adjustment parameter and / or shorten the monitoring period; if no, determine whether the sign of the deviation value changes; if yes, change the sign of the pressure adjustment parameter and / or reduce the step size of the pressure adjustment parameter; Applying the test pressure to the system under test includes: merging various types of performance data collected into a unified data format and transmitting them to the control center master to determine the control center to generate adjustment parameters; transmitting the adjustment parameters to each of the data collection agents in the form of instructions; each of the data collection agents receives the instructions, parses and executes the adjustment operation.
2. The method according to claim 1, characterized in that Before determining the expected parameters of the performance indicators of the system under test, including: Determine the type of system being tested; When the type of the tested system is an iterative system, a model is established based on the operational data to obtain expected parameters; When the type of the tested system is a completely new system, the preset parameters are determined according to historical experience values and / or standard values of the relevant system.
3. The method according to claim 1, characterized in that: The performance indicators of the system under test include at least one of the following: resource usage data, throughput per unit time, transaction success rate, and response time; The resource usage data includes: CPU usage data and memory usage data.
4. The method according to claim 1, characterized in that: Before the actual parameters of the performance indicator of the system under test are updated and after the test pressure is generated, the method includes: Determine pressure performance parameters; The pressure performance parameter is used in the pressure generation module to assist the pressure generator in the pressure generation module to generate the test pressure.
5. The method according to claim 4, characterized in that The expected parameters include: expected value and expected deviation range.
6. The method according to claim 5, characterized in that The step B and the step C are repeated until the actual parameters match the expected parameters, including: If the deviation value between the actual parameter and the expected parameter is within the preset deviation range for n consecutive times, the actual parameter matches the expected parameter; The n is a preset number of iterations.
7. A device for determining the pressure bearing capacity value of a system, characterized in that: include: An expected parameter determination module, used to determine expected parameters of the performance indicators of the system under test; A pressure generation module, used to generate test pressure according to the expected parameters and actual parameters of the performance indicators of the system under test; wherein the test pressure is generated by a pressure generation cluster, and the pressure generated by each pressure generator in the pressure generation cluster is different; and there are multiple data acquisition agents on the pressure generation cluster; An actual parameter updating module, used for applying the test pressure to the system under test and updating the actual parameters of the performance indicators of the system under test; A system pressure bearing capacity determination module is used to repeatedly iterate step B and step C until the actual parameters match the expected parameters; when the actual parameters match the expected parameters, the test pressure finally used for the system under test is the system pressure bearing capacity value; The pressure generating module is specifically used for: Determining a deviation value between the expected parameter and an actual parameter of the performance indicator of the system under test; Determining a pressure adjustment parameter according to the deviation value; generating a test pressure according to the pressure adjustment parameter; Determine whether the deviation value is within a first deviation range; if so, do not change the pressure adjustment parameter; if not, determine whether the deviation value is within a second deviation range; If yes, increase the step size of the pressure adjustment parameter and / or shorten the monitoring period; if no, determine whether the sign of the deviation value changes; if yes, change the sign of the pressure adjustment parameter and / or reduce the step size of the pressure adjustment parameter; The various types of performance data collected are combined into a unified data format and transmitted to the control center master to determine the control center to generate adjustment parameters; the adjustment parameters are transmitted to each data collection agent in the form of instructions; each data collection agent receives the instruction, parses and executes the adjustment operation.
8. An electronic device for determining a system pressure bearing capacity value, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.
9. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
System performance testing method and device, computer equipment and storage medium
CN108563544A
Pressure testing method and system, electronic equipment and readable storage medium
CN108874637A
Distributed pressure testing system and method
US20140298101A1
