A Method and System for Dynamic Feedback of System Performance Capacity

Abstract

The present invention provides a method and system for dynamically feedbacking system performance capacity, including comparing the change trend of the service capacity baseline with the change trend of the resource baseline. By subdividing the test requirements in dimensions such as service capacity, function point capacity, and resource capacity, multiple dimension measurement baselines such as the service capacity baseline, function point capacity baseline, and resource capacity baseline are evaluated to accurately measure and evaluate the baseline change problem caused by continuous iteration and changing business volume of the system. The present invention solves the problems of poor timeliness and limited referenceability of the performance capacity baseline caused by a single static baseline, and the problem of large error in evaluating the system capacity baseline when the production environment stress test conditions are not available.

Description

Technical Field

[0001] The present invention belongs to the field of software testing, and particularly relates to a system performance capacity dynamic feedback method and system. Background Art

[0002] The existing performance testing regular exit determination methods in the same industry usually rely on comparison with specified static values, which are often calculated based on resource capacity. In the era of microservices and cloud computing, resources are no longer a bottleneck, and the static value method has limitations. The existing performance testing regular exit determination methods in the Internet industry usually rely on peak multiple stress testing in the production environment, which is not applicable to the financial field with high compliance and security requirements. Summary of the Invention

[0003] The purpose of the present invention is to subdivide test requirements into dimensions such as business capacity, function point capacity, and resource capacity, evaluate multiple dimension measurement baselines such as business capacity baseline, function point capacity baseline, and resource capacity baseline, accurately measure and evaluate the baseline change problems caused by continuous iteration and changing business volume of the system, effectively reduce the production event incidence rate; regularly predict the trend of system performance capacity, and dynamically adjust the capacity baseline value.

[0004] To achieve the above purpose, the technical solutions adopted by the present invention include:

[0005] A system performance capacity dynamic feedback method, characterized by including:

[0006] Calculate and obtain the initial value of the business capacity baseline, update the initial value of the business capacity baseline on a monthly basis, and obtain the change trend of the business capacity baseline;

[0007] Calculate and obtain the initial value of the resource baseline, update the initial value of the resource baseline on a monthly basis, and obtain the change trend of the resource baseline;

[0008] Calculate and obtain the initial value of the transaction time-consuming baseline, and update the initial value of the transaction time-consuming baseline on a monthly basis;

[0009] Calculate and obtain the initial value of the function point baseline according to the initial value of the transaction time-consuming baseline, update the initial value of the function point baseline on a monthly basis, and obtain the change trend of the function point baseline;

[0010] Statistically analyze the change trends of ordinary trading days and peak trading days;

[0011] Compare the change trend of the business capacity baseline with the change trend of the resource baseline;

[0012] When the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline is greater than or equal to 80%, then adjust and increase the initial value of the resource baseline at least to make the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline less than 80%;

[0013] When the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline is less than 80%, further identify the fluctuation of the change trend of the function point baseline. If the fluctuation of the change trend of the function point baseline is greater than 20%, adjust the initial value of the function point baseline to the average value of the initial values of the corresponding function point baselines in the recent three months.

[0014] When the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline is greater than or equal to 80%, if adjusting and increasing the initial value of the resource baseline to make the resource reach the preset threshold still cannot make the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline less than 80%, an alarm is triggered.

[0015] If adjusting the initial value of the function point baseline to the average value of the initial values of the corresponding function point baselines in the recent three months makes the resource reach the preset threshold, an alarm is triggered.

[0016] Further, the calculation and acquisition of the initial value of the business capacity baseline include:

[0017] Obtain the transaction volume data in the most recent 12 months and the corresponding link server resource usage data;

[0018] Taking a month as a unit, after excluding the data of peak days and valley days, draw a histogram and take the median to obtain the monthly median;

[0019] Use the monthly medians corresponding to each month to draw a histogram and take the median to obtain the initial value of the business capacity baseline.

[0020] Further, the calculation and acquisition of the initial value of the resource baseline include:

[0021] Obtain the transaction volume data in the most recent 12 months and the corresponding link server resource usage data;

[0022] Taking a month as a unit, after excluding the data of peak days and valley days, draw a histogram and take the median to obtain the monthly median;

[0023] Use the monthly medians corresponding to each month to draw a histogram and take the median to obtain the initial value of the resource baseline.

[0024] Further, the calculation and acquisition of the initial value of the transaction time-consuming baseline include:

[0025] Obtain the data of the natural month with the largest transaction volume in the most recent 12 months, and identify ordinary trading days and peak trading days;

[0026] Extract all transactions, count the transaction time-consuming situation, draw a time-consuming distribution histogram and take the median to obtain the initial value of the transaction time-consuming baseline.

[0027] Further, the calculation and acquisition of the initial value of the function point baseline include:

[0028] Obtain all transactions in the natural month with the largest trading volume in the most recent 12 months;

[0029] Combine dynamic proxy technology to identify the transaction call path, record the call relationship and call times between path nodes, and together with the transaction time consumption, obtain the initial value of the function point baseline.

[0030] The present invention also relates to a system performance capacity dynamic feedback system, including an initial value calculation module and an initial value calculation module;

[0031] The initial value calculation module is used to calculate and obtain the initial value of the business capacity baseline, the initial value of the resource baseline, the initial value of the transaction time consumption baseline, and the initial value of the function point baseline;

[0032] The initial value calculation module is used to compare the change trend of the business capacity baseline with the change trend of the resource baseline and identify the fluctuations in the change trend of the function point baseline.

[0033] The present invention also relates to a computer-readable storage medium, characterized in that a computer program is stored on the storage medium, and when the computer program is executed by a processor, the above-mentioned method is implemented.

[0034] The present invention also relates to an electronic device, characterized in that it includes a processor and a memory;

[0035] The memory is used to store trading volume data and corresponding link server resource usage data;

[0036] The processor is used to call the trading volume data and the corresponding link server resource usage data.

[0037] The beneficial effects of the present invention are:

[0038] Using the system performance capacity dynamic feedback method and system of the present invention, by subdividing the test requirements in dimensions such as business capacity, function point capacity, and resource capacity, multiple dimension measurement baselines such as business capacity baseline, function point capacity baseline, and resource capacity baseline are evaluated, accurately measuring and evaluating the baseline change problems caused by continuous iteration and changing business volume of the system, effectively reducing the production event occurrence rate; regularly predicting the trend of system performance capacity, dynamically adjusting the capacity baseline value, automatically adjusting the baseline data value after tracking and analyzing according to the business capacity baseline, function point baseline, and resource baseline, assisting the system responsible person to make decisions to judge the system health degree, and effectively improving the accuracy of system capacity governance compared with the case where the present invention is not introduced. Brief Description of the Drawings

[0039] Figure 1 It is a schematic flowchart of the system performance capacity dynamic feedback method of the present invention.

[0040] Figure 2 This is a schematic diagram of the system performance capacity dynamic feedback system of the present invention. Specific implementation manners

[0041] To understand the content of the present invention more clearly, it will be described in detail in combination with the drawings and embodiments.

[0042] The first aspect of the present invention relates to a system performance capacity dynamic feedback method, and the process is as Figure 1 shown, including:

[0043] Calculate and obtain the initial value of the service capacity baseline. Obtain the transaction volume data and the corresponding link server resource usage data in the recent 12 months. Use the monthly median corresponding to each month to draw a histogram and take the median to obtain the initial value of the service capacity baseline, denoted as M 基线 , and update the initial value of the service capacity baseline on a monthly basis to obtain the change trend of the service capacity baseline;

[0044] Calculate and obtain the initial value of the resource baseline. Obtain the transaction volume data and the corresponding link server resource usage data in the recent 12 months. Use the monthly median corresponding to each month to draw a histogram and take the median to obtain the initial value of the resource baseline, denoted as R 基线 , and update the initial value of the resource baseline on a monthly basis to obtain the change trend of the resource baseline;

[0045] Calculate and obtain the initial value of the transaction time-consuming baseline. Obtain the data of the natural month with the largest transaction volume in the recent 12 months, identify ordinary trading days and peak trading days, extract all transactions, count the transaction time-consuming situation, draw a time-consuming distribution histogram and take the median to obtain the initial value of the transaction time-consuming baseline, denoted as RT 交易名称 , and update the initial value of the transaction time-consuming baseline on a monthly basis;

[0046] Calculate and obtain the initial value of the function point baseline according to the initial value of the transaction time-consuming baseline. Obtain all transactions of the natural month with the largest transaction volume in the recent 12 months. Combine the dynamic proxy technology to identify the transaction call path, record the call relationship and call times between path nodes, and together with the transaction time-consuming, obtain the initial value of the function point baseline, T (rt，p) , and update the initial value of the function point baseline on a monthly basis to obtain the change trend of the function point baseline;

[0047] Statistically analyze the change trends of ordinary trading days and peak trading days;

[0048] Compare the change trend of the service capacity baseline with the change trend of the resource baseline;

[0049] When the similarity between the change trend of the service capacity baseline and the change trend of the resource baseline is greater than or equal to 80%, then adjust and increase the initial value of the resource baseline at least so that the similarity between the change trend of the service capacity baseline and the change trend of the resource baseline is less than 80%;

[0050] When the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline is less than 80%, further identify the fluctuation of the change trend of the function point baseline. If the fluctuation of the change trend of the function point baseline is greater than 20%, adjust the initial value of the function point baseline to the average value of the initial values of the corresponding function point baselines in the recent three months.

[0051] When the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline is greater than or equal to 80%, if increasing the initial value of the resource baseline to make the resource reach the preset threshold still cannot make the similarity between the change trend of the business capacity baseline and the change trend of the resource baseline less than 80%, trigger an alarm.

[0052] If adjusting the initial value of the function point baseline to the average value of the initial values of the corresponding function point baselines in the recent three months makes the resource reach the preset threshold, trigger an alarm.

[0053] The second aspect of the present invention relates to a system performance capacity dynamic feedback system with a structure as Figure 2 shown, including:

[0054] An initial value calculation module, configured to calculate and obtain the initial value of the business capacity baseline, the initial value of the resource baseline, the initial value of the transaction time-consuming baseline, and the initial value of the function point baseline;

[0055] An initial value calculation module, configured to compare the change trend of the business capacity baseline with the change trend of the resource baseline and identify the fluctuation of the change trend of the function point baseline.

[0056] Using this system can be used to implement the above method and perform dynamic feedback on the system performance capacity.

[0057] The above are only the preferred specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present invention should be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.

Claims

1. A method for dynamically feedbacking system performance capacity, characterized in that Including: Calculate and obtain the initial value of the business capacity baseline, update the initial value of the business capacity baseline monthly, and obtain the changing trend of the business capacity baseline; Calculate and obtain the initial value of the resource baseline, update the initial value of the resource baseline monthly, and obtain the changing trend of the resource baseline; Calculate and obtain the initial value of the transaction time-consuming baseline, and update the initial value of the transaction time-consuming baseline monthly; Calculate and obtain the initial value of the function point baseline according to the initial value of the transaction time-consuming baseline, update the initial value of the function point baseline monthly, and obtain the changing trend of the function point baseline; Statistically analyze the changing trends of ordinary trading days and peak trading days; Compare the changing trend of the business capacity baseline with the changing trend of the resource baseline; When the similarity between the changing trend of the business capacity baseline and the changing trend of the resource baseline is greater than or equal to 80%, adjust and increase the initial value of the resource baseline at least to make the similarity between the changing trend of the business capacity baseline and the changing trend of the resource baseline less than 80%; When the similarity between the changing trend of the business capacity baseline and the changing trend of the resource baseline is less than 80%, further identify the fluctuation of the changing trend of the function point baseline. If the fluctuation of the changing trend of the function point baseline is greater than 20%, adjust the initial value of the function point baseline to the average value of the corresponding function point baseline in the recent three months.

2. The method according to claim 1, wherein When the similarity between the changing trend of the business capacity baseline and the changing trend of the resource baseline is greater than or equal to 80%, if adjusting and increasing the initial value of the resource baseline still cannot make the similarity between the changing trend of the business capacity baseline and the changing trend of the resource baseline less than 80% when the resource reaches the preset threshold, trigger an alarm.

3. The method according to claim 1, characterized in that If adjusting the initial value of the function point baseline to the average value of the corresponding function point baseline in the recent three months makes the resource reach the preset threshold, trigger an alarm.

4. The method according to claim 1, wherein The calculation and acquisition of the initial value of the business capacity baseline includes: Obtain the transaction volume data in the most recent 12 months and the corresponding link server resource usage data; Taking months as the unit, after excluding the data of peak days and trough days, draw a histogram and take the median to obtain the monthly median; Use the monthly medians corresponding to each month to draw a histogram and take the median to obtain the initial value of the business capacity baseline.

5. The method according to claim 1, characterized in that, The calculation and acquisition of the initial value of the resource baseline includes: Obtain the transaction volume data in the most recent 12 months and the corresponding link server resource usage data; Taking months as the unit, after excluding the data of peak days and trough days, draw a histogram and take the median to obtain the monthly median; Use the monthly medians corresponding to each month to draw a histogram and take the median to obtain the initial value of the resource baseline.

6. The method according to claim 1, wherein The calculation and acquisition of the initial value of the transaction time-consuming baseline includes: Obtain the data of the natural month with the largest transaction volume in the most recent 12 months, and identify ordinary trading days and peak trading days; Extract all transactions, statistically analyze the transaction time-consuming situation, draw a time-consuming distribution histogram and take the median to obtain the initial value of the transaction time-consuming baseline.

7. The method according to claim 6, wherein The calculation and acquisition of the initial value of the function point baseline includes: Obtain all transactions in the natural month with the largest transaction volume in the most recent 12 months; Combine the dynamic proxy technology to identify the transaction call path, record the call relationship and call times between path nodes, and together with the transaction time-consuming, obtain the initial value of the function point baseline.

8. A computer-readable storage medium, characterized in that, A computer program is stored on the storage medium, and when the computer program is executed by a processor, the method described in any one of claims 1 to 7 is implemented.

9. An electronic device, characterized in that, Including a processor and a memory; The memory is used to store transaction volume data and corresponding link server resource usage data; The processor is used to execute the method according to any one of claims 1 to 7 by calling the transaction volume data and the corresponding link server resource usage data.

Images