System stability evaluation method and device, electronic equipment and storage medium

Abstract

The invention relates to the technical field of system monitoring, in particular to a system stability evaluation method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining system operation data under a multi-level monitoring system, and carrying out the evaluation of the system operation data based on a preset system stability index, then generating a system stability evaluation report, if it is judged that the system to be evaluated has a potential fault, positioning the position of the potential fault and the cause of the potential fault, optimizing the system to be evaluated based on the position of the potential fault and the cause of the potential fault, and monitoring by using a preset feedback cycle mechanism; and dynamically adjusting an optimization strategy of the to-be-evaluated system according to the new system operation data to obtain a stability evaluation mechanism of the to-be-evaluated system. Therefore, the problems that in the related technology, the influence degree of unstable factors on the overall stability of the system is difficult to quantify accurately, so that targeted optimization suggestions cannot be provided, and faults are caused are solved.

Description

Technical Field

[0001] This application relates to the technical field of system monitoring, and particularly to a method, device, electronic device, and storage medium for evaluating system stability. Background Art

[0002] In modern information systems, due to the complexity and diversity of the systems, various unstable factors often occur, which may lead to system failures. However, these unstable factors may take some time to develop and become apparent. Therefore, for system management, it is necessary to identify these potential instability factors as early as possible and take corresponding measures for prevention and repair, so as to improve system stability.

[0003] In the related art, the monitoring and technical maintenance of systems usually focus on responding to and repairing the occurred failures, and it is difficult to accurately quantify the impact degree of these unstable factors on the overall system stability, thus unable to provide targeted optimization suggestions, and further leading to the inability to effectively determine priorities and implement improvement measures based on certain known risk points, which urgently needs to be solved. Summary of the Invention

[0004] This application provides a method, device, electronic device, and storage medium for evaluating system stability to solve the problems in the related art that it is difficult to accurately quantify the impact degree of unstable factors on the overall system stability, thus unable to provide targeted optimization suggestions, and further leading to the occurrence of failures.

[0005] The first aspect embodiment of this application provides a method for evaluating system stability, including the following steps:

[0006] Obtain the system operation data of the system to be evaluated based on a multi-level monitoring system;

[0007] Evaluate the system operation data based on preset system stability indicators, and generate a system stability evaluation report according to the evaluation results;

[0008] If it is determined based on the system stability evaluation report that the system to be evaluated has potential faults, locate the potential fault positions and potential fault causes, optimize the system to be evaluated based on the potential fault positions and the potential fault causes, and monitor the optimized system to be evaluated by using a preset feedback loop mechanism to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, so as to obtain the stability evaluation mechanism of the system to be evaluated.

[0009] According to an embodiment of this application, the evaluation of the system operation data based on preset system stability indicators includes:

[0010] Determine a first preset system stability index for system capacity evaluation, and use the first preset system stability index to evaluate the capacity operation data of the system to be evaluated, so as to obtain the capacity evaluation result of the system to be evaluated;

[0011] Determine a second preset system stability index for system performance evaluation, and evaluate the performance operation data of the system to be evaluated based on the second preset system stability index, so as to obtain the performance evaluation result of the system to be evaluated.

[0012] According to an embodiment of the present application, the generating the system stability evaluation report according to the evaluation result includes:

[0013] Based on the architecture and business requirements of the system to be evaluated, determine the stability index and evaluation weight of each layer of the multi-level monitoring system;

[0014] Determine at least one key performance indicator for each layer of the monitoring system, assign corresponding weights to each key performance indicator based on a preset weight assignment strategy, and obtain the stability score of each key performance indicator based on the weight assignment result;

[0015] Based on the stability scores of each key performance indicator, and combining the corresponding weights of each key performance indicator, obtain the system stability score under the overall monitoring system;

[0016] Obtain the historical operation data of the system to be evaluated, and compare the historical operation data with the system operation data to determine whether the system stability score meets the system evaluation conditions. If the system stability score meets the system evaluation conditions, generate the system stability evaluation report.

[0017] According to an embodiment of the present application, the obtaining the stability score of each key performance indicator based on the weight assignment result includes:

[0018] Obtain the actual measured value of each key performance indicator;

[0019] Map the actual measured value of each key performance indicator to a preset score interval, and obtain the score deviation value of each key performance indicator based on the preset scoring standard of each key performance indicator;

[0020] According to the score deviation value, correct the corresponding weight of each key performance indicator, and obtain the stability score of each key performance indicator according to the corrected corresponding weight of each key performance indicator.

[0021] According to an embodiment of the present application, the optimizing the system to be evaluated based on the potential fault location and the potential fault cause includes:

[0022] Generate an optimization strategy corresponding to the potential fault location based on the potential fault cause;

[0023] Optimize the potential fault location according to the optimization strategy, and at the same time start the system review mechanism, and optimize the system to be evaluated in combination with the optimization strategy corresponding to the potential fault location.

[0024] According to the system stability evaluation method of the embodiments of the present application, obtain the system operation data under the multi-level monitoring system, evaluate the system operation data based on the preset system stability index, and then generate a system stability evaluation report. If it is determined that there is a potential fault in the system to be evaluated, locate the potential fault location and the potential fault cause, and optimize the system to be evaluated based on the potential fault location and the potential fault cause. At the same time, use the preset feedback loop mechanism for monitoring to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, and obtain the stability evaluation mechanism of the system to be evaluated. Thus, in the related art, it is difficult to accurately quantify the influence degree of unstable factors on the overall stability of the system, so it is impossible to provide targeted optimization suggestions, which in turn leads to problems such as faults. By monitoring the stability index of the system, the instability of the system is predicted in advance, so as to provide optimization suggestions to improve the system stability.

[0025] The second aspect of the embodiments of the present application provides an evaluation device for system stability, including:

[0026] An acquisition module, configured to acquire the system operation data of the system to be evaluated based on the multi-level monitoring system;

[0027] A generation module, configured to evaluate the system operation data based on the preset system stability index, and generate a system stability evaluation report according to the evaluation result;

[0028] An optimization module, configured to, if it is determined based on the system stability evaluation report that there is a potential fault in the system to be evaluated, locate the potential fault location and the potential fault cause, and optimize the system to be evaluated based on the potential fault location and the potential fault cause, and based on the optimized system to be evaluated, use the preset feedback loop mechanism for monitoring to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, and obtain the stability evaluation mechanism of the system to be evaluated.

[0029] According to an embodiment of the present application, the generation module includes:

[0030] The first evaluation unit is used to determine a first preset system stability index for system capacity evaluation, and evaluate the capacity operation data of the system to be evaluated by using the first preset system stability index, so as to obtain the capacity evaluation result of the system to be evaluated;

[0031] The second evaluation unit is used to determine a second preset system stability index for system performance evaluation, and evaluate the performance operation data of the system to be evaluated based on the second preset system stability index, so as to obtain the performance evaluation result of the system to be evaluated.

[0032] According to an embodiment of the present application, the generation module includes:

[0033] A determination unit is used to determine the stability index and evaluation weight of each layer of the multi-level monitoring system based on the architecture of the system to be evaluated and business requirements;

[0034] An allocation unit is used to determine at least one key performance indicator for each layer of the monitoring system, allocate corresponding weights to each key performance indicator based on a preset weight allocation strategy, and obtain the stability score of each key performance indicator based on the weight allocation result;

[0035] An acquisition unit is used to obtain the system stability score under the overall monitoring system based on the stability score of each key performance indicator and in combination with the corresponding weight of each key performance indicator;

[0036] The first generation unit is used to obtain the historical operation data of the system to be evaluated, compare the historical operation data with the system operation data, and determine whether the system stability score meets the system evaluation conditions. If the system stability score meets the system evaluation conditions, the system stability evaluation report is generated.

[0037] According to an embodiment of the present application, the allocation unit includes:

[0038] A first acquisition subunit is used to acquire the actual measurement value of each key performance indicator;

[0039] A second acquisition subunit is used to map the actual measurement value of each key performance indicator to a preset score interval, and obtain the score deviation value of each key performance indicator based on the preset scoring standard of each key performance indicator;

[0040] A correction subunit is used to correct the corresponding weight of each key performance indicator according to the score deviation value, and obtain the stability score of each key performance indicator according to the corrected corresponding weight of each key performance indicator.

[0041] According to an embodiment of the present application, the optimization module includes:

[0042] A second generation unit, configured to generate an optimization strategy corresponding to the potential fault location based on the potential fault cause;

[0043] An optimization unit, configured to optimize the potential fault location according to the optimization strategy, and at the same time start a system review mechanism to optimize the system to be evaluated in combination with the optimization strategy corresponding to the potential fault location.

[0044] The system stability evaluation device according to the embodiment of the present application obtains system operation data under a multi-level monitoring system, evaluates the system operation data based on a preset system stability index, and then generates a system stability evaluation report. If it is determined that there is a potential fault in the system to be evaluated, the potential fault location and the potential fault cause are located, and the system to be evaluated is optimized based on the potential fault location and the potential fault cause. At the same time, a preset feedback loop mechanism is used for monitoring to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, so as to obtain the stability evaluation mechanism of the system to be evaluated. Thus, in the related art, it is difficult to accurately quantify the influence degree of unstable factors on the overall stability of the system, so that targeted optimization suggestions cannot be provided, and further problems such as faults occur. By monitoring the stability index of the system, the instability of the system is predicted in advance, so as to provide optimization suggestions to improve the system stability.

[0045] An embodiment of the third aspect of the present application provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor executes the program to implement the system stability evaluation method as described in the above embodiment.

[0046] An embodiment of the fourth aspect of the present application provides a computer-readable storage medium, where the computer-readable storage medium stores computer instructions, and the computer instructions are used to cause the computer to execute the system stability evaluation method as described in the above embodiment.

[0047] An embodiment of the fifth aspect of the present application provides a computer program product, including a computer program, and the computer program is executed to implement the system stability evaluation method as described in the above embodiment.

[0048] The additional aspects and advantages of the present application will be partially given in the following description, partially become obvious from the following description, or be understood through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The above and / or additional aspects and advantages of the present application will become obvious and easy to understand from the following description of the embodiments in conjunction with the drawings, where:

[0050] Figure 1 A flowchart of a method for evaluating system stability provided according to an embodiment of the present application;

[0051] Figure 2 A flowchart for evaluating system stability according to an embodiment of the present application;

[0052] Figure 3 A schematic diagram of a system stability evaluation model according to an embodiment of the present application;

[0053] Figure 4 An example diagram of an apparatus for evaluating system stability according to an embodiment of the present application;

[0054] Figure 5 A schematic diagram of the structure of an electronic device according to an embodiment of the present application. Detailed implementation manners

[0055] The embodiments of the present application will be described in detail below. The examples of the embodiments are shown in the accompanying drawings, where the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the present application, but should not be construed as a limitation to the present application.

[0056] The method, apparatus, electronic device, and storage medium for evaluating system stability according to the embodiments of the present application will be described below with reference to the accompanying drawings. In view of the problem in the related art mentioned in the above background art that it is difficult to accurately quantify the influence degree of unstable factors on the overall system stability, thus unable to provide targeted optimization suggestions, and further resulting in the occurrence of faults, the present application provides a method for evaluating system stability. In this method, the system operation data under a multi-level monitoring system is obtained, and the system operation data is evaluated based on a preset system stability index, and then a system stability evaluation report is generated. If it is determined that the system to be evaluated has potential faults, the positions and causes of the potential faults are located, and the system to be evaluated is optimized based on the positions and causes of the potential faults. At the same time, a preset feedback loop mechanism is used for monitoring to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, and a stability evaluation mechanism for the system to be evaluated is obtained. Thus, the problems in the related art that it is difficult to accurately quantify the influence degree of unstable factors on the overall system stability, thus unable to provide targeted optimization suggestions, and further resulting in the occurrence of faults, etc. are solved. By monitoring the stability index of the system, the instability of the system is predicted in advance, so as to provide optimization suggestions to improve the system stability.

[0057] Specifically, Figure 1 A schematic flowchart of a method for evaluating system stability provided according to an embodiment of the present application.

[0058] As Figure 1 shown, the method for evaluating the system stability includes the following steps:

[0059] In step S101, obtain the system operation data of the system to be evaluated based on a multi-level monitoring system.

[0060] Specifically, due to the unstable factors existing in the system, faults often occur. However, sometimes the potential instability does not directly manifest as a fault but requires a period of development to be reflected. Therefore, it is necessary to evaluate the system stability by formulating measurement indicators for system stability, predict the instability of the system in advance, and thus provide optimization suggestions to improve the system stability.

[0061] Specifically, as Figure 2 shown, this application mainly involves three parts: system stability indicators, system stability evaluation, and system stability correction. To improve the accuracy of system stability evaluation, the embodiments of this application need to be evaluated based on a multi-level monitoring system. Therefore, it is necessary to obtain the system operation data of the system to be evaluated based on a multi-level monitoring system, including but not limited to the hardware device layer, the operating system layer, the component service layer, the application performance layer, and the business layer.

[0062] For example, based on the hardware device layer, the hardware health status can be monitored and obtained, such as temperature, voltage, etc.; based on the operating system layer, the operating system performance parameters can be tracked, such as the CPU (Central Processing Unit) usage rate, memory occupancy, etc.; based on the component service layer, the response time and availability of key services and application program interfaces can be monitored; based on the application performance layer, the performance at the application program level can be evaluated, such as request processing time, error rate, etc.; based on the business layer, the performance at the business logic level can be concerned, such as transaction success rate, user operation response speed, etc.

[0063] In step S102, evaluate the system operation data based on the preset system stability indicators, and generate a system stability evaluation report according to the evaluation results.

[0064] According to an embodiment of the present application, evaluating the system operation data based on the preset system stability indicators includes: determining the first preset system stability indicator for system capacity evaluation, and using the first preset system stability indicator to evaluate the capacity operation data of the system to be evaluated to obtain the capacity evaluation result of the system to be evaluated; determining the second preset system stability indicator for system performance evaluation, and evaluating the performance operation data of the system to be evaluated based on the second preset system stability indicator to obtain the performance evaluation result of the system to be evaluated.

[0065] Among them, the preset system stability indicators include a first preset system stability indicator and a second preset system stability indicator. Both the first preset system stability indicator and the second preset system stability indicator can be set by those skilled in the art according to the actual system stability evaluation requirements, and no specific limitation is made here.

[0066] Specifically, in the embodiments of the present application, to improve the system stability evaluation, the system capacity evaluation and the system performance evaluation can be combined, and the system stability can be continuously evaluated according to the formulated system stability indicators (such as performance indicators, security indicators, reliability indicators, etc.).

[0067] Specifically, as Figure 3 shown, the embodiments of the present application can evaluate the capacity operation data of the system to be evaluated based on the first preset system stability indicator of the system capacity evaluation. For example, the system capacity evaluation can include hosts, container shared storage, databases, etc., and the corresponding first preset system stability indicators can include the average CPU utilization rate of the host, the memory utilization rate of the host, the average utilization rate of the host file system, the average CPU utilization rate of the container, the memory utilization rate of the container, the average utilization rate of the file system of a single container, the capacity growth rate of the shared storage, the number of connections of a single application database, etc. Thus, based on the evaluation of the above first preset system stability indicators, the capacity evaluation result of the system to be evaluated can be obtained.

[0068] Optionally, the embodiments of the present application can also evaluate the performance operation data of the system to be evaluated based on the second preset system stability indicator of the system performance evaluation. For example, the system performance evaluation can include slow SQL (Structured Query Language), slow interfaces, system error logs, etc., and the corresponding second preset system stability indicators can include the time-consuming of a single SQL, the time-consuming of a slow interface, the number of occurrences of system error log errors, etc. Thus, based on the evaluation of the above second preset system stability indicators, the performance evaluation result of the system to be evaluated can be obtained.

[0069] According to an embodiment of the present application, a system stability evaluation report is generated based on the evaluation results, including: determining the stability indicators and evaluation weights of each layer of the multi-level monitoring system based on the system architecture to be evaluated and business requirements; determining at least one key performance indicator for each layer of the monitoring system, and assigning corresponding weights to each key performance indicator based on a preset weight assignment strategy, and obtaining the stability score of each key performance indicator based on the weight assignment result; obtaining the system stability score under the overall monitoring system based on the stability scores of each key performance indicator and combining the corresponding weights of each key performance indicator; obtaining the historical operation data of the system to be evaluated, and comparing it with the system operation data to determine whether the system stability score meets the system evaluation conditions. If the system stability score meets the system evaluation conditions, a system stability evaluation report is generated.

[0070] According to an embodiment of the present application, obtaining the stability score of each key performance indicator based on the weight assignment result includes: obtaining the actual measured value of each key performance indicator; mapping the actual measured value of each key performance indicator to a preset score interval, and obtaining the score deviation value of each key performance indicator based on the preset scoring standard of each key performance indicator; correcting the corresponding weight of each key performance indicator according to the score deviation value, and obtaining the stability score of each key performance indicator according to the corrected corresponding weight of each key performance indicator.

[0071] Among them, the preset weight assignment strategy, system evaluation conditions, preset score interval, and preset scoring standard can all be set by those skilled in the art according to the actual system stability evaluation requirements, and no specific limitations are made here.

[0072] Specifically, based on the system architecture to be evaluated and business requirements, it is necessary to determine the stability indicators and evaluation weights of each layer of the multi-level monitoring system, and at the same time determine at least one key performance indicator for each layer of the monitoring system. For example, the hardware device layer may focus on temperature and voltage, while the application performance layer pays more attention to response time and error rate, etc. Thus, corresponding weights are assigned to each key performance indicator based on the preset weight assignment strategy, and the stability score of each key performance indicator is obtained based on the weight assignment result.

[0073] Specifically, first, obtain the actual measurement values of each key performance indicator under each layer of the monitoring system; secondly, according to predefined standard ranges (such as ideal values, warning thresholds, danger thresholds, etc.), map the actual measurement values of each key performance indicator into a preset score range (such as 0-100 points) respectively, and obtain the score deviation value of each key performance indicator based on the preset scoring criteria. For example, if the ideal value of a certain key performance indicator is 50ms and the actual measurement value is 60ms, at this time, the score deviation value can be obtained as 10ms based on the preset scoring criteria. Thus, correct the corresponding weight of each key performance indicator according to the score deviation value of each key performance indicator to make the weight allocation more accurate, and obtain the stability score of each key performance indicator according to the corrected corresponding weight of each key performance indicator.

[0074] Secondly, add up the stability scores of each key performance indicator to obtain the stability score under each layer of the monitoring system. At the same time, use the weighted average method or other mathematical models, and combine the corresponding weights of each key performance indicator to obtain the system stability score under the overall monitoring system.

[0075] Finally, after obtaining the system stability score under the overall monitoring system, it is necessary to further verify the system stability score and calculate the accuracy and rationality of the system stability score.

[0076] For example, obtain the historical operation data of the system to be evaluated, and compare it based on the historical operation data and the system operation data to determine whether the system stability score meets the system evaluation conditions, that is, verify whether the score is reasonable. When necessary, the weights or scoring algorithms of the key performance indicators can be adjusted to ensure that the system stability score can truly reflect the stability status of the system. If the system stability score meets the system evaluation conditions, generate a system stability evaluation report, and determine whether there are potential faults in the system to be evaluated based on the system stability evaluation report and point out improvement suggestions.

[0077] In step S103, if it is determined based on the system stability evaluation report that the system to be evaluated has potential faults, locate the potential fault location and the cause of the potential fault, optimize the system to be evaluated based on the potential fault location and the cause of the potential fault, and monitor the optimized system to be evaluated using a preset feedback loop mechanism to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, and obtain the stability evaluation mechanism of the system to be evaluated.

[0078] According to an embodiment of the present application, optimizing the system to be evaluated based on potential failure locations and potential failure causes includes: generating an optimization strategy corresponding to the potential failure location based on the potential failure cause; optimizing the potential failure location according to the optimization strategy, and at the same time starting the system review mechanism to optimize the system to be evaluated in combination with the optimization strategy corresponding to the potential failure location.

[0079] Among them, the preset feedback loop mechanism can be set by those skilled in the art according to the actual system stability evaluation requirements, and no specific limitation is made here.

[0080] Specifically, if it is determined based on the system stability evaluation report that the system to be evaluated has potential failures, that is, key performance indicators lower than the expected scores, then locate the potential failure location and clarify the potential failure cause based on the information shown in the system stability evaluation report, and generate an optimization strategy corresponding to the potential failure location based on the potential failure cause.

[0081] For example, based on function-related optimization, if there is a potential failure in a specific function module of the system to be evaluated, the function logic of this module can be considered for redesign or adjustment, and the interface interaction design can be improved through user feedback to improve usability and satisfaction; if the potential failure of the system to be evaluated is a database performance bottleneck, the query statement can be optimized, indexes can be added, or a more efficient database structure can be adopted to meet higher processing requirements; if the potential failure of the system to be evaluated is insufficient existing hardware resources, the system can be expanded by increasing the number of servers, increasing the storage capacity, etc.; if the potential failure of the system to be evaluated is that the current architecture has design defects or is not suitable for the current business requirements, a new architecture mode can be considered, such as switching from a monolithic application to a microservices architecture.

[0082] It should be noted that in actual operation, for urgent and highly localized problems, local optimization can be first adopted to quickly solve the problem, and at the same time, a system-level review is started, that is, the system review mechanism is started to find out possible deep-seated problems, and a long-term system optimization path is planned in combination with the optimization strategy corresponding to the potential failure location.

[0083] Furthermore, after optimizing the system to be evaluated, the preset feedback loop mechanism can be further used for monitoring, and the optimization strategy can be dynamically adjusted according to the latest system operation data, so as to ensure the long-term stability and efficiency of the system.

[0084] Specifically, first, use a preset feedback loop mechanism to regularly review the system operation data and compare it with historical data to identify new system operation data, trends, or problems; second, dynamically adjust the optimization strategy according to the new system operation data to ensure that the system is always in the best state; finally, establish an automatic alarm and early warning mechanism to detect and handle newly emerging problems in a timely manner. Thus, a stability evaluation mechanism for the system to be evaluated can be obtained. This evaluation mechanism can not only identify potential instability factors in advance but also provide scientific and effective optimization suggestions to ensure the continuous and stable operation of the system.

[0085] According to the system stability evaluation method of the embodiments of the present application, obtain the system operation data under a multi-level monitoring system, evaluate the system operation data based on a preset system stability index, and then generate a system stability evaluation report. If it is determined that the system to be evaluated has potential faults, locate the potential fault location and the cause of the potential fault, and optimize the system to be evaluated based on the potential fault location and the cause of the potential fault. At the same time, use a preset feedback loop mechanism for monitoring to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, and obtain a stability evaluation mechanism for the system to be evaluated. Thus, in the related art, it is difficult to accurately quantify the influence degree of unstable factors on the overall stability of the system, so targeted optimization suggestions cannot be provided, leading to problems such as the occurrence of faults. By monitoring the stability index of the system, the instability of the system can be predicted in advance, and optimization suggestions can be provided to improve the system stability.

[0086] Secondly, describe the system stability evaluation device proposed according to the embodiments of the present application with reference to the accompanying drawings.

[0087] Figure 4 It is a block diagram of the system stability evaluation device of the embodiments of the present application.

[0088] As Figure 4 shown, the system stability evaluation device 10 includes: an acquisition module 100, a generation module 200, and an optimization module 300.

[0089] Among them, the acquisition module 100 is used to acquire the system operation data of the system to be evaluated based on a multi-level monitoring system;

[0090] The generation module 200 is used to evaluate the system operation data based on a preset system stability index and generate a system stability evaluation report according to the evaluation result;

[0091] Optimization module 300 is used to, if it is determined based on the system stability assessment report that there are potential faults in the system to be evaluated, locate the positions and causes of the potential faults, optimize the system to be evaluated based on the positions and causes of the potential faults, and monitor the optimized system to be evaluated by using a preset feedback loop mechanism, so as to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, and obtain the stability evaluation mechanism of the system to be evaluated.

[0092] According to an embodiment of the present application, the generation module 200 includes:

[0093] The first evaluation unit is used to determine the first preset system stability index for system capacity evaluation, and evaluate the capacity operation data of the system to be evaluated by using the first preset system stability index, so as to obtain the capacity evaluation result of the system to be evaluated;

[0094] The second evaluation unit is used to determine the second preset system stability index for system performance evaluation, and evaluate the performance operation data of the system to be evaluated based on the second preset system stability index, so as to obtain the performance evaluation result of the system to be evaluated.

[0095] According to an embodiment of the present application, the generation module 200 includes:

[0096] The determination unit is used to determine the stability index and evaluation weight of each layer of the multi-level monitoring system based on the architecture and business requirements of the system to be evaluated;

[0097] The allocation unit is used to determine at least one key performance indicator of each layer of the monitoring system, allocate corresponding weights to each key performance indicator based on a preset weight allocation strategy, and obtain the stability score of each key performance indicator based on the weight allocation result;

[0098] The acquisition unit is used to obtain the system stability score under the overall monitoring system based on the stability score of each key performance indicator and in combination with the corresponding weight of each key performance indicator;

[0099] The first generation unit is used to obtain the historical operation data of the system to be evaluated, compare the historical operation data with the system operation data, determine whether the system stability score meets the system evaluation conditions, and if the system stability score meets the system evaluation conditions, generate a system stability assessment report.

[0100] According to an embodiment of the present application, the allocation unit includes:

[0101] The first acquisition subunit is used to acquire the actual measured value of each key performance indicator;

[0102] A second obtaining subunit, configured to map the actual measurement value of each key performance indicator to a preset score interval, and obtain the score deviation value of each key performance indicator based on the preset scoring criterion of each key performance indicator;

[0103] A correction subunit, configured to correct the corresponding weight of each key performance indicator according to the score deviation value, and obtain the stability score of each key performance indicator according to the corrected corresponding weight of each key performance indicator.

[0104] According to an embodiment of the present application, the optimization module 300 includes:

[0105] A second generating unit, configured to generate an optimization strategy corresponding to a potential fault location based on a potential fault cause;

[0106] An optimization unit, configured to optimize the potential fault location according to the optimization strategy, and at the same time start a system review mechanism, and optimize the system to be evaluated in combination with the optimization strategy corresponding to the potential fault location.

[0107] The evaluation device for system stability according to the embodiment of the present application obtains system operation data under a multi-level monitoring system, evaluates the system operation data based on preset system stability indicators, and then generates a system stability evaluation report. If it is determined that there is a potential fault in the system to be evaluated, the potential fault location and potential fault cause are located, and the system to be evaluated is optimized based on the potential fault location and potential fault cause. At the same time, a preset feedback loop mechanism is used for monitoring to dynamically adjust the optimization strategy of the system to be evaluated according to new system operation data, so as to obtain the stability evaluation mechanism of the system to be evaluated. Thus, the problems in the related art that it is difficult to accurately quantify the influence degree of unstable factors on the overall stability of the system, so that targeted optimization suggestions cannot be provided, and further faults occur are solved. By monitoring the stability indicators of the system, the instability of the system is predicted in advance, so as to provide optimization suggestions to improve the system stability.

[0108] Figure 5 The structural schematic diagram of the electronic device provided by the embodiment of the present application. The electronic device may include:

[0109] A memory 501, a processor 502, and a computer program stored on the memory 501 and executable on the processor 502.

[0110] When the processor 502 executes the program, it implements the system stability evaluation method provided in the above embodiment.

[0111] Further, the electronic device further includes:

[0112] A communication interface 503, configured for communication between the memory 501 and the processor 502.

[0113] A memory 501 for storing a computer program that can run on a processor 502.

[0114] The memory 501 may include a high-speed RAM memory and may also include non-volatile memory, such as at least one disk memory.

[0115] If the memory 501, the processor 502, and the communication interface 503 are implemented independently, the communication interface 503, the memory 501, and the processor 502 can be interconnected through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 5 only a thick line is shown in the figure, but it does not mean that there is only one bus or one type of bus.

[0116] Optionally, in a specific implementation, if the memory 501, the processor 502, and the communication interface 503 are integrated on a single chip, the memory 501, the processor 502, and the communication interface 503 can communicate with each other through an internal interface.

[0117] The processor 502 may be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0118] This embodiment also provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for evaluating system stability as described above is implemented.

[0119] This embodiment also provides a computer program product, including a computer program, and the computer program is executed to implement the method for evaluating system stability in the above embodiment.

[0120] In the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "examples", "specific examples", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of this application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0121] In addition, the terms "first" and "second" are used only for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0122] Any process or method description depicted in a flowchart or otherwise described herein can be understood to represent a module, segment, or portion of code including one or more executable instructions for implementing a customized logic function or process. And the scope of the preferred embodiments of this application includes additional implementations, where the functions may be executed in a substantially simultaneous manner or in a reverse order according to the functions involved, rather than in the order shown or discussed, which should be understood by those skilled in the art to which the embodiments of this application pertain.

[0123] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a definite sequence list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device), or used in conjunction with these instruction execution systems, apparatuses, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection part (electronic device) having one or N wirings, a portable computer disk cartridge (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable media on which a program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or other appropriate processing as necessary, and then stored in a computer memory.

[0124] It should be understood that various parts of the present application can be implemented by hardware, software, firmware, or a combination thereof. In the above-described embodiments, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application-specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

[0125] Those of ordinary skill in the art of this technology can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0126] In addition, each functional unit in various embodiments of the present application may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above integrated module may be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0127] The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disc, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

Claims

1. A method for evaluating system stability, characterized in that, Including the following steps: Obtain the system operation data of the system to be evaluated based on a multi-level monitoring system; Evaluate the system operation data based on preset system stability indicators, and generate a system stability evaluation report according to the evaluation results; If it is determined based on the system stability evaluation report that the system to be evaluated has potential faults, locate the potential fault positions and potential fault causes, optimize the system to be evaluated based on the potential fault positions and the potential fault causes, and monitor the optimized system to be evaluated using a preset feedback loop mechanism to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, so as to obtain the stability evaluation mechanism of the system to be evaluated.

2. The method according to claim 1, characterized in that, The evaluation of the system operation data based on preset system stability indicators includes: Determine the first preset system stability indicator for system capacity evaluation, and use the first preset system stability indicator to evaluate the capacity operation data of the system to be evaluated to obtain the capacity evaluation result of the system to be evaluated; Determine the second preset system stability indicator for system performance evaluation, and evaluate the performance operation data of the system to be evaluated based on the second preset system stability indicator to obtain the performance evaluation result of the system to be evaluated.

3. The method according to claim 1, characterized in that, The generation of the system stability evaluation report according to the evaluation results includes: Based on the architecture and business requirements of the system to be evaluated, determine the stability indicators and evaluation weights of each layer of the multi-level monitoring system; Determine at least one key performance indicator for each layer of the monitoring system, assign corresponding weights to each key performance indicator based on a preset weight assignment strategy, and obtain the stability score of each key performance indicator based on the weight assignment result; Based on the stability scores of each key performance indicator and in combination with the corresponding weights of each key performance indicator, obtain the system stability score under the overall monitoring system; Obtain the historical operation data of the system to be evaluated, and compare it with the system operation data to determine whether the system stability score meets the system evaluation conditions. If the system stability score meets the system evaluation conditions, generate the system stability evaluation report.

4. The method according to claim 3, characterized in that, The obtaining of the stability score of each key performance indicator based on the weight assignment result includes: Obtain the actual measured value of each key performance indicator; Map the actual measured value of each key performance indicator to a preset score interval, and obtain the score deviation value of each key performance indicator based on the preset scoring standard of each key performance indicator; Correct the corresponding weight of each key performance indicator according to the score deviation value, and obtain the stability score of each key performance indicator according to the corrected corresponding weight of each key performance indicator.

5. The method according to claim 1, wherein The optimization of the system to be evaluated based on the potential fault positions and the potential fault causes includes: Generate an optimization strategy corresponding to the potential fault position based on the potential fault cause; Optimize the potential fault location according to the optimization strategy, and at the same time start the system review mechanism, and optimize the system to be evaluated in combination with the optimization strategy corresponding to the potential fault location.

6. An evaluation device for system stability, characterized in that, Including: An acquisition module, configured to acquire system operation data of the system to be evaluated based on a multi-level monitoring system; A generation module, configured to evaluate the system operation data based on a preset system stability index, and generate a system stability evaluation report according to the evaluation result; An optimization module, configured to, if it is determined based on the system stability evaluation report that the system to be evaluated has potential faults, locate the potential fault location and the potential fault cause, and optimize the system to be evaluated based on the potential fault location and the potential fault cause, and based on the optimized system to be evaluated, monitor it using a preset feedback loop mechanism to dynamically adjust the optimization strategy of the system to be evaluated according to the new system operation data, and obtain the stability evaluation mechanism of the system to be evaluated.

7. The device according to claim 6, characterized in that, The generation module includes: A first evaluation unit, configured to determine a first preset system stability index for system capacity evaluation, and evaluate the capacity operation data of the system to be evaluated using the first preset system stability index to obtain the capacity evaluation result of the system to be evaluated; A second evaluation unit, configured to determine a second preset system stability index for system performance evaluation, and evaluate the performance operation data of the system to be evaluated based on the second preset system stability index to obtain the performance evaluation result of the system to be evaluated.

8. The device according to claim 6, characterized in that, The generation module includes: A determination unit, configured to determine the stability index and evaluation weight of each layer of the multi-level monitoring system based on the architecture of the system to be evaluated and business requirements; An allocation unit, configured to determine at least one key performance index of each layer of the monitoring system, and allocate corresponding weights to each key performance index based on a preset weight allocation strategy, and obtain the stability score of each key performance index based on the weight allocation result; An acquisition unit, configured to obtain the system stability score under the overall monitoring system based on the stability score of each key performance index and in combination with the corresponding weight of each key performance index; A first generation unit, configured to obtain the historical operation data of the system to be evaluated, and compare the historical operation data with the system operation data to determine whether the system stability score meets the system evaluation conditions. If the system stability score meets the system evaluation conditions, generate the system stability evaluation report.

9. An electronic device, characterized in that, Including: A memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the program to implement the method for evaluating the system stability according to any one of claims 1-5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to be used to implement the method for evaluating the system stability according to any one of claims 1-5.

Images