Method and system for evaluating health degree of SRE management

By constructing the evaluation index and health calculation method of SRE management work items, the problem of low SRE management efficiency in the existing technology is solved, accurate calculation and visual monitoring of SRE health are realized, and management efficiency is improved.

CN119025771APending Publication Date: 2024-11-26FUJIAN FUNO MOBILE COMM TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202410883270.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-03
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The existing technology lacks effective management of SRE management work items, which affects the efficiency and effectiveness of SRE management.

Method used

By setting multiple management work items of SRE and building process-oriented and result-oriented evaluation indicators based on these work items, the health of each work item is calculated, and the overall health of SRE is calculated, using periodic calculations and automatic generation of goals value, triggers SLO alarm and displays through visualization.

Benefits of technology

It improves the efficiency and accuracy of SRE management, ensures the rationality and accuracy of SRE health, and realizes all-round multi-angle management and visual monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119025771A_ABST
    Figure CN119025771A_ABST
Patent Text Reader

Abstract

The invention relates to an SRE management health degree evaluation method and system, and the method comprises the steps: constructing corresponding process-oriented evaluation indexes and result-oriented evaluation indexes for N set management work items of SRE, calculating the completion degree according to the current index value and the current target value of each evaluation index, and calculating the health degree of SRE management according to the completion degree. And calculating the current health degree of the corresponding management work item according to the completion degree of the evaluation indexes and the current first weight, and calculating the current health degree of the SRE according to the current health degrees of all the evaluation indexes and the current second weight. Therefore, calculation of the current health degree of the SRE is triggered periodically, and when the current health degree of the SRE is calculated, the process-oriented evaluation index and the result-oriented evaluation index are constructed for each set management work item of the SRE; and the comprehensiveness of the evaluation indexes further improves the accuracy of the current health degree of each obtained management work item, so that the accuracy of the current health degree of the SRE is ensured, and the management efficiency of the SRE is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and system for evaluating the health of SRE management. Background Art

[0002] With the rapid development of enterprise business, SRE (Site Reliability Engineering), as an emerging engineering management system method, plays an increasingly important role in ensuring the stable operation of enterprises and improving user experience. For system continuity assurance, SRE proposes the technical concepts of SLI (Service Level Indicator), SLO (Service Level Objective), and SLA (Service Level Agreement). The existing technology first selects performance monitoring indicators that are strongly related to the business layer and the user perception layer as SLI, defines the health range and sets SLO according to the trend of historical indicator data, and then calculates the current health of the system through real-time indicator data statistics error budget and burn rate, and issues SLA warnings for low current health. However, SRE itself is a huge operation and maintenance support system, which involves multiple management work contents. The existing technology lacks management of SRE management work items, which affects the efficiency and effectiveness of SRE management. Summary of the invention

[0003] The technical problem to be solved by the present invention is: the present invention provides a method and system for evaluating the health of SRE management to improve the efficiency of SRE management.

[0004] In order to solve the above technical problems, the technical solution adopted by the present invention is:

[0005] In a first aspect, the present invention provides a method for evaluating the health of SRE management, characterized by comprising:

[0006] Set N management work items of SRE, and construct corresponding M evaluation indicators based on the N management work items, wherein the evaluation indicators include process-oriented evaluation indicators and result-oriented evaluation indicators;

[0007] The current indicator value, current target value and current first weight of each evaluation indicator of each management work item in the current cycle are obtained according to the preset cycle, and the completion degree of each evaluation indicator in the current cycle is calculated according to the current indicator value and the current target value. The completion degree of all evaluation indicators and the corresponding current first weight are substituted into the health calculation formula for calculation to obtain the current health of the corresponding management work item in the current cycle, where the health calculation formula is:

[0008]

[0009] Among them, K j Indicates the current health of management work item j, zp ij represents the degree of completion of evaluation indicator i in management work item j, w ij represents the first weight of evaluation indicator i in management work item j;

[0010] The current second weight of each management work item is obtained, and the current health of the SRE in the current cycle is calculated according to the current health of all management work items and the corresponding current second weights.

[0011] The beneficial effects of the present invention are: the calculation of the current health of SRE is triggered periodically, and when calculating the current health of SRE, the current health of each management work item of SRE and the current second weight are used for calculation, and the current health of each management work item is calculated according to the completion of each corresponding evaluation indicator and the corresponding current first weight, thereby ensuring the rationality and accuracy of the final obtained current health of SRE, and when constructing the evaluation indicators of management work items, not only result-oriented evaluation indicators but also process-oriented evaluation indicators are included, and the comprehensiveness of the evaluation indicators further improves the accuracy of the current health of each management work item obtained, thereby ensuring the accuracy of the current health of SRE and improving the SRE management efficiency.

[0012] Optionally, the setting of N management work items of SRE and constructing corresponding M evaluation indicators based on the N management work items includes:

[0013] Set up 7 management work items for SRE, including fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items;

[0014] Based on the fault management work items, three process-oriented evaluation indicators and five result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: fault generalization and coordination timely rate, fault generalization and coordination completion rate, and fault generalization and coordination recurrence rate. The five result-oriented evaluation indicators include: fault quantity reduction rate, fault duration reduction rate, fault discovery rate, fault location rate, and fault resolution rate.

[0015] Based on the hidden danger management work items, one process-oriented evaluation indicator and two result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the hidden danger identification rate, and the two result-oriented evaluation indicators include: hidden danger resolution rate and bimonthly resolution rate;

[0016] Based on the emergency management work items, one process-oriented evaluation indicator and five result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the average construction time of emergency response, and the four result-oriented indicators include: emergency response coverage rate, one-time pass rate of drill acceptance, emergency self-healing coverage rate, and emergency fault resolution rate.

[0017] Based on the drill management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: automated drill rate, drill frequency, and implementation rate of post-drill improvement measures; the three result-oriented evaluation indicators include: drill plan coverage rate, drill plan completion rate, and drill plan availability rate;

[0018] Based on the ONCALL management work items, three process-oriented evaluation indicators and two result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: ONCALL response rate, ONCALL response accuracy rate and ONCALL response average time. The two result-oriented evaluation indicators include: ONCALL self-discovery rate and ONCALL self-resolution rate.

[0019] Based on the inspection management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: inspection work order timeliness rate, inspection problem recurrence times and standardized inspection feedback timeliness rate; the three result-oriented evaluation indicators include: inspection work order resolution rate, standardized inspection feedback completion rate and standardized inspection feedback accuracy rate;

[0020] Seven result-oriented evaluation indicators are constructed based on the asset management work items, including: business system information completeness rate, resource pool naming consistency rate, cluster naming compliance rate, host management consistency rate, host instance completeness rate, application instance coverage rate and application instance completeness rate.

[0021] According to the above description, we can build process-oriented evaluation indicators and result-oriented evaluation indicators corresponding to management work items to measure the completion of management work items.

[0022] According to the above description, fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items are used as SRE management work items. At the same time, corresponding multiple process-oriented evaluation indicators and result-oriented evaluation indicators are constructed for each management work item to achieve all-round and multi-angle management of SRE.

[0023] Optionally, the obtaining, according to a preset period, a current indicator value, a current target value, and a current first weight of each evaluation indicator in each management work item in the current period includes:

[0024] The current operation stage of each evaluation indicator is obtained, and the target value of the next cycle of the evaluation indicator is generated according to the current indicator value and the current operation stage. When the current operation stage is normal operation, the current target value is used as the target value of the next cycle. When the current operation stage is construction advancement, the current target value is input into the first formula to calculate the target value of the next cycle, where the first formula is:

[0025] The target value of the next cycle = current target value * (1 + a)

[0026] Among them, a represents the improvement ratio.

[0027] According to the above description, it can be seen that unlike the traditional method of relying on manual setting of the target value of each evaluation indicator, the target value of each evaluation indicator for the next cycle can be automatically generated, and when the target value of the next cycle is automatically generated, it is further divided according to the current operation stage, to ensure that the target value of the next cycle of each evaluation indicator generated is more in line with reality.

[0028] Optionally, it also includes:

[0029] When the current health of the SRE is lower than the health threshold, an SLO alarm is triggered.

[0030] According to the above description, when the current health of the SRE obtained is lower than the health threshold, an SLO alarm will be triggered to remind the staff to take relevant measures in time.

[0031] Optionally, use Grafana to visualize the completion of each evaluation indicator, the current health of each management work item, and the current health of SRE.

[0032] According to the above description, visualization of SRE management is achieved.

[0033] In a second aspect, the present invention provides an SRE management health evaluation system, including:

[0034] An evaluation indicator establishment module is used to set N management work items of SRE, and to construct corresponding M evaluation indicators based on the N management work items, wherein the evaluation indicators include process-oriented evaluation indicators and result-oriented evaluation indicators;

[0035] The current health calculation module of the management work item is used to obtain the current indicator value, current target value and current first weight of each evaluation indicator of each management work item in the current cycle according to the preset cycle, calculate the completion degree of each evaluation indicator in the current cycle according to the current indicator value and the current target value, substitute the completion degree of all evaluation indicators and the corresponding current first weight into the health calculation formula for calculation, and obtain the current health of the corresponding management work item in the current cycle, where the health calculation formula is:

[0036]

[0037] Among them, K j Indicates the current health of management work item j, zp ij represents the degree of completion of evaluation indicator i in management work item j, w ij represents the first weight of evaluation indicator i in management work item j;

[0038] The SRE current health calculation module is used to obtain the current second weight of each management work item, and calculate the SRE current health in the current cycle according to the current health of all management work items and the corresponding current second weights.

[0039] The beneficial effects of the present invention are: the calculation of the current health of SRE is triggered periodically, and when calculating the current health of SRE, the current health of each management work item of SRE and the current second weight are used for calculation, and the current health of each management work item is calculated according to the completion of each corresponding evaluation indicator and the corresponding current first weight, thereby ensuring the rationality and accuracy of the final obtained current health of SRE, and when constructing the evaluation indicators of management work items, not only result-oriented evaluation indicators but also process-oriented evaluation indicators are included, and the comprehensiveness of the evaluation indicators further improves the accuracy of the current health of each management work item obtained, thereby ensuring the accuracy of the current health of SRE and improving the SRE management efficiency.

[0040] Optionally, the evaluation index establishment module is specifically:

[0041] Set up 7 management work items for SRE, including fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items;

[0042] Based on the fault management work items, three process-oriented evaluation indicators and five result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: fault generalization and coordination timely rate, fault generalization and coordination completion rate, and fault generalization and coordination recurrence rate. The five result-oriented evaluation indicators include: fault quantity reduction rate, fault duration reduction rate, fault discovery rate, fault location rate, and fault resolution rate.

[0043] Based on the hidden danger management work items, one process-oriented evaluation indicator and two result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the hidden danger identification rate, and the two result-oriented evaluation indicators include: hidden danger resolution rate and bimonthly resolution rate;

[0044] Based on the emergency management work items, one process-oriented evaluation indicator and five result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the average construction time of emergency response, and the four result-oriented indicators include: emergency response coverage rate, one-time pass rate of drill acceptance, emergency self-healing coverage rate, and emergency fault resolution rate.

[0045] Based on the drill management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: automated drill rate, drill frequency, and implementation rate of post-drill improvement measures; the three result-oriented evaluation indicators include: drill plan coverage rate, drill plan completion rate, and drill plan availability rate;

[0046] Based on the ONCALL management work items, three process-oriented evaluation indicators and two result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: ONCALL response rate, ONCALL response accuracy rate and ONCALL response average time. The two result-oriented evaluation indicators include: ONCALL self-discovery rate and ONCALL self-resolution rate.

[0047] Based on the inspection management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: inspection work order timeliness rate, inspection problem recurrence times and standardized inspection feedback timeliness rate; the three result-oriented evaluation indicators include: inspection work order resolution rate, standardized inspection feedback completion rate and standardized inspection feedback accuracy rate;

[0048] Seven result-oriented evaluation indicators are constructed based on the asset management work items, including: business system information completeness rate, resource pool naming consistency rate, cluster naming compliance rate, host management consistency rate, host instance completeness rate, application instance coverage rate and application instance completeness rate.

[0049] According to the above description, fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items are used as SRE management work items. At the same time, corresponding multiple process-oriented evaluation indicators and result-oriented evaluation indicators are constructed for each management work item to achieve all-round and multi-angle management of SRE.

[0050] Optionally, the current health calculation module of the management work item is specifically:

[0051] The current operation stage of each evaluation indicator is obtained, and the target value of the next cycle of the evaluation indicator is generated according to the current indicator value and the current operation stage. When the current operation stage is normal operation, the current target value is used as the target value of the next cycle. When the current operation stage is construction advancement, the current target value is input into the first formula to calculate the target value of the next cycle, where the first formula is:

[0052] The target value of the next cycle = current target value * (1 + a)

[0053] Among them, a represents the improvement ratio.

[0054] According to the above description, it can be seen that unlike the traditional method of relying on manual setting of the target value of each evaluation indicator, the target value of each evaluation indicator for the next cycle can be automatically generated, and when the target value of the next cycle is automatically generated, it is further divided according to the current operation stage, to ensure that the target value of the next cycle of each evaluation indicator generated is more in line with reality.

[0055] Optionally, it also includes:

[0056] The alarm module is used to trigger an SLO alarm when the current health of the SRE is lower than a health threshold.

[0057] According to the above description, when the current health of the SRE obtained is lower than the health threshold, an SLO alarm will be triggered to remind the staff to take relevant measures in time.

[0058] Optionally, it also includes:

[0059] The visualization module is used to visualize the completion of each evaluation indicator, the current health of each management work item, and the current health of SRE through Grafana.

[0060] According to the above description, visualization of SRE management is achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] Figure 1 A flowchart of a method for evaluating the health of SRE management provided by an embodiment of the present invention;

[0062] Figure 2 A schematic diagram of the overall process of a method for evaluating the health of SRE management provided by an embodiment of the present invention;

[0063] Figure 3 A schematic diagram of the structure of an SRE management health evaluation system provided by an embodiment of the present invention.

[0064] [Description of Reference Numerals]

[0065] 1. An evaluation system for SRE management health;

[0066] 2. Evaluation indicator health module;

[0067] 3. Manage the current health calculation module of work items;

[0068] 4. SRE current health calculation module;

[0069] 5. Alarm module;

[0070] 6. Visualization module. DETAILED DESCRIPTION

[0071] In order to better understand the above technical solution, exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to enable a clearer and more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.

[0072] Embodiment 1

[0073] Please refer to Figure 1 to Figure 2 The present invention provides a method for evaluating the health of SRE management, comprising the steps of:

[0074] S1. Set N management work items of SRE, and construct corresponding M evaluation indicators based on the N management work items, wherein the evaluation indicators include process-oriented evaluation indicators and result-oriented evaluation indicators;

[0075] At this time, the N management work items of SRE are set in step S1, and the corresponding M evaluation indicators are constructed based on the N management work items, including:

[0076] S11. Set 7 management work items of SRE, including fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items;

[0077] S12. Construct three process-oriented evaluation indicators and five result-oriented evaluation indicators based on the fault management work items. The three process-oriented evaluation indicators include: fault generalization joint investigation timeliness rate, fault generalization joint investigation completion rate and fault generalization joint investigation recurrence rate. The five result-oriented evaluation indicators include: fault quantity reduction rate, fault duration reduction rate, fault discovery rate, fault location rate and fault resolution rate.

[0078] In this embodiment, the fault quantity reduction rate of the result-oriented evaluation indicator of the fault management work item refers to the reduction rate compared with last year, the fault duration reduction rate refers to the reduction rate compared with last year, the fault detection rate refers to the fault detection rate within 1 minute, the fault location rate refers to the fault location rate within 5 minutes, and the fault resolution rate refers to the fault resolution rate within 10 minutes.

[0079] S13. Based on the hidden danger management work items, construct one process-oriented evaluation indicator and two result-oriented evaluation indicators, of which one process-oriented evaluation indicator is the hidden danger identification rate, and the two result-oriented evaluation indicators include: hidden danger resolution rate and bimonthly resolution rate;

[0080] S14. Construct one process-oriented evaluation indicator and five result-oriented evaluation indicators based on emergency management work items. One process-oriented evaluation indicator is the average construction time of emergency response. The four result-oriented indicators include: emergency response coverage rate, one-time pass rate of drill acceptance, emergency self-healing coverage rate, and emergency fault resolution rate.

[0081] In this embodiment, the fault emergency resolution rate refers to the fault emergency resolution rate within 15 minutes.

[0082] S15. Construct three process-oriented evaluation indicators and three result-oriented evaluation indicators based on the drill management work items. The three process-oriented evaluation indicators include: automated drill rate, drill frequency, and implementation rate of post-drill improvement measures; the three result-oriented evaluation indicators include: drill plan coverage rate, drill plan completion rate, and drill plan availability rate;

[0083] S16. Construct three process-oriented evaluation indicators and two result-oriented evaluation indicators based on the ONCALL management work items. The three process-oriented evaluation indicators include: ONCALL response rate, ONCALL response accuracy rate and ONCALL response average time. The two result-oriented evaluation indicators include: ONCALL self-discovery rate and ONCALL self-resolution rate.

[0084] S17. Construct three process-oriented evaluation indicators and three result-oriented evaluation indicators based on the inspection management work items. The three process-oriented evaluation indicators include: inspection work order timeliness rate, inspection problem recurrence times and standardized inspection feedback timeliness rate. The three result-oriented evaluation indicators include: inspection work order resolution rate, standardized inspection feedback completion rate and standardized inspection feedback accuracy rate.

[0085] S18. Construct 7 result-oriented evaluation indicators based on asset management work items. The 7 result-oriented evaluation indicators include: business system information completeness rate, resource pool naming consistency rate, cluster naming compliance rate, host management consistency rate, host instance completeness rate, application instance coverage rate and application instance completeness rate.

[0086] S2. Obtain the current indicator value, current target value and current first weight of each evaluation indicator of each management work item in the current cycle according to the preset cycle, calculate the completion degree of each evaluation indicator in the current cycle according to the current indicator value and the current target value, substitute the completion degree of all evaluation indicators and the corresponding current first weight into the health calculation formula for calculation, and obtain the current health degree of the corresponding management work item in the current cycle, where the health calculation formula is:

[0087]

[0088] Among them, K j Indicates the current health of management work item j, zp ij represents the degree of completion of evaluation indicator i in management work item j, w ij represents the first weight of evaluation indicator i in management work item j;

[0089] In this embodiment, if Figure 2 As shown, the current indicator value, current target value and current first weight of each evaluation indicator in each management work item in the current cycle are obtained according to the preset cycle, wherein the preset cycle is 7 days, which can be adjusted according to the actual situation, for example, the preset cycle is set to: 3 days, 1 day, etc., and the completion degree of each evaluation indicator is calculated according to the current indicator value and the current target value. The specific calculation of the completion degree is through the first comparison formula:

[0090] Completion degree = current indicator value / target indicator value

[0091] For example, the result-oriented evaluation indicators in the fault management work item: the current indicator value of the fault generalization coordination timeliness rate is 90%, and the current target value is 100%. Then, the completion degree of the fault generalization coordination timeliness rate = 90% / 100% = 90%. The current indicator value of the fault duration reduction rate is 20%, and the current target value is 25%. Then, the completion degree of the fault duration reduction rate = 20% / 25% = 75%. The completion degree of all evaluation indicators of the specific fault management work item is shown in Table 1:

[0092] Table 1. Evaluation indicators of fault management work items

[0093]

[0094] Then substitute the completion degree of all evaluation indicators in the fault management work item and the corresponding current first weight into the health calculation formula for calculation: K j =75%×0.2+75%×0.2+40%×0.1+100%×0.1+100%×0.1+90%×0.1+100%×0.1+90%×0.1=82%, that is, the current health of the fault management work item is 82%.

[0095] At this time, the step S2 of obtaining the current indicator value, the current target value and the current first weight of each evaluation indicator in each management work item in the current period according to the preset period includes:

[0096] S21, obtaining the current operation stage of each evaluation indicator, generating the target value of the next cycle of the evaluation indicator according to the current indicator value and the current operation stage, when the current operation stage is normal operation, taking the current target value as the target value of the next cycle, when the current operation stage is construction advancement, inputting the current target value into the first formula to calculate the target value of the next cycle, wherein the first formula is:

[0097] The target value of the next cycle = current target value * (1 + a)

[0098] Among them, a represents the improvement ratio.

[0099] In this embodiment, if Figure 2As shown, the target value of the next cycle of the evaluation indicator will be automatically generated. Specifically, different methods are used to calculate according to the current operation stage of the evaluation indicator. When the current operation stage of the evaluation indicator is the normal stage, the current target value is directly used as the target value of the next cycle. When the current operation stage of the evaluation indicator is the construction promotion, it is calculated according to the current target value. For example, if the current operation stage of the fault resolution rate in the fault management work item is the construction promotion, the current target value is 70%, and the preset improvement ratio is 20%, then it is substituted into the first formula for calculation: Target value of the next cycle = 70%* (1+20%)=84%, then the target value of the fault resolution rate in the next cycle is 84%, the current operation stage of the fault generalization cooperative investigation completion rate is normal operation, and the current target value is 100%, then 100% will be directly used as the target value of the fault generalization cooperative investigation completion rate in the next cycle, and the generated target value of the next cycle of the evaluation indicator will be sent to the corresponding management personnel for confirmation. If the management personnel confirms that it is correct, the evaluation will be carried out according to the target value of the next cycle of the automatically generated evaluation indicator. If the management personnel make modifications, the evaluation will be carried out according to the target value of the next cycle of the modified evaluation indicator.

[0100] S3. Obtain the current second weight of each management work item, and calculate the current health of the SRE in the current cycle according to the current health of all management work items and the corresponding current second weights.

[0101] In this embodiment, if Figure 2 As shown, the current health of all management work items and the corresponding second weights are weighted and calculated to obtain the current health of the SRE.

[0102] In this embodiment, after calculating the current health of the SRE, an early warning reminder will be issued. The specific steps are as follows:

[0103] When the current health of the SRE is lower than the health threshold, an SLO alarm is triggered.

[0104] The health threshold is 90%, which can be adjusted according to actual conditions.

[0105] In this embodiment, a visual display step is also included, specifically:

[0106] Grafana is used to visualize the completion of each evaluation indicator, the current health of each management work item, and the current health of SRE.

[0107] Embodiment 2

[0108] Please refer to Figure 3The present invention provides an SRE management health evaluation system, including: an evaluation indicator health module 2, a management work item current health calculation module 3, an SRE current health calculation module 4, an alarm module 5 and a visualization module 6.

[0109] The evaluation indicator establishment module 2 is used to set N management work items of SRE, and construct corresponding M evaluation indicators based on the N management work items, wherein the evaluation indicators include process-oriented evaluation indicators and result-oriented evaluation indicators;

[0110] The current health calculation module 3 of the management work item is used to obtain the current indicator value, current target value and current first weight of each evaluation indicator of each management work item in the current cycle according to the preset cycle, calculate the completion degree of each evaluation indicator in the current cycle according to the current indicator value and the current target value, substitute the completion degree of all evaluation indicators and the corresponding current first weight into the health calculation formula for calculation, and obtain the current health of the corresponding management work item in the current cycle, wherein the health calculation formula is:

[0111]

[0112] Among them, K j Indicates the current health of management work item j, zp ij represents the degree of completion of evaluation indicator i in management work item j, w ij represents the first weight of evaluation indicator i in management work item j;

[0113] The SRE current health calculation module 4 is used to obtain the current second weight of each management work item, and calculate the SRE current health in the current cycle according to the current health of all management work items and the corresponding current second weights.

[0114] Specifically, the evaluation index establishment module 2 is specifically:

[0115] Set up 7 management work items for SRE, including fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items;

[0116] Based on the fault management work items, three process-oriented evaluation indicators and five result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: fault generalization and coordination timely rate, fault generalization and coordination completion rate, and fault generalization and coordination recurrence rate. The five result-oriented evaluation indicators include: fault quantity reduction rate, fault duration reduction rate, fault discovery rate, fault location rate, and fault resolution rate.

[0117] Based on the hidden danger management work items, one process-oriented evaluation indicator and two result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the hidden danger identification rate, and the two result-oriented evaluation indicators include: hidden danger resolution rate and bimonthly resolution rate;

[0118] Based on the emergency management work items, one process-oriented evaluation indicator and five result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the average construction time of emergency response, and the four result-oriented indicators include: emergency response coverage rate, one-time pass rate of drill acceptance, emergency self-healing coverage rate, and emergency fault resolution rate.

[0119] Based on the drill management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: automated drill rate, drill frequency, and implementation rate of post-drill improvement measures; the three result-oriented evaluation indicators include: drill plan coverage rate, drill plan completion rate, and drill plan availability rate;

[0120] Based on the ONCALL management work items, three process-oriented evaluation indicators and two result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: ONCALL response rate, ONCALL response accuracy rate and ONCALL response average time. The two result-oriented evaluation indicators include: ONCALL self-discovery rate and ONCALL self-resolution rate.

[0121] Based on the inspection management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: inspection work order timeliness rate, inspection problem recurrence times and standardized inspection feedback timeliness rate; the three result-oriented evaluation indicators include: inspection work order resolution rate, standardized inspection feedback completion rate and standardized inspection feedback accuracy rate;

[0122] Seven result-oriented evaluation indicators are constructed based on the asset management work items, including: business system information completeness rate, resource pool naming consistency rate, cluster naming compliance rate, host management consistency rate, host instance completeness rate, application instance coverage rate and application instance completeness rate.

[0123] Specifically, the current health calculation module 3 of the management work item is specifically:

[0124] The current operation stage of each evaluation indicator is obtained, and the target value of the next cycle of the evaluation indicator is generated according to the current indicator value and the current operation stage. When the current operation stage is normal operation, the current target value is used as the target value of the next cycle. When the current operation stage is construction advancement, the current target value is input into the first formula to calculate the target value of the next cycle, where the first formula is:

[0125] The target value of the next cycle = current target value * (1 + a)

[0126] Among them, a represents the improvement ratio.

[0127] Specifically, the alarm module 5 is used to trigger an SLO alarm when the current health of the SRE is lower than a health threshold.

[0128] Specifically, the visualization module 6 is used to display the completion degree of each evaluation indicator, the current health of each management work item and the current health of SRE in a visualized form through Grafana.

[0129] Since the system / device described in the above embodiments of the present invention is a system / device used to implement the method of the above embodiments of the present invention, a person skilled in the art can understand the specific structure and deformation of the system / device based on the method described in the above embodiments of the present invention, and thus will not be described in detail here. All systems / devices used in the method of the above embodiments of the present invention belong to the scope of protection of the present invention.

[0130] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0131] The present invention is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present invention. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions.

[0132] It should be noted that in the claims, any reference numerals placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claims. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention may be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In the claims enumerating several means, several of these means may be embodied by the same hardware. The use of the words first, second, third, etc., is for convenience of expression only and does not indicate any order. These words may be understood as part of the component name.

[0133] In addition, it should be noted that, in the description of this specification, the description of the terms "one embodiment", "some embodiments", "embodiment", "example", "specific example" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0134] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments after knowing the basic creative concept. Therefore, the claims should be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present invention.

[0135] Obviously, those skilled in the art can make various modifications and variations to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention should also include these modifications and variations.

Claims

1. A method for evaluating the health of SRE management, characterized in that: include: Set N management work items of SRE, and construct corresponding M evaluation indicators based on the N management work items, wherein the evaluation indicators include process-oriented evaluation indicators and result-oriented evaluation indicators; The current indicator value, current target value and current first weight of each evaluation indicator of each management work item in the current cycle are obtained according to the preset cycle, and the completion degree of each evaluation indicator in the current cycle is calculated according to the current indicator value and the current target value. The completion degree of all evaluation indicators and the corresponding current first weight are substituted into the health calculation formula for calculation to obtain the current health of the corresponding management work item in the current cycle, where the health calculation formula is: Among them, K j Indicates the current health of management work item j, zp ij represents the degree of completion of evaluation indicator i in management work item j, w ij represents the first weight of evaluation indicator i in management work item j; The current second weight of each management work item is obtained, and the current health of the SRE in the current cycle is calculated according to the current health of all management work items and the corresponding current second weights.

2. A method for evaluating the health of SRE management according to claim 1, characterized in that: The setting of N management work items of SRE and constructing corresponding M evaluation indicators based on the N management work items include: Set up 7 management work items for SRE, including fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items; Based on the fault management work items, three process-oriented evaluation indicators and five result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: fault generalization and coordination timely rate, fault generalization and coordination completion rate, and fault generalization and coordination recurrence rate. The five result-oriented evaluation indicators include: fault quantity reduction rate, fault duration reduction rate, fault discovery rate, fault location rate, and fault resolution rate. Based on the hidden danger management work items, one process-oriented evaluation indicator and two result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the hidden danger identification rate, and the two result-oriented evaluation indicators include: hidden danger resolution rate and bimonthly resolution rate; Based on the emergency management work items, one process-oriented evaluation indicator and five result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the average construction time of emergency response, and the four result-oriented indicators include: emergency response coverage rate, one-time pass rate of drill acceptance, emergency self-healing coverage rate, and emergency fault resolution rate. Based on the drill management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: automated drill rate, drill frequency, and implementation rate of post-drill improvement measures; the three result-oriented evaluation indicators include: drill plan coverage rate, drill plan completion rate, and drill plan availability rate; Based on the ONCALL management work items, three process-oriented evaluation indicators and two result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: ONCALL response rate, ONCALL response accuracy rate and ONCALL response average time. The two result-oriented evaluation indicators include: ONCALL self-discovery rate and ONCALL self-resolution rate. Based on the inspection management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: inspection work order timeliness rate, inspection problem recurrence times and standardized inspection feedback timeliness rate; the three result-oriented evaluation indicators include: inspection work order resolution rate, standardized inspection feedback completion rate and standardized inspection feedback accuracy rate; Seven result-oriented evaluation indicators are constructed based on the asset management work items, including: business system information completeness rate, resource pool naming consistency rate, cluster naming compliance rate, host management consistency rate, host instance completeness rate, application instance coverage rate and application instance completeness rate.

3. A method for evaluating the health of SRE management according to claim 1, characterized in that: The step of obtaining the current indicator value, the current target value, and the current first weight of each evaluation indicator in each management work item in the current period according to the preset period includes: The current operation stage of each evaluation indicator is obtained, and the target value of the next cycle of the evaluation indicator is generated according to the current indicator value and the current operation stage. When the current operation stage is normal operation, the current target value is used as the target value of the next cycle. When the current operation stage is construction advancement, the current target value is input into the first formula to calculate the target value of the next cycle, where the first formula is: The target value of the next cycle = current target value * (1 + a) Among them, a represents the improvement ratio.

4. The method for evaluating the health of SRE management according to claim 1, characterized in that: Also includes: When the current health of the SRE is lower than the health threshold, an SLO alarm is triggered.

5. The method for evaluating the health of SRE management according to claim 1, characterized in that: Also includes: Grafana is used to visualize the completion of each evaluation indicator, the current health of each management work item, and the current health of SRE.

6. A system for evaluating the health of SRE management, characterized in that: include: An evaluation indicator establishment module is used to set N management work items of SRE, and to construct corresponding M evaluation indicators based on the N management work items, wherein the evaluation indicators include process-oriented evaluation indicators and result-oriented evaluation indicators; The current health calculation module of the management work item is used to obtain the current indicator value, current target value and current first weight of each evaluation indicator of each management work item in the current cycle according to the preset cycle, calculate the completion degree of each evaluation indicator in the current cycle according to the current indicator value and the current target value, substitute the completion degree of all evaluation indicators and the corresponding current first weight into the health calculation formula for calculation, and obtain the current health of the corresponding management work item in the current cycle, where the health calculation formula is: Among them, K j Indicates the current health of management work item j, zp ij represents the degree of completion of evaluation indicator i in management work item j, w ij represents the first weight of evaluation indicator i in management work item j; The SRE current health calculation module is used to obtain the current second weight of each management work item, and calculate the SRE current health in the current cycle according to the current health of all management work items and the corresponding current second weights.

7. The SRE management health evaluation system according to claim 6, characterized in that: The evaluation index establishment module is specifically: Set up 7 management work items for SRE, including fault management work items, hidden danger management work items, emergency management work items, drill management work items, ONCALL management, inspection management work items and asset management work items; Based on the fault management work items, three process-oriented evaluation indicators and five result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: fault generalization and coordination timely rate, fault generalization and coordination completion rate, and fault generalization and coordination recurrence rate. The five result-oriented evaluation indicators include: fault quantity reduction rate, fault duration reduction rate, fault discovery rate, fault location rate, and fault resolution rate. Based on the hidden danger management work items, one process-oriented evaluation indicator and two result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the hidden danger identification rate, and the two result-oriented evaluation indicators include: hidden danger resolution rate and bimonthly resolution rate; Based on the emergency management work items, one process-oriented evaluation indicator and five result-oriented evaluation indicators are constructed. One process-oriented evaluation indicator is the average construction time of emergency response, and the four result-oriented indicators include: emergency response coverage rate, one-time pass rate of drill acceptance, emergency self-healing coverage rate, and emergency fault resolution rate. Based on the drill management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: automated drill rate, drill frequency, and implementation rate of post-drill improvement measures; the three result-oriented evaluation indicators include: drill plan coverage rate, drill plan completion rate, and drill plan availability rate; Based on the ONCALL management work items, three process-oriented evaluation indicators and two result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: ONCALL response rate, ONCALL response accuracy rate and ONCALL response average time. The two result-oriented evaluation indicators include: ONCALL self-discovery rate and ONCALL self-resolution rate. Based on the inspection management work items, three process-oriented evaluation indicators and three result-oriented evaluation indicators are constructed. The three process-oriented evaluation indicators include: inspection work order timeliness rate, inspection problem recurrence times and standardized inspection feedback timeliness rate; the three result-oriented evaluation indicators include: inspection work order resolution rate, standardized inspection feedback completion rate and standardized inspection feedback accuracy rate; Seven result-oriented evaluation indicators are constructed based on the asset management work items, including: business system information completeness rate, resource pool naming consistency rate, cluster naming compliance rate, host management consistency rate, host instance completeness rate, application instance coverage rate and application instance completeness rate.

8. The SRE management health evaluation system according to claim 6, characterized in that: The current health calculation module of the management work item is specifically: The current operation stage of each evaluation indicator is obtained, and the target value of the next cycle of the evaluation indicator is generated according to the current indicator value and the current operation stage. When the current operation stage is normal operation, the current target value is used as the target value of the next cycle. When the current operation stage is construction advancement, the current target value is input into the first formula to calculate the target value of the next cycle, where the first formula is: The target value of the next cycle = current target value * (1 + a) Among them, a represents the improvement ratio.

9. The SRE management health evaluation system according to claim 6, characterized in that: Also includes: The alarm module is used to trigger an SLO alarm when the current health of the SRE is lower than a health threshold.

10. The SRE management health evaluation system according to claim 6, characterized in that: Also includes: The visualization module is used to visualize the completion of each evaluation indicator, the current health of each management work item, and the current health of SRE through Grafana.

Citation Information

Patent Citations

  • Health degree analysis method and device of business system, electronic equipment and storage medium

    CN118246621A