A method and system for automatic continuous improvement of a devops platform

Abstract

The present application relates to a method and system for automatic continuous improvement of a DevOps platform. The method comprises collecting defect data of a business, pushing a defect event to a relevant person, determining a root cause category of the defect event and an improvement measure or a preventive measure, judging the effectiveness of the measure, outputting the measure and automatically including the improvement measure in the daily work targets of each team on the DevOps platform, continuously implementing the improvement measure, tracking the implementation result feedback of the measure, quantifying the improvement quality, and further improving the key points in each step based on the improvement quality result. The method fully considers the mutual relationship among the three elements of people, processes and tools in the continuous improvement process of the DevOps platform, guides people to conduct lean root cause analysis of defect events, and on this basis, outputs effective improvement measures based on people, processes and tools on the DevOps platform, and dynamically tracks the implementation results, and dynamically establishes a self-feedback DevOps continuous improvement system according to the implementation results.

Description

TECHNICAL FIELD

[0001] The application belongs to the technical field of DevOps platform operation and maintenance, and particularly relates to a DevOps platform automatic continuous improvement method and system. BACKGROUND

[0002] Although the automatic continuous improvement of the DevOps platform can bring great benefits, how to quickly feed back various failures or problems to the DevOps and realize the automatic and intelligent continuous improvement of the DevOps platform has no mature solution at present. SUMMARY

[0003] In order to solve the problem that the current DevOps platform cannot realize automatic and intelligent continuous improvement based on the rapid feedback of failures or problems, we provide a solution.

[0004] We believe that the automatic continuous improvement process of the DevOps platform includes three elements of individuals, processes and tools, and the real-time collaboration function of the DevOps platform closely links all people in the organization, therefore, based on the analysis and mining of the data of the above three elements, the unknown correlation, process improvement mode and other useful information can be revealed, the cluster decision output improvement scheme can be realized, the failure scene or problem can be quickly fed back to the process and tool, and the process and tool can be continuously optimized.

[0005] Specifically, in a first aspect, the application provides a DevOps platform automatic continuous improvement method, which comprises:

[0006] S1: continuously collecting defect data of a business, and recording the defects that have been solved and closed as defect analysis events;

[0007] S2: pushing the defect analysis events to relevant persons in real time, pushing a defect root cause analysis event to the relevant persons (generally defect solvers) if the defect is marked as solved, pushing a defect measure analysis event to the relevant persons (generally defect solving teams and quality acceptance teams) if the defect is marked as closed, for complex defect analysis events, a (quality control team) QA special meeting is needed to be initiated to trace back, based on the result information collected in advance, the final improvement measures are obtained, the information is shared in real time, the key backtracking factors and the corresponding weighting value list are dynamically maintained, the estimated value of the defect analysis event backtracking value is calculated according to the weighting value, and the estimated value is pushed to the relevant persons;

[0008] S3: the relevant persons determine at least one root cause category or at least one root cause improvement measure or preventive measure of the defect analysis event according to a root cause or measure analysis template, and dynamically judge whether the improvement measure or preventive measure is an effective measure;

[0009] S4: output the summarized root cause improvement measures or preventive measures in real time;

[0010] S5: automatically include the root cause improvement measures or preventive measures output in the previous step into the daily work objectives of DevOps, continuously implement the root cause improvement measures or preventive measures, and continuously manage the progress of the implementation on the DevOps platform;

[0011] S6: continuously track the result feedback of the implementation tasks of the root cause improvement measures or preventive measures traceable on the DevOps platform, dynamically maintain the key backtracking factors and corresponding weighting values in the improvement or prevention process, and use them to quantify the improvement or prevention quality of each process;

[0012] S7: based on the improvement or prevention quality results of each process obtained in the previous step, improve the list of key backtracking factors and corresponding weighting values in step S2, the root cause analysis template in step S3, and the algorithm for dynamically determining whether the measures are effective, and the output strategy of the root cause improvement measures or preventive measures in step S4.

[0013] Further, according to some embodiments of the present application, the defect analysis event recorded in step S1 of the method for automatically and continuously improving the DevOps platform of the present application includes a complete defect event processing process, including:

[0014] (1) the process of time + person + defect discovery;

[0015] (2) the process of time + person + positioning analysis;

[0016] (3) the process of time + person + defect repair.

[0017] Further, according to some embodiments of the present application, after the estimation of the defect analysis event backtracking value is pushed to the relevant person in step S2 of the method for automatically and continuously improving the DevOps platform of the present application, the support team cluster strategy and individual separate analysis input are supported, and the analysis results are synchronized in real time.

[0018] Further, according to some embodiments of the present application, the root cause or measure analysis template in step S3 of the method for automatically and continuously improving the DevOps platform of the present application includes root cause categories, root cause improvement measures, and root cause preventive measures.

[0019] Further, the root cause improvement measures and root cause preventive measures in the above-mentioned method for automatically and continuously improving the DevOps platform include:

[0020] (1) Root cause improvement measures

[0021] Demand improvement: including improving communication and cooperation with customers, improving demand templates, checklists, demand management processes, and tools;

[0022] Architecture improvement: includes performing architecture analysis, analyzing the robustness and stability of the architecture, introducing domain-specific training;

[0023] High-level design improvement: includes supplementing design research documentation, introducing domain- and / or product-specific training, adding items to the design template and / or design checklist;

[0024] Low-level design improvement: includes adding items to the low-level design template, checklist, and review criteria, introducing low-level design-specific training;

[0025] Coding quality improvement: includes improving coding standards and guidelines, improving code review checklists, and improving code review tools;

[0026] Improvement of user documentation: includes testing user documentation, team review of documentation;

[0027] Improvement of configuration and fault management: includes automating manual processes, improving analysis tools and plans;

[0028] Improvement of professional knowledge and training: includes improving product, domain, architecture, tool platform, and technology, introducing training on development processes and support tools;

[0029] (2) Root cause prevention measures

[0030] Technical review improvement: includes ensuring that technical reviews are completed on time, establishing or improving review tools;

[0031] Code analysis tool improvement: includes improving static and dynamic code analysis tools;

[0032] Unit test improvement: includes improving the content and path of mandatory unit tests;

[0033] Improvement of system component and / or module testing: includes adding or improving system component and / or module test cases;

[0034] Improvement of integration and verification testing: includes adding or improving integration and verification test cases;

[0035] Improvement of system verification functional testing: includes adding or improving system verification functional test cases;

[0036] Improvement of system verification, non-functional testing: includes adding non-functional test cases, adding robustness or exploratory test cases.

[0037] Further, according to some embodiments of the present application, the root cause improvement measures or preventive measures summarized in step S4 of the method of automatic continuous improvement of the DevOps platform are output in the form of an improvement list, which includes improvement items for individuals, processes, and tools, wherein:

[0038] The improvement items for individuals include individual learning or training items;

[0039] The improvement items for processes include improvement or standardization of specific implementation processes;

[0040] The improvement items for tools include improvement of the requirements of the DevOps platform.

[0041] Further, the continuous implementation of the root cause improvement measures or preventive measures in step S5 of the method of automatic continuous improvement of the DevOps platform includes:

[0042] For individual improvement items: the DevOps interface training platform automatically pushes training or training requirements to the relevant person, sets a deadline, dynamically tracks the completion status and regularly publicizes the completion results;

[0043] For process improvement items: the following methods are used,

[0044] (1) Directly through automatic quantitative results, automatically create the improvement items as daily work goals on the DevOps platform for each team, set different deadlines based on the completion of each team, dynamically track the completion status and regularly publicize the completion results;

[0045] (2) Items that cannot be quantified by automation but can be tracked on the DevOps platform: first identify whether the improvement items are included in the daily work goals recorded on the DevOps platform of the target team, if not, the DevOps platform dynamically adds an example requirement for the improvement items to the target team, and real-time tracks the completion of the tasks split from the example requirement;

[0046] For tool improvement items: automatically create tasks or requirements for corresponding tool teams, dynamically track the completion status and regularly publicize the completion results.

[0047] In a second aspect, the present application also provides a system for automatic continuous improvement of a DevOps platform, which implements the method of automatic continuous improvement of the DevOps platform as described above, and the system includes:

[0048] A data collection module: used for continuously collecting defect data of the business, and recording the collected defect data meeting the conditions as defect analysis events;

[0049] Value evaluation module: used for calculating the quantitative evaluation of defect analysis event backtracking value according to the weighted value;

[0050] Analysis processing module: used for determining the root cause category and root cause improvement measures or preventive measures of the defect analysis event, and dynamically judging whether the improvement measures or preventive measures are effective measures;

[0051] Measure management module: used for automatically listing the root cause improvement measures or preventive measures in the daily work targets of the DevOps platform, and managing the process of continuous implementation;

[0052] System maintenance module: used for dynamically maintaining the list of key backtracking factors and corresponding weighted values;

[0053] Effect evaluation module: used for tracking and collecting the implementation result feedback of the root cause improvement measures or preventive measures, and quantifying the improvement or prevention quality of each process;

[0054] Result feedback module: used for feeding back the quality results of the improvement or prevention measures of each process, prompting the improvement of key backtracking factors and corresponding weighted value list, root cause or measure analysis template, and dynamically judging whether the measures are effective, output strategy of root cause improvement measures or preventive measures.

[0055] In a third aspect, the present application also provides a computer readable storage medium, the storage medium stores a computer program, the program is executed by a processor to realize the steps of the DevOps platform automatic continuous improvement method described above.

[0056] In summary, the DevOps platform automatic continuous improvement method of the present application has the following characteristics:

[0057] (1) The method fully considers the mutual relationship of the three elements: people, processes and tools in the continuous improvement process of the DevOps platform, guides people to conduct lean root cause analysis of defect events, and on this basis, outputs effective improvement measures based on people, processes and tools that can be tracked on the DevOps platform, and dynamically tracks the implementation results in real time, and dynamically establishes a self-feedback DevOps continuous improvement system according to the implementation results and multi-party considerations.

[0058] (2) The method designs an interactive root cause analysis system for the DevOps platform, based on lean analysis and mining of defect events and analysis data, reveals unknown correlations, process improvement methods and other useful information, and automatically converts the obtained effective improvement measures into daily work targets that can be tracked on the DevOps platform, realizes the output of improvement schemes, and the defect improvement measures are quickly fed back to the improvement of people, processes and tools, and realizes the continuous improvement of the DevOps platform. BRIEF DESCRIPTION OF DRAWINGS

[0059] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, not all embodiments, and other drawings can be obtained by those skilled in the art without creative labor on the basis of these drawings.

[0060] Figure 1 The present application is a DevOps platform automatic continuous improvement method flowchart.

[0061] Figure 2 The present application is a DevOps platform automatic continuous improvement system structure schematic diagram. DETAILED DESCRIPTION

[0062] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme of the present application will be described clearly and completely in combination with specific embodiments. Obviously, the described embodiments are only some embodiments of the present application, not all embodiments, and the present application can also be implemented or applied by different specific embodiments, and each detail in the specification can be modified or changed based on different views and applications without departing from the spirit of the present application.

[0063] It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict; and all other embodiments obtained by those skilled in the art based on the embodiments in the present disclosure without creative labor are within the scope of protection of the present disclosure.

[0064] It should be noted that the aspects described herein can be embodied in a wide variety of forms and any specific structure and / or function described herein is merely illustrative. Based on the present disclosure, those skilled in the art should understand that one aspect described herein can be implemented independently of any other aspect, and two or more of these aspects can be combined in various ways, for example, a device can be implemented and / or a method can be practiced using any number of the aspects described herein.

[0065] The present application will be described in detail below in combination with the embodiments shown in the drawings.

[0066] According to Figure 1 As shown in the figure, the present application DevOps platform automatic continuous improvement method includes:

[0067] S1. Continuously collect defect data of the business, record the collected defect data as defect analysis events, and record each solved defect event as a solved event; the solved event records the complete defect event handling process, including the process of time + person + defect discovery, the process of time + person + positioning analysis, and the process of time + person + defect repair.

[0068] S2. Real-time push the defect analysis event to the relevant person, if the defect is marked as solved, push the defect root cause analysis event to the relevant person (usually the defect solver), if the defect is marked as closed, push the defect measure analysis event to the relevant person (usually the defect solving team and quality acceptance team), for complex defect analysis events, a special traceability meeting needs to be initiated by the (quality control team) QA, based on the pre-summarized result information to derive the final improvement measures, implement real-time sharing of information, dynamically maintain the key traceability factors and the corresponding weight value list, calculate the estimated value of the defect analysis event traceability value according to the weight value, and push the estimated value to the relevant person according to a certain distribution strategy, support team cluster strategy and individual separate analysis input, and real-time synchronization of analysis results.

[0069] S3. The analysis processing module first inputs the preset root cause or measure analysis template, uses different root cause or measure analysis templates based on different analysis roles, the root cause or measure analysis template includes root cause categories, root cause improvement measures and root cause prevention measures, the relevant person determines at least one root cause category or at least one root cause improvement measure or prevention measure of the defect event according to the root cause or measure analysis template, and dynamically judges whether the improvement measure or prevention measure is an effective measure (which can be converted into a measure executed on the DevOps platform), and inputting invalid measures cannot complete the analysis process; specific root cause improvement measures and root cause prevention measures are shown in Table 1 and Table 2, and the system supports custom input of new categories.

[0070] Table 1 Root Cause Improvement Measures

[0071]

[0072] Table 2 Root Cause Prevention Measures

[0073]

[0074] S4. Real-time output of the summarized root cause improvement measures or prevention measures, the root cause improvement measures or prevention measures correspond to each link of the DevOps process, the summarized root cause improvement measures or prevention measures are output in the form of improvement items list, the improvement items list includes improvement items for individual, process and tool dimensions, wherein:

[0075] The individual improvement items include individual learning or training items;

[0076] Process improvement items include improving or standardizing specific implementation processes (such as architecture processes, use case design processes, etc.);

[0077] Tool improvement items include improving the requirements items of the DevOps platform.

[0078] S5. According to a certain strategy, the root cause improvement measures or preventive measures output in the previous step are automatically included in the daily work objectives of the DevOps platform, and the root cause improvement measures or preventive measures are continuously implemented, and the progress of the implementation is continuously managed in the DevOps platform; the specific DevOps platform continuous improvement items are shown in Table 3.

[0079] Table 3 DevOps platform improvement items

[0080]

[0081] S6. Collect result feedback, and dynamically maintain the key backtracking factors and corresponding weighting values in the improvement or prevention process based on the result feedback of the implementation task of the root cause improvement measures or preventive measures in the DevOps platform, and use the result feedback to quantify the improvement or prevention quality of each process.

[0082] S7. Based on the improvement or prevention quality results of each process obtained in the previous step, improve the list of key backtracking factors and corresponding weighting values in step S2, the root cause analysis template in step S3, and the algorithm for dynamically judging whether the measures are effective, and the output strategy of the root cause improvement measures or preventive measures in step S4.

[0083] According to Figure 2 As shown in FIG. 1, the DevOps platform automatic continuous improvement system of the present application comprises:

[0084] A data collection module is configured to continuously collect defect data of the business, and record the collected defect data meeting the conditions as defect analysis events;

[0085] A value evaluation module is configured to calculate the quantitative evaluation of the defect analysis event backtracking value according to the weighting value;

[0086] An analysis processing module is configured to determine the root cause category of the defect analysis event and the root cause improvement measures or preventive measures, and dynamically judge whether the improvement measures or preventive measures are effective measures;

[0087] A measure management module is configured to automatically include the root cause improvement measures or preventive measures in the daily work objectives of the DevOps platform, and manage the continuous implementation process;

[0088] A system maintenance module is configured to dynamically maintain the list of key backtracking factors and corresponding weighting values;

[0089] Effect evaluation module: used for tracking the implementation result feedback of root cause improvement measures or preventive measures, and quantifying the improvement or prevention quality of each process;

[0090] Result feedback module: used for feeding back the quality result of the improvement or prevention measures of each process, prompting the key backtracking factors and corresponding weighted value list, root cause or measure analysis template, and dynamically judging whether the algorithm is effective, output strategy of root cause improvement measures or preventive measures.

[0091] Each module is implemented and operated according to the automatic continuous improvement method of the DevOps platform.

[0092] Each embodiment in the present application is described in a progressive manner, and the same or similar parts between each embodiment can be referred to each other.

[0093] The above only describes the embodiments of the present application and is not used to limit the present application. The present application can have various changes and variations for those skilled in the art. Any modification, replacement, etc. within the spirit and principle of the present application shall be included in the protection scope of the claims of the present application.

Claims

1. A method for DevOps platform automatic continuous improvement, characterized in that, The method comprises: S1: continuously collecting defect data of the business, and recording the defects that have been solved and closed as defect analysis events; S2: pushing the defect analysis events to the relevant persons in real time, pushing the defect root cause analysis events to the relevant persons if the defects are marked as solved, pushing the defect improvement measures analysis events to the relevant persons if the defects are marked as closed, implementing real-time sharing of information, dynamically maintaining a list of key backtracking factors and corresponding weighting values, calculating the estimated value of the defect analysis event backtracking value according to the weighting values, and pushing the estimated value to the relevant persons; S3: determining at least one root cause category of the defect analysis event according to a root cause analysis template, or determining at least one root cause improvement measure or preventive measure of the defect analysis event according to a measure analysis template, and dynamically judging whether the improvement measure or preventive measure is an effective measure; S4: outputting the summarized root cause improvement measure or preventive measure in real time; S5: automatically including the root cause improvement measure or preventive measure output in step S4 into the daily work objectives of the DevOps platform, continuously implementing the root cause improvement measure or preventive measure, and continuously managing the progress of the implementation on the DevOps platform; S6: continuously tracking the result feedback of the implementation tasks of the root cause improvement measure or preventive measure that can be traced on the DevOps platform, dynamically maintaining the key backtracking factors and corresponding weighting values in the improvement or prevention process, and quantifying the improvement or prevention quality of each process according to the key backtracking factors and corresponding weighting values; S7: improving the key backtracking factors and corresponding weighting value list in step S2, the root cause analysis template in step S3, the algorithm for dynamically judging whether the measure is effective in step S3, and the output strategy of the root cause improvement measure or preventive measure in step S4 based on the improvement or prevention quality result of each process obtained in step S6.

2. The method of automatic continuous improvement of DevOps platform according to claim 1, characterized in that, The defect analysis events recorded in step S1 record the complete defect event processing process, which specifically includes: recording the time, personnel and discovery process of discovering the defect, and recording the time, personnel and positioning analysis process of analyzing the defect, and recording the time, personnel and repair process of repairing the defect.

3. The method of claim 1, wherein, After the estimated value of the defect analysis event backtracking value is pushed to the relevant persons in step S2, the support team cluster decision and individual separate analysis input are supported, and the analysis results are synchronized in real time.

4. The method of claim 1, wherein, The root cause or measure analysis template in step S3 includes root cause categories, root cause improvement measures and root cause preventive measures.

5. The DevOps platform automatic continuous improvement method according to claim 4, wherein (1) the root cause improvement measures include: demand improvement: including improving communication and cooperation with customers, improving demand templates, checklists, demand management processes and tools; architecture improvement: including performing architecture analysis, analyzing the robustness and stability of the architecture, and introducing preset field training; high-level design improvement: including supplementing design research documents, introducing preset field and / or product training, and adding projects to design templates and / or design checklists; low-level design improvement: including adding check items to low-level design templates, checklists and review standards, and introducing low-level design special training. Coding quality improvement: including improving coding standards and guidelines, improving code review checklist, improving code review tools; User documentation improvement: including testing user documentation, team review of documentation; Configuration and fault management improvement: automating manual processes, improving analysis means and plans; Improvement of professional knowledge and training: including improving products, fields, architectures, tool platforms, technologies, introducing training on development processes and support tools; (2) The root cause prevention measures include: Technical review improvement: including ensuring that technical reviews are completed on time, establishing or improving review tools; Code analysis tool improvement: including improving static and dynamic code analysis tools; Unit test improvement: including improving the content and path of mandatory unit tests; Improvement of system component and / or module testing: including adding or improving system component and / or module test cases; Integration and verification test improvement: including adding or improving integration and verification test cases; System verification functional test improvement: including adding or improving system verification functional test cases; System verification, non-functional test improvement: including adding non-functional test cases, adding robustness or exploratory test cases.

6. The method of automatic continuous improvement of DevOps platform of claim 1, wherein, The root cause improvement measures or prevention measures summarized in step S4 are output in the form of an improvement list, which includes improvement items for individuals, processes, and tools: Individual improvement items include individual learning or training items; Process improvement items include improving or standardizing specific implementation processes; Tool improvement items include improving the requirements of the DevOps platform.

7. The method of claim 6, wherein, The continuous implementation of root cause improvement measures or prevention measures in step S5 includes: For individual improvement items: the DevOps platform connects to the training platform, automatically pushes training or training requirements to the relevant person, sets a deadline, dynamically tracks completion, and regularly publicizes the completion results; For process improvement items: handled as follows, (1) Automatically create the improvement item as a daily work goal on the DevOps platform that can be traced for each team directly through automated quantitative results, set different deadlines based on the completion of each team, dynamically track completion, and regularly publicize the completion results; (2) Items that cannot be quantified by automation but can be tracked on the DevOps platform are first identified in the daily work goals recorded on the DevOps platform of the target team, if not, the DevOps platform dynamically adds an example requirement to implement the improvement item to the target team, and real-time tracks the completion of the task split into tasks; For tool improvement items: automatically create tasks or requirements for corresponding tool teams, dynamically track completion, and regularly publicize completion results.

8. A system for automatic continuous improvement of a DevOps platform, the system implementing the method for automatic continuous improvement of a DevOps platform according to any one of claims 1-7, characterized in that, The system includes: Data collection module: for continuously collecting business defect data, and recording the collected defect data that meet the conditions as defect analysis events; Value assessment module: for calculating the quantitative valuation of defect analysis event backtracking value according to the weighted value; The analysis processing module is used to determine the root cause category and root cause improvement measure or preventive measure of the defect analysis event, and dynamically determine whether the improvement measure or preventive measure is an effective measure; The measure management module is used to automatically list the root cause improvement measure or preventive measure in the daily work target of the DevOps platform, and manage the process of continuous implementation; The system maintenance module is used to dynamically maintain the list of key backtracking factors and corresponding weighting values; The effect evaluation module is used to track and collect the implementation result feedback of the root cause improvement measure or preventive measure, and quantify the improvement or prevention quality of each process; The result feedback module is used to feed back the quality result of the improvement or prevention measure of each process, prompt the improvement of the key backtracking factors and the corresponding weighting value list, the root cause analysis template or the measure analysis template, and the algorithm of dynamically determining whether the measure is effective, the output strategy of the root cause improvement measure or preventive measure.

Images