An assembly line efficiency measurement and evaluation device and its operation method

By constructing metrics at different stages of the pipeline and automatically adjusting parallelism and resource allocation, the problem of insufficient efficiency assessment between multiple projects by pipeline management tools is solved, and stable and efficient pipeline operation is achieved.

CN114579138BActive Publication Date: 2025-08-01BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210211550.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-04
Publication Date
2025-08-01
Estimated Expiration
2042-03-04

AI Technical Summary

Technical Problem

The existing pipeline management tools lack the evaluation of the efficiency of each link between multiple projects, resulting in inefficient overall pipelines and inability to automatically optimize and resource utilization.

Method used

Provide a pipeline efficiency measurement and evaluation device, which realizes automated process control and resource optimization by constructing metrics in unit testing, code scanning, construction and deployment stages, adjusting parallelism, execution concurrency and server usage status.

Benefits of technology

It improves the overall execution efficiency of the assembly line, enables it to operate in a stable and efficient state, reduces manual intervention, and reduces procurement difficulty and cost.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114579138B_ABST
    Figure CN114579138B_ABST
Patent Text Reader

Abstract

The present invention provides a pipeline efficiency measurement and evaluation device and its operation method, belonging to big data. The device includes: a unit test efficiency measurement module, which is used to measure the number of unit tests and the unit test success rate data during the execution of the pipeline in the unit test stage, and adjust the configuration of the build machine and the parallelism of the pipeline; a code scanning efficiency measurement module, which is used to measure the code scanning efficiency of the pipeline in the code scanning stage, determine the overall server performance, and adjust the execution concurrency; a build duration and success rate measurement module, which is used to measure the build duration and success rate of the pipeline in the build stage, and adjust the concurrency number and waiting duration; a deployment duration and success rate measurement module, which is used to measure the duration and success rate of the pipeline in the deployment stage, and determine the usage status of the pipeline server. The present invention can improve the execution efficiency of the overall pipeline and make the entire pipeline run in a stable and efficient state.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of computer data processing, and in particular to a pipeline efficiency measurement and evaluation device and an operating method thereof. Background Art

[0002] This section is intended to provide a background or context to embodiments of the invention that are recited in the claims. No statement herein is admitted to be prior art by inclusion in this section.

[0003] In the software construction pipeline, for large-scale collaborative projects, there are many code projects, and there are many dependencies between the projects.

[0004] The current pipeline management method is to use sequential execution for the compilation, testing, quality construction, packaging, etc. of a single code project. For multiple projects, pipeline management tools tend to only manage submissions and do not evaluate the efficiency of each link in the pipeline.

[0005] Therefore, how to provide a new solution that can solve the above technical problems is a technical problem that needs to be solved urgently in this field. Summary of the Invention

[0006] An embodiment of the present invention provides a pipeline efficiency measurement and evaluation device. The present invention constructs measurement indicators in the unit testing stage, code scanning stage, construction stage, and deployment stage, completes the viewing of individual indicators and the comparison of overall indicators, improves the execution efficiency of the entire pipeline, and makes the entire pipeline run in a stable and efficient state, including:

[0007] The unit test efficiency measurement module is used to measure the number of unit tests and the unit test success rate during the pipeline execution during the unit test phase, and adjust the configuration of the build machine and the parallelism of the pipeline;

[0008] The code scanning efficiency measurement module is used to measure the code scanning efficiency of the pipeline during the code scanning phase, determine the overall server performance, and adjust the execution concurrency;

[0009] The build time and success rate measurement module is used to measure the build time and success rate of the pipeline during the build phase, and adjust the number of concurrent connections and waiting time.

[0010] The deployment time consumption and success rate measurement module is used to measure the time consumption and success rate of the pipeline during the deployment phase and determine the usage status of the pipeline server.

[0011] An embodiment of the present invention further provides an operating method of a pipeline efficiency measurement and evaluation device, comprising:

[0012] The unit test efficiency measurement module measures the number of unit tests and the unit test success rate data during the execution of the pipeline in the unit test phase, and adjusts the configuration of the build machine and the parallelism of the pipeline;

[0013] The code scanning efficiency measurement module measures the code scanning efficiency of the pipeline in the code scanning phase, determines the overall server performance, and adjusts the execution concurrency;

[0014] The build duration and success rate measurement module measures the build duration and success rate of the pipeline in the build phase, and adjusts the concurrency number and waiting duration;

[0015] The deployment duration and success rate measurement module measures the duration and success rate of the pipeline in the deployment phase, and determines the usage status of the pipeline server.

[0016] An embodiment of the present invention also provides a computer device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, the running method of the above-mentioned pipeline efficiency measurement and evaluation device is implemented.

[0017] An embodiment of the present invention also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the running method of the above-mentioned pipeline efficiency measurement and evaluation device is implemented.

[0018] An embodiment of the present invention also provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the running method of the above-mentioned pipeline efficiency measurement and evaluation device is implemented.

[0019] An apparatus for measuring and evaluating the efficiency of a pipeline and its operation method provided by an embodiment of the present invention includes: a unit test efficiency measurement module, which is used to measure the number of unit tests and the data of the success rate of unit tests during the execution of the pipeline in the unit test stage, and adjust the configuration of the build machine and the parallelism of the pipeline; a code scanning efficiency measurement module, which is used to measure the code scanning efficiency of the pipeline in the code scanning stage, determine the overall server performance, and adjust the execution concurrency; a build time and success rate measurement module, which is used to measure the build duration and success rate of the pipeline in the build stage, and adjust the number of concurrencies and the waiting duration; a deployment time and success rate measurement module, which is used to measure the time and success rate of the pipeline in the deployment stage, and determine the usage status of the pipeline server. The present invention constructs measurement indicators in the unit test stage, code scanning stage, build stage, and deployment stage respectively, completes the viewing of individual indicators and the comparison viewing of overall indicators, improves the execution efficiency of the overall pipeline, and enables the entire pipeline to run in a stable and efficient state; the dependency relationship between projects in the present invention can be used, and the process control can be completed without manual intervention, making full use of environmental resources, enabling the code construction to be executed with the highest efficiency, having no special requirements for the pipeline management tools in the market, and the procurement difficulty and cost can be controlled. Brief Description of the Drawings

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts. In the drawings:

[0021] Figure 1 It is a schematic diagram of an apparatus for measuring and evaluating the efficiency of a pipeline according to an embodiment of the present invention.

[0022] Figure 2 It is a schematic structural diagram of an apparatus for measuring and evaluating the efficiency of a pipeline according to an embodiment of the present invention.

[0023] Figure 3 It is a schematic diagram of the operation method of an apparatus for measuring and evaluating the efficiency of a pipeline according to an embodiment of the present invention.

[0024] Figure 4 It is a schematic diagram of the unit test efficiency measurement process of the operation method of an apparatus for measuring and evaluating the efficiency of a pipeline according to an embodiment of the present invention.

[0025] Figure 5 It is a schematic diagram of a computer device for running the operation method of an apparatus for measuring and evaluating the efficiency of a pipeline according to an embodiment of the present invention. Detailed Description of the Embodiments

[0026] To make the objectives, technical solutions and advantages of the embodiments of the present invention clearer and more understandable, the following further describes the embodiments of the present invention in detail with reference to the accompanying drawings. Herein, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but not to limit the present invention.

[0027] The present invention belongs to the field of big data technology. Figure 1 This is a schematic diagram of a pipeline efficiency measurement and evaluation device according to an embodiment of the present invention. As Figure 1 shown, the embodiment of the present invention provides a pipeline efficiency measurement and evaluation device. The present invention constructs measurement indicators respectively in the unit test stage, code scanning stage, build stage and deployment stage, completes the viewing of individual indicators and the comparison viewing of overall indicators, improves the execution efficiency of the overall pipeline, and enables the entire pipeline to run in a stable and efficient state, including:

[0028] A unit test efficiency measurement module 101, which is used to measure the number of unit tests and the data of unit test success rate during the execution of the pipeline in the unit test stage, and adjust the configuration of the build machine and the parallelism of the pipeline;

[0029] A code scanning efficiency measurement module 102, which is used to measure the code scanning efficiency of the pipeline in the code scanning stage, determine the overall server performance, and adjust the execution concurrency;

[0030] A build duration and success rate measurement module 103, which is used to measure the build duration and success rate of the pipeline in the build stage, and adjust the concurrency number and waiting duration;

[0031] A deployment duration and success rate measurement module 104, which is used to measure the duration and success rate of the pipeline in the deployment stage, and determine the usage status of the pipeline server.

[0032] A pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention includes: a unit test efficiency measurement module, which is used to measure the number of unit tests and the data of unit test success rate during the execution of the pipeline in the unit test stage, and adjust the configuration of the builder and the parallelism of the pipeline; a code scanning efficiency measurement module, which is used to measure the code scanning efficiency of the pipeline in the code scanning stage, determine the overall server performance, and adjust the execution concurrency; a build duration and success rate measurement module, which is used to measure the build duration and success rate of the pipeline in the build stage, and adjust the concurrency number and waiting duration; a deployment duration and success rate measurement module, which is used to measure the duration and success rate of the pipeline in the deployment stage, and determine the usage status of the pipeline server. In the present invention, measurement indicators are constructed respectively in the unit test stage, the code scanning stage, the build stage and the deployment stage, the viewing of individual indicators and the comparison viewing of overall indicators are completed, the execution efficiency of the overall pipeline is improved, and the whole pipeline runs in a stable and efficient state; the dependency relationship between projects in the present invention can be used, and process control can be completed without manual intervention, making full use of environmental resources, enabling code construction to be executed with the highest efficiency, having no special requirements for pipeline management tools in the market, and the procurement difficulty and cost can be controlled.

[0033] Figure 2 The structural schematic diagram of a pipeline efficiency measurement and evaluation device according to an embodiment of the present invention is as Figure 2 shown. When specifically implementing a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, it may include:

[0034] A unit test efficiency measurement module, which is used to measure the number of unit tests and the data of unit test success rate during the execution of the pipeline in the unit test stage, and adjust the configuration of the builder and the parallelism of the pipeline;

[0035] A code scanning efficiency measurement module, which is used to measure the code scanning efficiency of the pipeline in the code scanning stage, determine the overall server performance, and adjust the execution concurrency;

[0036] A build duration and success rate measurement module, which is used to measure the build duration and success rate of the pipeline in the build stage, and adjust the concurrency number and waiting duration;

[0037] A deployment duration and success rate measurement module, which is used to measure the duration and success rate of the pipeline in the deployment stage, and determine the usage status of the pipeline server.

[0038] In the unit test stage, code scanning stage, build stage, and deployment stage, the present invention constructs metric indicators respectively, completes the viewing of individual indicators and the comparison viewing of overall indicators, improves the execution efficiency of the overall pipeline, and enables the entire pipeline to operate in a stable and efficient state; in the present invention, the dependency relationships between projects can be utilized, and process control can be completed without manual intervention, making full use of environmental resources, enabling code construction to be executed with the highest efficiency, having no special requirements for pipeline management tools in the market, and controlling the procurement difficulty and cost.

[0039] When specifically implementing a pipeline efficiency metric evaluation device provided by an embodiment of the present invention, in one embodiment, the unit test efficiency metric module is specifically used for:

[0040] In the unit test stage, measure the change in the number of unit tests during the execution of a single project pipeline according to time, and measure the change in the unit test success rate data during the execution of a single project pipeline according to time;

[0041] According to the change in the number of unit tests during the execution of a single project pipeline and the change in the unit test success rate data during the execution of a single project pipeline, measure the number of unit tests and the unit test success rate during the execution of all project pipelines, screen out the pipelines with long unit test duration and low unit test success rate, and adjust the configuration of the build machine and the parallelism of the pipeline.

[0042] In the embodiment, for the unit test stage, the unit test efficiency metric of the CI pipeline of the project mainly includes:

[0043] Measure the change in the number of unit tests during the execution of a single project pipeline according to time, measure the change in the unit test success rate during the execution of a single project pipeline according to time, measure the number of unit tests and the overall success rate during the execution of all pipelines, so as to sort the pipelines with long duration and low success rate and give development suggestions, and adjust the configuration of the build machine and the parallelism of the pipeline to improve the execution efficiency of the overall pipeline.

[0044] Furthermore, for the unit test stage of the pipeline process, measure the number of unit tests and the average execution time of unit tests. For the same project pipeline, the impact of the number of unit tests and the execution time on the unit test efficiency during the iteration process can be found by referring to the historical data line chart. The differences in the unit test efficiency of projects of different scales can also be evaluated by referring to the number of unit tests and the execution time of different project pipelines. Thus, according to the project and unit test scale, adjust the use of the build machine and the parallelism of the pipeline to improve the execution efficiency of the overall pipeline.

[0045] When specifically implementing a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, the code scanning efficiency measurement module is specifically used for:

[0046] In the code scanning stage, measure the chart metrics of the number of lines of code in a single pipeline and the sonnar static code scanning time, measure the chart metrics of the total number of lines of code in the pipeline and the sonnar static code scanning time, and determine the code scanning efficiency;

[0047] Calculate the overall server performance according to the number of executed projects, combined with the code scanning efficiency;

[0048] According to the overall server performance, when the dependency relationship meets the set conditions, adjust the concurrency number and waiting duration.

[0049] In the embodiment, in the code scanning stage, the measurement of the code scanning efficiency of the CI pipeline of the project mainly includes:

[0050] Measure the chart metrics of the number of lines of code in a single pipeline and the sonnar static code scanning time, measure the chart metrics of the total number of lines of code in the pipeline and the sonnar static code scanning time, and combine the number of executed projects to estimate the overall server performance. When the dependency relationship permits, execute the maximum concurrency to shorten the overall execution time.

[0051] Furthermore, in the code scanning stage, increase the efficiency measurement of unit tests, mainly increase the measurement of code quality during the code scanning process, mainly increase the chart metrics of the number of lines of code and the sonnar static code scanning time. And estimate the overall server performance according to the number of executed projects. When the dependency relationship permits, execute the maximum concurrency to shorten the overall execution time.

[0052] When specifically implementing a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, the build time and success rate measurement module is specifically used for:

[0053] In the build stage, measure the build duration and success rate of a single pipeline at different time periods to evaluate the changes and problem positioning of the current pipeline;

[0054] Measure the build duration and success rate of the overall pipeline at different time periods to evaluate the status of the machine carrying the project build, and adjust the concurrency number and waiting duration.

[0055] In the embodiment, during the construction phase, the construction time consumption and success rate are measured, mainly including: measuring the chart indicators of the success rate of the pipeline during the construction phase, including measuring the construction duration and success rate of the single / whole pipeline at different times, evaluating the machine carrying the project construction, the adjusted concurrency number and waiting duration.

[0056] Furthermore, the measurement of the success rate of the pipeline during the construction phase includes measuring the construction duration success rate of a single pipeline at different times to evaluate the changes and problem positioning of the current project pipeline. It also includes measuring the construction duration and success rate of different projects of the whole project. Analyze and locate the problems of the project, evaluate whether the concurrency number received by the machine carrying the project construction is reasonable, and timely adjust and increase the limit of the concurrency number.

[0057] When specifically implementing a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, a time consumption and success rate measurement module is deployed, specifically used for:

[0058] During the deployment phase, measure the chart indicators of the success rate of the pipeline, determine the server usage status of single and whole pipelines, and locate the server disks that need to be cleaned.

[0059] In the embodiment, during the deployment phase, the deployment time consumption and success rate are measured, mainly including: measuring the chart indicators of the success rate of the pipeline during the deployment phase. Evaluate the server usage status of single and whole pipelines, facilitate locating specific server disks, and clean them in time. Make the whole system run in a stable and efficient state.

[0060] Furthermore, the measurement of the pipeline time consumption and success rate during the deployment phase is used to evaluate the server usage status of single and whole pipelines, facilitate locating specific server disks, and clean them in time. It can make the whole system run in a stable and efficient state.

[0061] Next, in combination with a specific scenario, a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention is briefly described:

[0062] A pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention mainly includes:

[0063] An efficiency measurement module for unit testing:

[0064] For the unit test phase of the pipeline process, measure the number of unit tests and the average execution time of unit tests. For the same project pipeline, the line chart of historical data can be referred to find the impact of the number of unit tests and execution time on the unit test efficiency during the iteration process. The number of unit tests and execution time of different project pipelines can also be referred to evaluate the differences in unit test efficiency of projects of different scales. Thus, according to the project and unit test scales, adjust the use of the builder and the parallelism of the pipeline to improve the overall execution efficiency of the pipeline.

[0065] Code quality measurement module in the code scanning process:

[0066] In the code scanning stage, add chart metrics such as the number of code lines and the time of sonnar static code scanning for measurement. And estimate the overall server performance according to the number of executed projects. When the dependencies allow, execute the maximum degree of concurrency to shorten the overall execution time.

[0067] Build time and success rate measurement module:

[0068] Measure the success rate of the pipeline in the build stage. This includes measuring the build duration success rate of a single pipeline at different times to evaluate the changes and problem positioning of the current project pipeline. It also includes measuring the build duration and success rate of different projects in the overall project. Analyze and locate the problems of the project, evaluate whether the number of concurrent requests received by the machine carrying the project build is reasonable, and adjust the limit of increasing the number of concurrent requests in a timely manner.

[0069] Deployment time and success rate measurement module:

[0070] Measure the deployment time and success rate of the pipeline in the deployment stage, which is used to evaluate the server usage status of a single and the overall pipeline, facilitate locating the specific server disk, and clean it in a timely manner. It can make the entire system run in a stable and efficient state.

[0071] The overall operation process of a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention includes:

[0072] 1. Measure the unit test efficiency of the CI pipeline of the project;

[0073] 2. Measure the code scanning efficiency of the CI pipeline of the project;

[0074] 3. Measure the build time and success rate;

[0075] 4. Measure the deployment time and success rate;

[0076] The specific process is as follows:

[0077] 1. Measure the unit test efficiency of the CI pipeline of the project:

[0078] Measure the change in the number of unit tests during the execution of a single engineering pipeline according to time.

[0079] Measure the change in the success rate of unit tests during the execution of a single engineering pipeline according to time

[0080] Measure the number of unit tests and the overall success rate during the execution of all pipelines, so as to sort out the pipelines with long execution time and low success rate and give development suggestions, and adjust the configuration of the build machine and the parallelism of the pipeline to improve the overall execution efficiency of the pipeline.

[0081] 2. Measure the code scanning efficiency of the CI pipeline of the project:

[0082] Measure the chart metrics of the number of code lines and sonnar static code scanning time of a single pipeline

[0083] Measure the chart metrics of the number of code lines and sonnar static code scanning time of the overall pipeline. Estimate the overall server performance according to the number of executed projects, and execute the maximum concurrency allowed for the dependencies to shorten the overall execution time.

[0084] 3. Measure the build time and success rate:

[0085] Measure the chart metrics of the success rate of the pipeline during the build phase. Include measuring the build duration and success rate of single / overall pipelines at different times, evaluating the machines carrying the project builds, adjusting the number of concurrencies and waiting durations.

[0086] 4. Measure the deployment time and success rate:

[0087] Measure the chart metrics of the success rate of the pipeline during the deployment phase. Evaluate the server usage of single and overall pipelines, facilitate locating the specific server disks, and clean them up in time. Make the entire system run in a stable and efficient state.

[0088] When using a pipeline efficiency measurement and evaluation device according to an embodiment of the present invention, it is necessary to screen and view the pipeline projects with abnormal measurement indicators, understand the reasonable level of the overall measurement values, and adjust the use of machine resources according to the usage performance conditions.

[0089] In the unit test stage, code scanning stage, building stage, and deployment stage, the present invention constructs measurement metrics respectively, completes the viewing of individual metrics and the comparison viewing of overall metrics, improves the execution efficiency of the overall pipeline, and enables the entire pipeline to operate in a stable and efficient state; in the present invention, the dependency relationships between projects can be utilized, and process control can be completed without manual intervention, making full use of environmental resources, enabling code construction to be executed with the highest efficiency, having no special requirements for pipeline management tools in the market, and controlling the procurement difficulty and cost.

[0090] In an embodiment of the present invention, a running method of a pipeline efficiency measurement and evaluation device is also provided, as described in the following embodiments. Since the principle of solving problems by this running method is similar to that of a pipeline efficiency measurement and evaluation device, the implementation of this running method can refer to the implementation of a pipeline efficiency measurement and evaluation device, and the repeated parts will not be elaborated.

[0091] Figure 3 It is a schematic diagram of the running method of a pipeline efficiency measurement and evaluation device according to an embodiment of the present invention, as Figure 3 shown, an embodiment of the present invention also provides a running method of a pipeline efficiency measurement and evaluation device, which may specifically include:

[0092] Step 301: The unit test efficiency measurement module measures the number of unit tests and the unit test success rate data during the execution of the pipeline in the unit test stage, and adjusts the configuration of the build machine and the parallelism of the pipeline;

[0093] Step 302: The code scanning efficiency measurement module measures the code scanning efficiency of the pipeline in the code scanning stage, determines the overall server performance, and adjusts the execution concurrency;

[0094] Step 303: The build duration and success rate measurement module measures the build duration and success rate of the pipeline in the build stage, and adjusts the concurrency number and waiting duration;

[0095] Step 304: The deployment duration and success rate measurement module measures the duration and success rate of the pipeline in the deployment stage, and determines the usage status of the pipeline server.

[0096] Figure 4 It is a schematic diagram of the unit test efficiency measurement process of the running method of a pipeline efficiency measurement and evaluation device according to an embodiment of the present invention, as Figure 4 shown, when specifically implementing the running method of a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, the unit test efficiency measurement module measures the number of unit tests and the unit test success rate data during the execution of the pipeline in the unit test stage, and adjusts the configuration of the build machine and the parallelism of the pipeline, including:

[0097] Step 401: In the unit test phase, measure the change in the number of unit tests during the execution of a single project pipeline according to time, and measure the change in the unit test success rate data during the execution of a single project pipeline according to time;

[0098] Step 402: According to the change in the number of unit tests during the execution of a single project pipeline and the change in the unit test success rate data during the execution of a single project pipeline, measure the number of unit tests and the unit test success rate during the execution of all project pipelines, screen out the pipelines with long unit test duration and low unit test success rate, and adjust the configuration of the build machine and the parallelism of the pipeline.

[0099] When specifically implementing the operation method of a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, the code scanning efficiency measurement module measures the code scanning efficiency of the pipeline during the code scanning phase, determines the overall server performance, and adjusts the execution concurrency, including:

[0100] During the code scanning phase, measure the chart metrics of the number of code lines and sonnar static code scanning time of a single pipeline, measure the chart metrics of the number of code lines and sonnar static code scanning time of the overall pipeline, and determine the code scanning efficiency;

[0101] Calculate the overall server performance according to the number of executed projects and in combination with the code scanning efficiency;

[0102] According to the overall server performance, adjust the concurrency number and waiting duration when the dependency relationship meets the set conditions.

[0103] When specifically implementing the operation method of a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, the build duration and success rate measurement module measures the build duration and success rate of the pipeline during the build phase, and adjusts the concurrency number and waiting duration, including:

[0104] During the build phase, measure the build duration and success rate of a single pipeline at different time periods, and evaluate the changes and problem positioning of the current pipeline;

[0105] Measure the build duration and success rate of the overall pipeline at different time periods, evaluate the status of the machine carrying the project build, and adjust the concurrency number and waiting duration.

[0106] When specifically implementing the operation method of a pipeline efficiency measurement and evaluation device provided by an embodiment of the present invention, in one embodiment, the deployment duration and success rate measurement module measures the duration and success rate of the pipeline during the deployment phase, and determines the usage status of the pipeline server, including:

[0107] During the deployment phase, measure the chart metrics of the pipeline success rate, determine the server usage status of individual and overall pipelines, and locate the server disks that need to be cleaned up.

[0108] Figure 5 Schematic diagram of a computer device for running a method of a pipeline efficiency measurement and evaluation device according to an embodiment of the present invention. As Figure 5 shown, an embodiment of the present invention further provides a computer device 500, including a memory 510, a processor 520, and a computer program 530 stored on the memory and executable on the processor. When the processor executes the computer program, it implements the method of running the above-mentioned pipeline efficiency measurement and evaluation device.

[0109] An embodiment of the present invention further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements the method of running the above-mentioned pipeline efficiency measurement and evaluation device.

[0110] An embodiment of the present invention further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, it implements the method of running the above-mentioned pipeline efficiency measurement and evaluation device.

[0111] In summary, an embodiment of the present invention provides a pipeline efficiency measurement and evaluation device and its running method, including: a unit test efficiency measurement module, used to measure the number of unit tests and unit test success rate data during the unit test phase of the pipeline execution process, and adjust the configuration of the builder and the parallelism of the pipeline; a code scanning efficiency measurement module, used to measure the code scanning efficiency of the pipeline during the code scanning phase, determine the overall server performance, and adjust the execution concurrency; a build duration and success rate measurement module, used to measure the build duration and success rate of the pipeline during the build phase, and adjust the concurrency number and waiting duration; a deployment duration and success rate measurement module, used to measure the duration and success rate of the pipeline during the deployment phase, and determine the pipeline server usage status. The present invention constructs measurement metrics respectively in the unit test phase, code scanning phase, build phase, and deployment phase, completes the viewing of individual metrics and the comparison viewing of overall metrics, improves the execution efficiency of the overall pipeline, and enables the entire pipeline to run in a stable and efficient state; the dependency relationship between projects in the present invention can be used, and process control can be completed without manual intervention, making full use of environmental resources, enabling code construction to be executed with the highest efficiency, having no special requirements for market pipeline management tools, and controlling the procurement difficulty and cost.

[0112] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) that contain computer-usable program code.

[0113] The present invention is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to the embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices generate means for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0114] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including instruction means that implement the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0115] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in Figure 1 one flow or multiple flows and / or blocks Figure 1 one block or multiple blocks.

[0116] The specific embodiments described above further elaborate on the objectives, technical solutions, and beneficial effects of the present invention. It should be understood that the above are only specific embodiments of the present invention and are not used to limit the protection scope of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. An apparatus for evaluating the efficiency measurement of an assembly line, characterized in that including: Unit test efficiency measurement module, which is used to measure the number of unit tests and the success rate data of unit tests during the execution of the pipeline in the unit test stage, and adjust the configuration of the build machine and the parallelism of the pipeline; Code scanning efficiency measurement module, which is used to measure the code scanning efficiency of the pipeline in the code scanning stage, determine the overall server performance, and adjust the execution concurrency; Build time and success rate measurement module, which is used to measure the build duration and success rate of the pipeline in the build stage, and adjust the concurrency number and waiting duration; Deployment time and success rate measurement module, which is used to measure the time and success rate of the pipeline in the deployment stage, and determine the usage status of the pipeline server.

2. The device according to claim 1, wherein The unit test efficiency measurement module is specifically used for: In the unit test stage, measure the change in the number of unit tests during the execution of a single-project pipeline according to time, and measure the change in the success rate data of unit tests during the execution of a single-project pipeline according to time; According to the change in the number of unit tests during the execution of a single-project pipeline and the change in the success rate data of unit tests during the execution of a single-project pipeline, measure the number of unit tests and the success rate of unit tests during the execution of all project pipelines, screen out the pipelines with long unit test duration and low unit test success rate, and adjust the configuration of the build machine and the parallelism of the pipeline.

3. The device according to claim 1, characterized in that, The code scanning efficiency measurement module is specifically used for: In the code scanning stage, measure the chart indicators of the number of code lines and sonnar static code scanning time of a single pipeline, measure the chart indicators of the number of code lines and sonnar static code scanning time of the overall pipeline, and determine the code scanning efficiency; Calculate the overall server performance according to the number of executed projects and in combination with the code scanning efficiency; According to the overall server performance, adjust the concurrency number and waiting duration when the dependency relationship meets the set conditions.

4. The device according to claim 1, characterized in that, The build time and success rate measurement module is specifically used for: In the build stage, measure the build duration and success rate of a single pipeline at different time periods, and evaluate the changes and problem positioning of the current pipeline; Measure the build duration and success rate of the overall pipeline at different time periods, evaluate the status of the machine carrying the project build, and adjust the concurrency number and waiting duration.

5. The device according to claim 1, characterized in that, The deployment time and success rate measurement module is specifically used for: In the deployment stage, measure the chart indicators of the success rate of the pipeline, determine the usage status of the single and overall pipeline servers, and locate the server disks that need to be cleaned.

6. A running method of a pipeline efficiency measurement and evaluation device, characterized in that, including: The unit test efficiency measurement module measures the number of unit tests and the success rate data of unit tests during the execution of the pipeline in the unit test stage, and adjusts the configuration of the build machine and the parallelism of the pipeline; The code scanning efficiency measurement module measures the code scanning efficiency of the pipeline in the code scanning stage, determines the overall server performance, and adjusts the execution concurrency; The build time and success rate measurement module measures the build duration and success rate of the pipeline in the build stage, and adjusts the concurrency number and waiting duration; The deployment time and success rate measurement module measures the time and success rate of the pipeline in the deployment stage, and determines the usage status of the pipeline server.

7. The operating method of the device according to claim 6, characterized in that, The unit test efficiency measurement module measures the number of unit tests and the unit test success rate data during the execution of the pipeline in the unit test phase, and adjusts the configuration of the build machine and the parallelism of the pipeline, including: In the unit test phase, measure the change in the number of unit tests during the execution of a single project pipeline according to time, and measure the change in the unit test success rate data during the execution of a single project pipeline according to time; According to the change in the number of unit tests during the execution of a single project pipeline and the change in the unit test success rate data during the execution of a single project pipeline, measure the number of unit tests and the unit test success rate during the execution of all project pipelines, screen out the pipelines with long unit test duration and low unit test success rate, and adjust the configuration of the build machine and the parallelism of the pipeline.

8. The operating method of the device according to claim 6, characterized in that, The code scanning efficiency measurement module measures the code scanning efficiency of the pipeline in the code scanning phase, determines the overall server performance, and adjusts the execution concurrency, including: In the code scanning phase, measure the chart metrics of the number of code lines and the sonnar static code scanning time of a single pipeline, and measure the chart metrics of the number of code lines and the sonnar static code scanning time of the overall pipeline to determine the code scanning efficiency; Calculate the overall server performance according to the number of executed projects and in combination with the code scanning efficiency; According to the overall server performance, adjust the concurrency number and waiting duration when the dependency relationship meets the set conditions.

9. The operating method of the device according to claim 6, characterized in that, The build duration and success rate measurement module measures the build duration and success rate of the pipeline in the build phase, and adjusts the concurrency number and waiting duration, including: In the build phase, measure the build duration and success rate of a single pipeline at different time periods to evaluate the changes and problem positioning of the current pipeline; Measure the build duration and success rate of the overall pipeline at different time periods to evaluate the status of the machine carrying the project build, and adjust the concurrency number and waiting duration.

10. The operating method of the device according to claim 6, characterized in that, The deployment duration and success rate measurement module measures the duration and success rate of the pipeline in the deployment phase, and determines the usage status of the pipeline server, including: In the deployment phase, measure the chart metrics of the pipeline success rate to determine the usage status of the single and overall pipeline servers, and locate the server disks that need to be cleaned.

11. A computer device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the operation method of the device according to any one of claims 6 to 10.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, it implements the operation method of the device according to any one of claims 6 to 10.

13. A computer program product, characterized in that, The computer program product includes a computer program, and when the computer program is executed by the processor, it implements the operation method of the device according to any one of claims 6 to 10.

Citation Information

Patent Citations

  • Quality evaluation system of intelligent contract code

    CN113282517A

  • Research and development performance evaluation method based on DevOps

    CN113806194A