Regression testing method, device and equipment based on trusted management platform service and storage medium

Abstract

The invention discloses a regression test method, device and equipment based on trusted management platform service and a storage medium, and belongs to the technical field of DCS controllers. When a test engineer executes a test case, a management platform code line or a method name corresponding to the test case is collected by using a JacoAgent, the code line or the method name corresponding to the test case is input into a test case management system, and when a research and development engineer modifies a corresponding code or method, the test case management system is started, and the test case management system is started. A corresponding tool is used for extracting the changed code line or method name, and the test case management system automatically pushes a test case needing to be subjected to regression testing to a test engineer according to the code line or method name. And after the pushed test case is executed, outputting a regression test report. Through the method, the accuracy of the regression test range and the test quality can be effectively improved, the regression test reliability problem caused by the personal experience of a test engineer can be avoided, the regression test result can be measured, and meanwhile, the regression test cost can be remarkably reduced.

Description

Technical Field

[0001] The present invention belongs to the field of trusted control technology, and in particular relates to a regression testing method, device, equipment and storage medium based on a trusted management platform service. Background Art

[0002] In the field of industrial automation, the security and reliability of distributed control systems (DCS) as the core control platform are of vital importance. With the continuous advancement of technology, the concept of trusted DCS controllers has emerged, aiming to enhance the system's protection capabilities by integrating a series of advanced security features. These features include but are not limited to trusted startup, static and dynamic trusted verification, trusted whitelist management, process protection, and application access control, which together build a multi-level, all-round security protection system.

[0003] At the same time, in order to efficiently manage and configure these security features, a trusted management platform came into being. This platform not only provides centralized configuration and policy management of the above security functions in multiple DCS controller systems, but also allows users to obtain and display the trusted status of DCS controllers in real time and conduct trusted function audits to ensure that the security status of the system is always under monitoring. This centralized management method greatly simplifies the configuration process of security policies and improves management efficiency.

[0004] However, as the functions of the trusted management platform become increasingly rich and complex, its testing and maintenance work also faces new challenges. Especially in the R&D stage, every time an engineer fixes a bug in the system or adds a new function, a comprehensive regression test is required to ensure that the stability and security of the system are not affected. However, in this process, test engineers face the problem of accurately defining the scope of regression testing. Since the size of the test scope is highly dependent on the personal experience and on-the-spot judgment of the test engineer, there are often two extreme situations: one is that the estimated scope is too small, resulting in the failure to fully test key functions or newly introduced bugs, increasing the risk after the system goes online; the other is that the estimated scope is too large, and unnecessary testing work consumes a lot of testing resources, prolongs the project cycle, and increases project costs.

[0005] Therefore, how to accurately define the scope of regression testing and improve testing efficiency and effectiveness has become a technical problem that needs to be urgently solved in the development and maintenance of trusted DCS controllers and their management platforms. Summary of the invention

[0006] The purpose of the present invention is to overcome the shortcomings of the above-mentioned prior art and provide a regression testing method, device, equipment and storage medium based on a trusted management platform service to solve the problem in the prior art that the test scope is difficult to confirm, which is prone to under-testing, missed testing or waste of test resources.

[0007] To achieve the above object, the present invention is implemented by the following technical solutions: A regression testing method based on a trusted management platform service, comprising the following steps: S1, Start jacocoagent and the trusted management platform to be regression tested together, and the jacocoagent instruments in the trusted management platform to be regression tested; S2, Parse the code change document generated by git diff to obtain the changed information, and the changed information includes method names, code lines, and attributes; S3, Through the Java reflection API in the trusted management platform to be regression tested, obtain the information in the jar package of the trusted management platform to be regression tested, and the information includes method names, code lines, and attributes; S4, Compare the information in S3 and S2. If the changed information is included in the jar package, based on the changed code lines and the changed method names, obtain the regression test case set corresponding to all the changed method names from the test case management system; If the changed information is not included in the jar package, complete the test cases and the corresponding method names in the test case management system; S5, Execute the regression test case set for regression testing.

[0008] A further improvement of the present invention lies in: Preferably, in S2, the specific process of obtaining the changed information is: Parse the code change document generated by git diff, extract the file name, method name, attribute, and corresponding code lines of the changed information, form a mapping relationship, and write the mapping into a temporary file.

[0009] Preferably, in S4, when completing the test cases and their corresponding method names in the test case management system, the test case management system enters the stained code lines and method names extracted from the test cases.

[0010] Preferably, the jacocoagent instruments in the trusted management platform to be regression tested and stains the test cases in the trusted management platform to be regression tested.

[0011] Preferably, the test case management system enters the stained code lines and method names extracted from the test cases in the trusted management platform for regression testing.

[0012] Preferably, in S5, the process for the test case management system to obtain the stained code lines and method names is: (1) The trusted management platform to be regression tested receives, processes, and executes the test cases; (2) Stain the code blocks that have been running in the transformed trusted management platform through jacocoagent; (3) Generate and collect the stained code lines and method names of this test case through jacococli.jar; (4) Enter the stained code lines and method names extracted from the test cases into the test case management system.

[0013] Preferably, in S5, the transformed trusted management platform sends the measured results of the executed test cases to the terminal.

[0014] A regression testing device based on the trusted management platform service, including: A startup module, used to start jacocoagent and the trusted management platform to be regression tested together, and the jacocoagent instruments in the trusted management platform to be regression tested; A parsing module, used to parse the code change document generated by git diff to obtain the changed information, and the changed information includes method names, code lines, and attributes; An acquisition module, used to obtain the information in the jar package of the trusted management platform to be regression tested through the Java reflection API in the trusted management platform to be regression tested, and the information includes method names, code lines, and attributes; A comparison module, used to compare the information in the parsing module and the acquisition module. If the changed information is included in the jar package, based on the changed code lines and changed method names, obtain the regression test case set corresponding to all the changed method names from the test case management system; if the changed information is not included in the jar package, complete the test cases and corresponding method names in the test case management system; A testing module, used to execute the regression test case set for regression testing.

[0015] A computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the above-mentioned regression testing method based on the trusted management platform service.

[0016] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements the above-mentioned regression testing method based on the trusted management platform service.

[0017] Compared with the prior art, the present invention has the following beneficial effects: The present invention discloses a regression test method based on a trusted management platform service, in which a jacocoagent is inserted in the trusted management platform of the regression test, so that during the regression test process, the jacocoagent can record the execution of the regression test. When an engineer fixes a bug in the system or adds a new function, the change line and the change method name of the change code are obtained from the new function, and based on the change line and the change method name, the target regression test case set of the regression test is directly obtained from the test case management system; wherein the test case management system stores a plurality of regression test case colored code lines and method names, the stored code lines and method names are obtained after the trusted management platform test after the previous training, and the trusted management platform test is inserted by the jacocoagent; through this method, the accuracy of the regression test range and the test quality can be effectively improved, the regression test reliability problem caused by the personal experience of the test engineer can be avoided, the result of the regression test can be measured, and the regression test cost can also be significantly reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A flow chart of a regression testing method based on a trusted management platform service of the present invention; Figure 2 It is a module relationship diagram of the present invention. DETAILED DESCRIPTION

[0019] In the following, the terms "first", "second", "third", and "fourth" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, a feature defined as "first", "second", "third", and "fourth" may explicitly or implicitly include one or more of the features.

[0020] The co-shooting method provided in the embodiment of the present application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc. The embodiment of the present application does not impose any restrictions on the specific type of the terminal device.

[0021] It should be noted that the terms "first", "second", etc. in the specification and drawings of the present invention are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0022] The trusted DCS controller integrates trusted startup, static trusted verification, dynamic trusted verification, trusted whitelist, process protection, application access control and other functions. The trusted management platform provides the setting and deletion policies for trusted startup, static trusted verification, dynamic trusted verification, trusted whitelist, process protection, application access control and other functions in multiple DCS controller systems; obtains and displays the trusted status of DCS controllers, trusted function audit and other management functions. Users can configure relevant trusted policies for DCS controllers simply and conveniently through the trusted management platform. Since the trusted management platform integrates the above functions, whenever the R&D engineer fixes individual bugs, the test engineer needs to do regression testing. At this time, the regression test scope of the test engineer is particularly dependent on his personal experience and on-the-spot performance. If the estimated scope is smaller than the required test scope, it will lead to the risk of under-testing and missed tests. If the estimated scope is larger than the required test scope, it will cause a waste of test resources, prolong the project time, and generate over-plan costs.

[0023] In order to solve the problems of the above technology, the present invention proposes a method for monitoring the behavior of the service of the trusted management platform based on jacocoagent, and using the test case management system to bind the code relationship between the test case and the management platform. Whenever there is a code change on the trusted management platform, the test case system will automatically push the regression test method of the test case that needs to be regressed. This method is that when the test engineer executes the test case, he uses jacocoagent to collect the management platform code line or method name corresponding to the test case, and enters the code line or method name corresponding to the test case into the test case management system. Whenever the R&D engineer modifies the corresponding code or method, he uses the corresponding tool to extract the changed code line or method name, and the test case management system automatically pushes the test case that needs regression testing to the test engineer according to the code line or method name. After executing the pushed test case, the regression test report is output.

[0024] See also Figure 1 The first aspect of the present invention discloses a regression testing method based on a trusted management platform service, comprising the following steps: S1. Start the jacocoagent together with the trust management platform to be regression - tested. The jacocoagent instruments the trust management platform to be regression - tested, resulting in a transformed trust management platform. The jacocoagent used in this step is a tool for code coverage analysis. Instrumentation records the execution status of the code during program runtime, helping testers and developers understand the code coverage, thereby identifying code sections not covered by tests and improving code quality. The jacocoagent of the present invention records code coverage information into a database through instrumentation for testers and developers to view and analyze.

[0025] Specifically, record the execution path and execution time of the code, and store the information in the test case management system database after recording.

[0026] Multiple test cases are pre - entered in the test case management system. The trust management platform conducts tests through the test cases. During the test process, the jacocoagent can color the method names, code lines, and attributes after the test.

[0027] S2. When an engineer fixes a bug or adds a new feature in the system, use git diff to generate the changed lines and changed method names for the bug or new feature, parse the code change document generated by git diff, and obtain the changed information. The changed information includes method names, code lines, and attributes. In some embodiments of the present invention, the changed information includes the fixed bug or added new feature.

[0028] In some embodiments of the present invention, the process of obtaining the changed lines and changed method names from the code change document includes the following steps: Parse the code change document generated by git diff, extract the changed file names, method names, attributes, and corresponding code lines, form a mapping relationship, and write this mapping into a temporary file. The specific mapping relationship is the specific lines of the file name and its corresponding method, attribute name, etc. For example: using the file name as the key, and for the value, the above - mentioned information can be encapsulated into an object, and this encapsulated object is used as the value's mapping relationship.

[0029] S3. In the trust management platform to be regression - tested, obtain the information in the trust management platform jar package through the Java reflection API. The information includes method names, code lines, and attributes. In this process, through the Java reflection API, it is allowed to dynamically check and operate on the attributes and methods of a class at runtime.

[0030] S4. Compare the change information extracted in S2 with the information in the jar package in S3. If the information extracted in S2 is included in the information in the jar package, the code extracted in S3 has changed, and the existing test cases can be directly called for testing; if the information extracted in S2 is not in the information in the jar package, the information in the code change document generated by git diff is new information, indicating that this method name, code, and attribute are new content, and new tests need to be conducted for the new content. For the information extracted in S2 that is not included in S3, if the corresponding regression test case set cannot be obtained from the test case management system based on the changed lines and method names, it indicates that this method is a new method and there were no test cases covering this method before. Therefore, when testing, the test engineer needs to write test cases for the new content and enter relevant information for the new test cases during testing. Specifically, complete the test cases and their corresponding method names in the test case management system. For the information extracted in S2 that is included in S3, automatically access the database of the test case management system, and use the method name determined in S3 to obtain the test cases containing this method name.

[0031] S5. Based on the changed lines and method names, obtain the target regression test case set for regression testing from the test case management system; multiple regression test case - stained code lines and method names are stored in the test case management system, and the stained code lines and method names are obtained through the transformed trusted management platform, and the transformed trusted management platform is instrumented by jacocoagent. Among them, multiple regression test case - stained code lines and method names are stored in the test case management system, and the stored code lines and method names are obtained after being tested by the trusted management platform after preliminary training. The trusted management platform is instrumented by jacocoagent during testing.

[0032] S6. The trusted management platform to be regression - tested executes the regression test case set for regression testing.

[0033] In some embodiments of the present invention, in S6, the ways to obtain the test case management system and the transformed trusted management platform include the following steps: (1) The test engineer executes test cases on the transformed trusted management platform. The process of the transformed trusted management platform executing test cases includes the following steps: a) Receive and process the tested requests in the executed test cases and send the processed results to the corresponding terminals; b) jacocoagent stains the code blocks that have been run on the trusted management platform; c) Receive and process the trusted function messages sent by the terminals; (2) The terminal receives a request from the transformed trusted management platform; (3) The terminal processes the request from the management platform and returns the processing result to the transformed trusted management platform.

[0034] (4) The test engineer uses jacococli.jar to generate and collect the colored code lines and method names of this test case; (5) The test engineer enters the code lines and method names corresponding to the test case into the test case management system.

[0035] Specifically, there are roughly the following categories for the terminal to receive the trusted management platform: (1) The user sets on / off, etc. for the trusted module function of the terminal from the management platform; (2) The user configures and deletes the policies of the trusted module function of the terminal from the management platform; When the terminal processes the request from the management platform, for example, when receiving a request from the management platform to turn off the static trusted function on the terminal, the terminal will call the relevant APIs of the static trusted module to turn off the static trusted verification module, etc.

[0036] In an embodiment of the present invention, a specific regression testing method based on the trusted management platform service is provided, including the following steps: 1) Start together with the trusted management platform service using jacocoagent, so that jacocoagent can instrument the trusted management platform, which is subsequently referred to as the transformed trusted management platform; 2) The test engineer executes the test case on the transformed trusted management platform; 3) The transformed trusted management platform provides the following functions Receive, process the tested request in the executed test case and send the processed result to the corresponding terminal; jacocoagent colors the code blocks that have run on the management platform; receive and process the trusted function messages sent by the terminal; 4) The terminal receives and processes the request from the transformed trusted management platform; 5) The terminal processes the request from the management platform and returns the processing result to the transformed trusted management platform.

[0037] 6) The test engineer uses jacococli.jar to generate and collect the colored code lines and method names of this test case; 7) The test engineer enters the code lines and method names corresponding to the test case into the test case management system; 8) When the R & D engineer submits a new trusted management platform installation package due to adding new functions or modifying defects, the test engineer needs to deploy jacocoagent and the trusted management platform that needs to be regression-tested together, which is hereinafter referred to as the trusted management platform for regression testing; 9) According to the code change document provided by R & D (usually using git diff), use a code change tool to extract the changed lines and method names. The code change tool has the following functions: a) Parse the code change document generated by git diff, extract the changed file names, methods, attributes, and the corresponding code lines, form a mapping relationship, and write this mapping into a file; b) Use the Java reflection API to obtain information such as class names, method names, and attributes in the jar package of the trusted management platform for regression testing, and write this information into a file; c) Compare the file in a) with the result in b), extract the newly added classes, method names, and attributes, and determine whether the result in a) exists in the result file b). If it exists, the method name and code lines of the changed code can be determined; d) Automatically access the database of the test case management system, and use the method name determined in b) to obtain the test cases containing this method name.

[0038] 10) The code change tool finds the target regression test case set that needs to be regression-tested this time from the test case management system based on the extracted code lines and method names, automatically generates this test case set in the test case management system, and pushes the test case set for this regression test to the test engineer; 11) The test engineer executes the pushed test case set; 12) After all the pushed regression test case sets are executed, a regression test report is generated.

[0039] See Figure 2 , the second aspect of the present invention discloses a regression test device based on a trusted management platform service, including: A startup module for starting jacocoagent and the trusted management platform to be regression-tested together, and the jacocoagent instruments in the trusted management platform to be regression-tested; A parsing module for parsing the code change document generated by git diff to obtain the changed information, where the changed information includes method names, code lines, and attributes; An obtaining module for obtaining information in the jar package of the trusted management platform to be regression-tested through the Java reflection API in the trusted management platform to be regression-tested, where the information includes method names, code lines, and attributes; A comparison module, configured to compare the information in the parsing module and the obtaining module. If the changed information is included in the jar package, based on the changed code lines and the changed method names, obtain the regression test case set corresponding to all the changed method names from the test case management system; if the changed information is not included in the jar package, complete the test cases and the corresponding method names in the test case management system. A test module, configured to execute the regression test case set for regression testing.

[0040] A third aspect of the present invention discloses a computer device. The computer terminal device includes a processor and a memory. The memory is used to store a computer program. The computer program includes program instructions. The processor is used to execute the program instructions stored in the computer storage medium. The processor may be a Central Processing Unit (CPU), or may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. It is the computing core and control core of the terminal, and is suitable for implementing one or more instructions. Specifically, it is suitable for loading and executing one or more instructions to implement the corresponding method flow or corresponding function; the processor described in this embodiment can be used to implement a regression test method based on a trusted management platform service, including the following steps: S1, start the jacocoagent and the trusted management platform to be regression tested together, and the jacocoagent instruments in the trusted management platform to be regression tested; S2, parse the code change document generated by git diff to obtain the changed information, and the changed information includes method names, code lines, and attributes; S3, obtain the information in the jar package of the trusted management platform to be regression tested through the Java reflection API in the trusted management platform to be regression tested, and the information includes method names, code lines, and attributes; S4, compare the information in S3 and S2. If the changed information is included in the jar package, based on the changed code lines and the changed method names, obtain the regression test case set corresponding to all the changed method names from the test case management system; if the changed information is not included in the jar package, complete the test cases and the corresponding method names in the test case management system; S5, execute the regression test case set for regression testing.

[0041] The fourth aspect of the present invention discloses a storage medium, specifically a computer-readable storage medium (Memory). The computer-readable storage medium is a memory device in a terminal device and is used to store programs and data. It can be understood that the computer-readable storage medium here can include both the built-in storage medium in the terminal device and, of course, the extended storage medium supported by the terminal device. The computer-readable storage medium provides a storage space, and the operating system of the terminal is stored in this storage space. Moreover, one or more instructions suitable for being loaded and executed by the processor are also stored in this storage space. These instructions can be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here can be a high-speed RAM memory or a non-volatile memory, such as at least one disk memory. One or more instructions stored in the computer-readable storage medium can be loaded and executed by the processor to implement a regression testing method based on a trusted management platform service in the above-mentioned embodiment, including the following steps: S1, start jacocoagent and the trusted management platform to be regression-tested together, and the jacocoagent instruments in the trusted management platform to be regression-tested; S2, parse the code change document generated by git diff to obtain the changed information, and the changed information includes method names, code lines, and attributes; S3, obtain the information in the jar package of the trusted management platform to be regression-tested through the Java reflection API in the trusted management platform to be regression-tested, and the information includes method names, code lines, and attributes; S4, compare the information in S3 with that in S2. If the changed information is included in the jar package, based on the changed code lines and the changed method names, obtain the regression test case set corresponding to all the changed method names from the test case management system; if the changed information is not included in the jar package, complete the test cases and the corresponding method names in the test case management system; S5, execute the regression test case set to perform regression testing.

[0042] The above are only the preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A regression testing method based on a trusted management platform service, characterized in that: The following steps are involved: S1, start jacocoagent and the trusted management platform to be regression tested together, and the jacocoagent is inserted in the trusted management platform to be regression tested; S2, parsing the code change document generated by git diff to obtain the change information, wherein the change information includes method name, code line and attribute; S3, obtaining information in the jar package of the trusted management platform to be regression tested through a Java reflection API in the trusted management platform to be regression tested, wherein the information includes method names, code lines, and attributes; S4, compare the information in S3 with that in S2. If the changed information is included in the jar package, obtain the regression test case set corresponding to all the changed method names from the test case management system based on the changed code lines and the changed method names; if the changed information is not included in the jar package, complete the test cases and the corresponding method names in the test case management system; S5, execute the regression test case set to perform regression testing.

2. The regression testing method based on the trusted management platform service according to claim 1, characterized in that: In S2, the specific process of obtaining the changed information is: parsing the code change document generated by git diff, extracting the file name, method name, attribute and corresponding code line of the changed information, forming a mapping relationship, and writing the mapping into a temporary file.

3. The regression testing method based on the trusted management platform service according to claim 1, characterized in that: In S4, when completing the test case and its corresponding method name in the test case management system, the test case management system enters the colored code line and method name extracted from the test case.

4. The regression testing method based on the trusted management platform service according to claim 1, characterized in that: The jacocoagent is inserted into the trusted management platform to be regression tested, and the test cases in the trusted management platform to be regression tested are dyed.

5. The regression testing method based on the trusted management platform service according to claim 4, characterized in that: The test case management system records the colored code lines and method names extracted from the test cases in the trusted management platform of the regression test.

6. The regression testing method based on the trusted management platform service according to claim 4, characterized in that: In S5, the process of the test case management system obtaining the colored code lines and method names is as follows: (1) The trusted management platform to be regression tested receives, processes and executes the test cases; (2) Use jacocoagent to color the code blocks that are already running in the transformed trusted management platform; (3) Generate and collect the colored code lines and method names of this test case through jacococli.jar; (4) Enter the colored code lines and method names extracted from the test cases into the test case management system.

7. The regression testing method based on the trusted management platform service according to claim 5, characterized in that: In S5, the modified trusted management platform sends the test results of executing the test case to the terminal.

8. A regression testing device based on a trusted management platform service, characterized in that: include: A startup module, used to start jacocoagent and a trusted management platform to be regression tested together, wherein the jacocoagent is inserted into the trusted management platform to be regression tested; A parsing module is used to parse the code change document generated by git diff to obtain the change information, including method name, code line and attribute; An acquisition module is used to obtain information in a jar package of a trusted management platform to be regression tested through a Java reflection API in the trusted management platform to be regression tested, wherein the information includes method names, code lines, and attributes; The comparison module is used to compare the information in the parsing module and the acquisition module. If the changed information is included in the jar package, based on the changed code lines and the changed method names, the regression test case set corresponding to all the changed method names is obtained from the test case management system; if the changed information is not included in the jar package, the test cases and the corresponding method names are completed in the test case management system; The test module is used to execute regression test case sets for regression testing.

9. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the regression testing method based on the trusted management platform service as described in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the regression testing method based on a trusted management platform service as claimed in any one of claims 1 to 7 is implemented.

Images