Automated test method based on backtracking alignment, electronic device and storage medium

Abstract

The application discloses an automatic test method based on backtracking comparison, an electronic device and a storage medium. The method comprises the following steps: obtaining business data of an event triggered in a test process in an old version of a target application, filtering request information and response information, constructing a link node, obtaining aggregated link data, performing regression testing on the aggregated link data, binding the aggregated link data of the old version to a backtracking interface after the testing, generating backtracking simulation data, judging whether there is a backtracking link identifier in a new version of the target application when the new version is tested, triggering the backtracking interface through the backtracking link identifier if the backtracking link identifier exists, comparing the backtracking simulation data with aggregated link data with the backtracking link identifier in the new version, and judging whether the results of the two are the same. The above scheme uses old version data as backtracking simulation data and compares the old version data with new version data, thereby providing a new way for backtracking comparison testing and improving test quality.

Description

Technical Field

[0001] The present application relates to the field of testing, and in particular to an automated testing method, electronic device, and storage medium based on retrospective comparison. Background Art

[0002] Automated testing is a software testing technique that uses automated testing tools to execute test cases, improving the return on investment (ROI) of test automation. Automated testing is often used to identify issues before they occur. Regression testing is an incremental verification technique used to verify that new product changes do not break existing functionality. Adding new test cases for each new feature ensures successful regression testing. Regression testing is particularly important in agile testing, as new features are constantly being added to prevent them from impacting existing functionality. Therefore, automated regression testing can significantly reduce testing costs. Proper implementation of regression testing can improve the quality of the tested product.

[0003] In the current common method, the assertion information in the script is used to judge the result. However, it is impossible to write an assertion for each return field of the interface, which results in incompleteness and error in the test. Summary of the Invention

[0004] This application at least provides an automated testing method, electronic device and storage medium based on retrospective comparison, which uses old version data as retrospective simulation data and compares it with new version data, providing a new way for retrospective comparison testing and improving test quality.

[0005] The first aspect of the present application provides an automated testing method based on retrospective comparison, comprising:

[0006] Obtaining business data of events triggered during testing in an old version of the target application, the business data including request information, event response information, and event operation time;

[0007] Filtering the request information and the response information, constructing link nodes with the filtered request information and the filtered response information, and sorting the link nodes according to the event operation time to obtain the old version of the aggregated link data;

[0008] Performing a regression test on the old version of the aggregate link data. If the old version of the aggregate link data passes the test, storing the old version of the aggregate link data in a storage device and binding it to a backtracking interface to generate backtracking simulation data.

[0009] When a new version of the target application is tested, it is determined whether there is a backtracking link identifier in the business data of the event triggered in the testing process in the new version, if the backtracking link identifier exists, the backtracking interface is triggered through the backtracking link identifier, the backtracking simulation data is compared with the aggregated link data with the backtracking link identifier in the new version, it is determined whether the results of the two are the same, if the same, the test is passed, otherwise an error report is output.

[0010] Wherein, after the regression testing of the aggregated link data of the old version, it comprises:

[0011] If the aggregated link data of the old version fails the test, an error report is output, and the regression testing is performed again after adjusting the test problem.

[0012] Wherein, the filtering of the request information and the response information, and the construction of link nodes based on the filtered request information and the filtered response information, and the sorting of each link node according to the event operation time to obtain the aggregated link data of the old version, comprises:

[0013] Identify the request information and the response information with the backtracking link identifier in the request information and the response information, and filter out the request information and the response information with the backtracking link identifier;

[0014] Construct link nodes for the request information and the response information with the backtracking link identifier;

[0015] Sort each link node according to the event operation time to obtain the aggregated link data of the old version.

[0016] Wherein, after identifying the request information and the response information with the backtracking link identifier in the request information and the response information, and filtering out the request information and the response information with the link identifier, it comprises:

[0017] Convert the request information and the response information without the backtracking link identifier in the request information and the response information into test cases, and set assertions in the part to be tested in the test cases;

[0018] Execute the test case, if the assertion fails to output correct data, check the test problem of the test case, and adjust the test problem and perform the test again.

[0019] Wherein, the business data of the event triggered in the testing process in the old version of the target application, the business data comprises request information, response information of the event, and event operation time, comprises:

[0020] Initiating a request message to the old version of the target application;

[0021] The request information triggers the control layer of the application program, and returns the business data of the triggering event during the test process.

[0022] When testing a new version of the target application, after determining whether the service data of the new version that triggers an event during the test contains a traceback link identifier, the method includes:

[0023] If the backtracking link identifier does not exist, the service data of the new version that triggers an event during the test process directly initiates a test request for testing.

[0024] If the two are identical, the comparison test is passed. Otherwise, after outputting an error report, the following steps are performed:

[0025] The error report is sent to the terminal for display.

[0026] The method further comprises:

[0027] The aggregated link data with the backtracking link identifier in the new version is subjected to regression testing. If the aggregated link data with the backtracking link identifier in the new version passes the test, the aggregated link data is placed in a storage device and bound to a backtracking interface to generate backtracking simulation data for the next backtracking comparison.

[0028] A second aspect of the present application provides an electronic device, comprising a memory and a processor coupled to each other, wherein the processor is configured to execute program instructions stored in the memory to implement the automated testing method based on backtracking comparison in the first aspect.

[0029] A third aspect of the present application provides a computer-readable storage medium having program instructions stored thereon, which, when executed by a processor, implements the automated testing method based on backtracking comparison in the first aspect.

[0030] The above scheme obtains the business data of the event triggered during the test in the old version of the target application, filters the request information and response information, constructs the link node with the filtered request information and response information, obtains the aggregated link data, and performs regression testing on it. If the aggregated link data of the old version passes the test, the aggregated link data of the old version is bound to the backtracking interface to generate backtracking simulation data. When testing the new version of the target application, it is determined whether there is a backtracking link identifier in the new version. If so, the backtracking interface is triggered by the backtracking link identifier, and the backtracking simulation data is compared with the aggregated link data with the backtracking link identifier in the new version to determine whether the results are the same. The above scheme verifies the difference between the old and new versions of the system through automatic comparison, then binds the aggregated link data in the old version to the backtracking interface, generates backtracking simulation data, and refines the test scenario. The backtracking simulation data is compared with the aggregated link data with the backtracking link identifier in the new version, and problems are discovered before the new version is launched. The old version data is used as backtracking simulation data and compared with the new version data, providing a new way for backtracking comparison testing and improving test quality.

[0031] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and, together with the specification, are used to illustrate the technical solutions of the present application.

[0033] Figure 1 This is a flow chart of the first embodiment of the automated testing method based on retrospective comparison of the present application;

[0034] Figure 2 This is a flow chart of the second embodiment of the automated testing method based on retrospective comparison of the present application;

[0035] Figure 3 This is a schematic diagram of the framework of an embodiment of the electronic device of the present application;

[0036] Figure 4 It is a schematic diagram of a framework of an embodiment of the non-volatile computer-readable storage medium of the present application. DETAILED DESCRIPTION

[0037] The following describes the embodiments of the present application in detail with reference to the accompanying drawings.

[0038] In the following description, for the purpose of explanation rather than limitation, specific details such as specific system structures, interfaces, and technologies are provided to facilitate a thorough understanding of the present application.

[0039] The term "and / or" in this article is simply a description of the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects are in an "or" relationship. In addition, "many" in this article means two or more than two. In addition, the term "at least one" in this article means any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0040] If the technical solution of this application involves personal information, the product using the technical solution of this application has clearly informed the individual of the personal information processing rules and obtained the individual's voluntary consent before processing the personal information. If the technical solution of this application involves sensitive personal information, the product using the technical solution of this application has obtained the individual's separate consent before processing the sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, a clear and prominent sign is set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that they agree to the collection of their personal information; or on the personal information processing device, when the personal information processing rules are notified by obvious signs / information, the individual's authorization is obtained through pop-up information or by asking the individual to upload their personal information; among which, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

[0041] Currently, the industry is conducting regression testing, while also implementing automated testing. Regression test scripts are written and executed automatically. Results are judged based on assertions within the scripts. This approach improves testing efficiency to a certain extent. However, it also presents a problem: Results are judged based on assertions, but in actual script writing, it's impossible to include assertions for every return field in the interface. This results in incomplete testing and potential for errors. A script that appears to run successfully may not actually have succeeded. This situation has also led to accidents in real applications due to omissions in regression testing.

[0042] See also Figure 1 , Figure 1 This is a flow chart of the first embodiment of the automated testing method based on retrospective comparison of the present application. Specifically, it can include the following steps:

[0043] Step S100: Acquire business data of an event triggered during the test in an old version of the target application, wherein the business data includes request information, event response information, and event operation time.

[0044] In this embodiment, the business data of the event that triggered the test in the old version of the target application is obtained. The business data includes request information, response information of the event, and the time before the event operation, including initiating a request information to the old version of the target application; the request information triggers the control layer of the application and returns the business data of the event that triggered the test. That is, when the old version of the target application needs to first initiate a request message, trigger the control controller of the application to make it run, and return the response information and request information generated at the departure time during the test, the response information and request information are assembled into the form of an MQ message and returned, wherein the MQ message is a cross-process communication mechanism used to transmit messages upstream and downstream. After using the MQ message, the message sending upstream only needs to rely on the MQ message, without relying on other services.

[0045] Step S101: Filter the request information and the response information, construct link nodes with the filtered request information and the filtered response information, and sort the link nodes according to the event operation time to obtain the old version of the aggregated link data.

[0046] In this embodiment, step S101 includes:

[0047] The request information and response information with the backtracking link identifier are identified in the request information and the response information, and the request information and response information with the backtracking link identifier are filtered out; a link node is constructed for the request information and response information with the backtracking link identifier; and each link node is sorted according to the event operation time to obtain the old version of the aggregated link data. In other words, the request information and response information are first filtered based on whether there is a backtracking link identifier to obtain the request information and response information with the backtracking link identifier. Then, a link node is constructed for the request information and response information with the backtracking link identifier, and each link node is sorted according to the event operation time to form an identification link, thereby obtaining the old version of the aggregated link data.

[0048] Furthermore, after identifying the request information and response information with a backtracking link identifier in the request information and the response information, and filtering out the request information and response information with a link identifier, the request information and the response information without a backtracking link identifier in the request information and the response information are converted into a test case, and assertions are set in the part of the test case that needs to be tested; the test case is executed, and if the assertion fails to successfully output the correct data, the test problem of the test case is checked, and the test is performed again after adjusting the test problem. In other words, the request information and response information without a link identifier do not need to be backtracked and compared, so the automated test of the real request can be directly performed, and it is converted into a test case, and assertions are set in the part of the test case that needs to be tested, and the test case is executed. If the assertion fails to successfully output the correct data, the test problem of the test case is checked, and the test is performed again after adjusting the test problem.

[0049] Step S102: performing a regression test on the old version of the aggregate link data. If the old version of the aggregate link data passes the test, the old version of the aggregate link data is stored in a storage device and bound to a backtracking interface to generate backtracking simulation data.

[0050] In this embodiment, after the old version of the aggregation link data is subjected to regression testing, if the old version of the aggregation link data fails the test, an error report is output, and the regression test is performed again after the test problem is adjusted. Among them, the time for regression testing of the old version of the aggregation link data is mainly when the version is relatively stable. The regression case automatic test can be set to run the regression test.

[0051] Step S103: When testing the new version of the target application, determine whether there is a backtracking link identifier in the business data of the new version that triggers the event during the test. If the backtracking link identifier exists, trigger the backtracking interface through the backtracking link identifier, compare the backtracking simulation data with the aggregated link data with the backtracking link identifier in the new version, and determine whether the results of the two are the same. If they are the same, the comparison test passes, otherwise an error report is output.

[0052] In this embodiment, if the two are the same, the comparison test is passed. Otherwise, an error report is output, which includes sending the error report to the terminal for display. The error report usually includes problems such as new bugs caused by code changes, problems with the deployment environment, and problems with data.

[0053] In this embodiment, the method further includes subjecting the aggregated link data in the new version with the backtracking link identifier to a regression test. If the aggregated link data in the new version with the backtracking link identifier passes the test, the aggregated link data is stored in a storage device and bound to a backtracking interface to generate backtracking simulation data for the next backtracking comparison. In other words, after each backtracking comparison, the aggregated link data in the new version undergoes a regression test. If it passes the test, it is bound to the backtracking interface and used as the backtracking simulation data for the next backtracking comparison during the next update.

[0054] Those skilled in the art will understand that in the above-mentioned method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0055] Currently, the industry performs regression testing, while also implementing automated testing. Regression test scripts are written and executed automatically. Results are determined based on assertions within the scripts. This approach improves testing efficiency to a certain extent. However, it also presents a problem: Results are determined based on assertions, and in actual script writing, it's impossible to include assertions for every return field within the interface. This results in incomplete testing and potential for errors. A script that appears to run successfully may not necessarily be successful. This situation has also led to accidents in real-world applications due to omissions in regression testing.

[0056] In this embodiment, the differences between the old and new versions of the system are verified through automatic comparison. The aggregate link data in the old version is bound to the backtracking interface to generate backtracking simulation data. This refines the test scenario and compares the backtracking simulation data with the aggregate link data with the backtracking link identifier in the new version. Problems are discovered before the new version goes online. The old version data is used as backtracking simulation data and compared with the new version data, providing a new way for backtracking comparison testing and improving test quality.

[0057] See also Figure 2 , Figure 2 This is a flow chart of the second embodiment of the automated testing method based on retrospective comparison of the present application. Specifically, it may include the following steps:

[0058] Step S200: Acquire business data of an event triggered during the test in an old version of the target application, wherein the business data includes request information, event response information, and event operation time.

[0059] This can be as described in S100 above, and will not be repeated here.

[0060] Step S201: Filter the request information and the response information, construct link nodes with the filtered request information and the filtered response information, and sort the link nodes according to the event operation time to obtain the old version of the aggregated link data.

[0061] This can be as described in S101 above and will not be repeated here.

[0062] Step S202: performing regression testing on the old version of the aggregated link data.

[0063] In this embodiment, the time to perform regression testing on the old version of the aggregated link data is mainly when the version is relatively stable. An automatic regression case test can be set to run the regression test.

[0064] Step S203: If the old version of the aggregate link data passes the test, the old version of the aggregate link data is stored in a storage device and bound to a backtracking interface to generate backtracking simulation data.

[0065] Step S204: If the old version of the aggregated link data fails the test, an error report is output, and the regression test is performed again after adjusting the test problem.

[0066] In this embodiment, if the test fails, an error report will be output, and the test problem can be manually adjusted and executed again until it is successful. The aggregate link data of this version will be placed in a storage device and bound to the backtrace interface to generate backtrace simulation data.

[0067] In this embodiment, the old version of the aggregation link data is subjected to regression testing. Once the data passes the test, it can become the backtracking simulation data for the next new version iteration, thereby providing a new way for simulation testing.

[0068] For example, when the automated testing method of backtesting comparison is applied to the field of financial technology, there are assertions when actually testing the new version, and it is impossible to write assertions for each return field. Therefore, the test will be incomplete, resulting in errors in the new version and the inability to test the problem. However, this method can obtain the business data of the event triggered in the old version of the target application during the test through the user, filter the request information and response information, and build link nodes to obtain aggregated link data, and perform regression testing on it. After the test passes, the aggregated link data of the old version is bound to the backtest interface to generate backtest simulation data. When the new version of the target application is tested, it is judged that the new version Check whether there is a backtracking link identifier in the version. If so, trigger the backtracking interface through the backtracking link identifier, compare the backtracking simulation data with the aggregated link data with the backtracking link identifier in the new version, and determine whether the two results are the same. In this way, the difference between the old and new versions of the system can be verified through automatic comparison. Then, bind the aggregated link data in the old version with the backtracking interface to generate backtracking simulation data. In this way, the test scenario can be refined, and the backtracking simulation data can be compared with the aggregated link data with the backtracking link identifier in the new version. Problems can be discovered before the new version is launched, and the old version data can be used as backtracking simulation data and compared with the new version data. This provides a new way for backtracking comparison testing and improves test quality.

[0069] See also Figure 3 , Figure 3 1 is a schematic diagram of a framework of an embodiment of an electronic device 30 of the present application. The electronic device 30 includes a memory 31 and a processor 32 coupled to each other. The processor 32 is configured to execute program instructions stored in the memory 31 to implement the steps of any of the aforementioned embodiments of the automated testing method based on backtracking comparison. In a specific implementation scenario, the electronic device 30 may include, but is not limited to, a microcomputer and a server. Furthermore, the electronic device 30 may also include mobile devices such as laptops and tablet computers, which are not limited herein.

[0070] Specifically, the processor 32 is configured to control itself and the memory 31 to implement the steps in any of the above-mentioned embodiments of the method for automatic test based on backtracking comparison. The processor 32 can also be referred to as a CPU (Central Processing Unit). The processor 32 can be an integrated circuit chip having a processing capability of signals. The processor 32 can also be a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor or the like. In addition, the processor 32 can be implemented by an integrated circuit chip together.

[0071] Referring to Figure 4 , Figure 4 is a schematic diagram of a framework of an embodiment of the non-volatile computer readable storage medium 40. The non-volatile computer readable storage medium 40 stores program instructions 401 capable of being executed by the processor, and the program instructions 401 are used to implement the steps in any of the above-mentioned embodiments of the method for automatic test based on backtracking comparison.

[0072] In some embodiments, the device provided by the embodiments of the present disclosure has functions or includes modules that can be used to execute the methods described in the above method embodiments, and the specific implementation can refer to the description of the above method embodiments. For brevity, details are not repeated here.

[0073] The above description of each embodiment tends to emphasize the differences between each embodiment, and the same or similar parts can be mutually referred to. For brevity, details are not repeated here.

[0074] In several embodiments provided in the present application, it should be understood that the disclosed method and device can be implemented by other means. For example, the above-described device implementation is only schematic; for example, the division of modules or units is only a logical function division, and actual implementation can have another division manner, for example, a unit or component can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed mutual ones can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0075] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0076] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

Claims

1. An automated testing method based on retrospective comparison, characterized in that: include: Obtaining business data of events triggered during testing in an old version of the target application, the business data including request information, event response information, and event operation time; Filtering the request information and the response information, constructing link nodes with the filtered request information and the filtered response information, and sorting the link nodes according to the event operation time to obtain the old version of the aggregated link data; Performing a regression test on the old version of the aggregate link data. If the old version of the aggregate link data passes the test, storing the old version of the aggregate link data in a storage device and binding it to a backtracking interface to generate backtracking simulation data. When testing a new version of the target application, determine whether there is a backtracking link identifier in the business data of the new version that triggers the event during the test. If the backtracking link identifier exists, trigger the backtracking interface through the backtracking link identifier, compare the backtracking simulation data with the aggregated link data with the backtracking link identifier in the new version, and determine whether the results are the same. If they are the same, the comparison test passes; otherwise, an error report is output; The filtering of the request information and the response information, constructing link nodes for the filtered request information and the filtered response information, and sorting the link nodes according to the event operation time to obtain the old version of the aggregated link data includes: Identifying request information and response information with a backtracking link identifier from the request information and the response information, and filtering out the request information and response information with the backtracking link identifier; Constructing a link node for the request information and response information with the backtracking link identifier; Sort each link node according to the event operation time to obtain the old version of the aggregated link data; After identifying the request information and the response information with the backtracking link identifier from the request information and the response information, and filtering out the request information and the response information with the link identifier, the method further includes: Converting the request information and the response information that do not carry the backtracking link identifier into a test case, and setting assertions in the test case for the part that needs to be tested; The test case is executed. If the assertion fails to successfully output correct data, the test problem of the test case is checked, and the test is executed again after adjusting the test problem.

2. The method according to claim 1, characterized in that After the regression test is performed on the old version of the aggregated link data, the method includes: If the old version of the aggregated link data fails the test, an error report is output, and the regression test is performed again after adjusting the test problem.

3. The method according to claim 1, characterized in that The business data of the event triggered during the test in the old version of the target application is obtained, wherein the business data includes request information, event response information, and event operation time, including: Initiating a request message to the old version of the target application; The request information triggers the control layer of the application program, and returns the business data of the triggering event during the test process.

4. The method according to claim 1, wherein When testing a new version of the target application, after determining whether the service data of the new version that triggers an event during the test contains a traceback link identifier, the following steps are included: If the backtracking link identifier does not exist, the service data of the new version that triggers an event during the test process directly initiates a test request for testing.

5. The method according to claim 1, wherein If they are the same, the comparison test passes. Otherwise, an error report is output, including: The error report is sent to the terminal for display.

6. The method according to claim 1, characterized in that The method further comprises: The aggregated link data with the backtracking link identifier in the new version is subjected to regression testing. If the aggregated link data with the backtracking link identifier in the new version passes the test, the aggregated link data is placed in a storage device and bound to a backtracking interface to generate backtracking simulation data for the next backtracking comparison.

7. An electronic device, characterized in that: It comprises a memory and a processor coupled to each other, wherein the processor is used to execute program instructions stored in the memory to implement the automated testing method based on retrospective comparison as described in any one of claims 1 to 6.

8. A non-volatile computer-readable storage medium having program instructions stored thereon, characterized in that: When the program instructions are executed by a processor, the automated testing method based on backtracking comparison described in any one of claims 1 to 6 is implemented.

Images