Batch comparison test method and device based on breadth-first algorithm

Abstract

The invention relates to a batch comparison test method and device based on a breadth-first algorithm. The method comprises the following steps: acquiring a to-be-compared test scene for a to-be-tested system; respectively obtaining test tasks corresponding to the test scenes to be compared, wherein each test task represents a task for executing a test case corresponding to the test scene to be compared; according to the to-be-compared test scene and the test task, a test task scheduling graph is obtained, and the test task scheduling graph represents a preliminary execution process of the test task; based on a breadth-first algorithm, traversing the test task scheduling graph, calculating the priority of each test task, and generating a test task scheduling scheme according to the priority of each test task; and according to the test task scheduling scheme, performing batch comparison test on the to-be-tested system to generate a comparison test result. According to the method, automatic scheduling of the test tasks is realized through the breadth-first algorithm, and the batch comparison test efficiency is greatly improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data testing, and in particular to a batch comparison testing method and device based on a breadth-first algorithm. Background Art

[0002] As the telecommunications industry has experienced rapid development in communication technology, 5G technology is also sprinting rapidly on a commercial scale. In the 5G era, the business of telecommunications billing systems is more complex, and customers have higher requirements for billing accuracy. Therefore, in the process of system upgrades and renovations, in order to ensure customer satisfaction, it is necessary to continuously improve test quality and test efficiency.

[0003] For any required configuration and program modifications during the system upgrade and transformation process, before the system goes online, it must not only undergo a complete functional regression test, but also a comprehensive business scenario test. In order to achieve comprehensive coverage of business scenario testing, it is necessary to conduct a large-scale comparison test of business scenario data on the system before and after the upgrade to ensure zero failures and zero problems after the new system goes online. However, due to the large amount of data and long processing flow of batch comparison tests, there is a bottleneck in the scheduling of test tasks in the current batch comparison test, resulting in low test efficiency. Therefore, there is an urgent need for an efficient and accurate batch comparison test method to solve the pain points encountered. Summary of the invention

[0004] The technical problem to be solved by the present invention is to provide a batch comparison test method and device based on breadth-first algorithm to solve the above technical problem.

[0005] The technical solution of the present invention to solve the above-mentioned technical problems is as follows: a batch comparison test method based on a breadth-first algorithm, comprising: obtaining a test scenario to be compared for a system to be tested; respectively obtaining test tasks corresponding to each of the test scenarios to be compared, each of the test tasks representing a task of executing a test case corresponding to the test scenario to be compared; obtaining a test task scheduling diagram based on the test scenario to be compared and the test task, the test task scheduling diagram representing a preliminary execution process of the test task; based on the breadth-first algorithm, traversing the test task scheduling diagram, calculating the priority of each of the test tasks, and generating a test task scheduling plan based on the priority of each of the test tasks; based on the test task scheduling plan, performing batch comparison tests on the system to be tested to generate comparison test results.

[0006] The beneficial effects of the present invention are as follows: the present invention sorts out the test tasks that need to be compared and tested for the system to be tested, and obtains a test task scheduling diagram. The test task scheduling diagram is then traversed by a breadth-first algorithm, the execution priority of each test task is calculated, and a better test task scheduling scheme is generated. The present invention realizes automatic scheduling of test tasks through a breadth-first algorithm, so that test tasks can be executed concurrently, greatly improving the efficiency of batch comparison testing.

[0007] Based on the above technical solution, the present invention can also be improved as follows.

[0008] Furthermore, the test task scheduling diagram is obtained according to the test scenario to be compared and the test task, including: judging whether the pre-configured existing test process can be reused according to the test scenario to be compared and the test task, and if it can be reused, obtaining the test task scheduling diagram corresponding to the existing test process as the test task scheduling diagram; otherwise, the test task is arranged to generate the test task scheduling diagram.

[0009] The beneficial effect of adopting the above further scheme is: pre-configuring the existing test process, when the existing test process can be reused, the test task scheduling diagram corresponding to the existing test process can be directly used for subsequent processing, without the need to re-arrange the test tasks, thereby improving the overall test efficiency.

[0010] Furthermore, judging whether the preconfigured existing test process can be reused based on the test scenarios to be compared and the test tasks includes: respectively obtaining a first number of the test scenarios to be compared and a second number of the test tasks; judging whether the first number is less than a preset threshold value of the number of test scenarios, and judging whether the second number is less than a preset threshold value of the number of test tasks; if the first number is less than the threshold value of the number of test scenarios and the second number is less than the threshold value of the number of test tasks, judging that the existing test process can be reused; otherwise, judging that the existing test process cannot be reused.

[0011] Furthermore, the system to be tested includes a new system and an old system, the new system represents the updated system, and the old system represents the system before the update; the batch comparison test is performed on the system to be tested according to the test task scheduling scheme to generate comparison test results, including: according to the test task scheduling scheme, the new system and the old system are used to execute each of the test tasks respectively, and new system test results and old system test results corresponding to each of the test tasks are generated respectively; for each of the test tasks, the new system test results and the old system test results corresponding to the test task are compared and analyzed to generate comparison test results.

[0012] Further, for each of the test tasks, the new system test results corresponding to the test task and the old system test results are compared and analyzed to generate a comparison test result, including: for each of the test tasks, the new system test results corresponding to the test task and the old system test results are compared and analyzed to generate a comparison analysis result, the comparison analysis result is that the new system test result and the old system test result are the same or the new system test result and the old system test result are different; it is determined whether the comparison analysis result meets expectations, and the comparison test result is generated, the comparison test result is that it meets expectations or does not meet expectations; wherein, when there is an update to the content corresponding to the test task in the new system, the expectation is that the new system test result and the old system test result are different; otherwise, the expectation is that the new system test result and the old system test result are the same.

[0013] Furthermore, the method also includes: generating a batch comparison test report according to each of the comparison test results.

[0014] The beneficial effect of adopting the above further solution is: by generating a batch comparison test report, it is convenient to integrate and display the comparison test results, thereby facilitating the analysis of the comparison test results.

[0015] In order to solve the above technical problems, the present invention also provides a batch comparison test device based on a breadth-first algorithm, comprising:

[0016] A test scenario acquisition module is used to acquire a test scenario to be compared for the system to be tested;

[0017] A test task acquisition module, used to respectively acquire the test tasks corresponding to each of the test scenarios to be compared, each of the test tasks representing the task of executing the test case corresponding to the test scenario to be compared;

[0018] A scheduling diagram acquisition module, used to acquire a test task scheduling diagram according to the test scenario to be compared and the test task, wherein the test task scheduling diagram represents a preliminary execution flow of the test task;

[0019] A scheduling scheme generating module, used to traverse the test task scheduling graph based on a breadth-first algorithm, calculate the priority of each of the test tasks, and generate a test task scheduling scheme according to the priority of each of the test tasks;

[0020] The test module is used to perform batch comparison test on the systems to be tested according to the test task scheduling plan and generate comparison test results.

[0021] Furthermore, the scheduling diagram acquisition module includes: a scheduling diagram acquisition unit, which is used to determine whether the pre-configured existing test process can be reused based on the test scenario to be compared and the test task. If it can be reused, the test task scheduling diagram corresponding to the existing test process is obtained as the test task scheduling diagram; otherwise, the test task is arranged to generate the test task scheduling diagram.

[0022] In order to solve the above technical problems, the present invention also provides an electronic device, including a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, a batch comparison test method based on a breadth-first algorithm as described above is implemented.

[0023] To solve the above technical problems, the present invention also provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute a batch comparison test method based on a breadth-first algorithm as described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 The present invention is a flow chart of a batch comparison test method based on a breadth-first algorithm;

[0025] Figure 2 A schematic diagram of a batch comparison test process of a batch comparison test method based on a breadth-first algorithm of the present invention;

[0026] Figure 3 The present invention is a schematic diagram of a batch comparison test device based on a breadth-first algorithm. DETAILED DESCRIPTION

[0027] The principles and features of the present invention are described below. The examples given are only used to explain the present invention and are not used to limit the scope of the present invention.

[0028] Embodiment 1

[0029] like Figure 1As shown, this embodiment provides a batch comparison test method based on a breadth-first algorithm, including: obtaining a test scenario to be compared for a system to be tested; respectively obtaining test tasks corresponding to each of the test scenarios to be compared, each of the test tasks representing a task of executing a test case corresponding to the test scenario to be compared; obtaining a test task scheduling diagram based on the test scenario to be compared and the test task, the test task scheduling diagram representing a preliminary execution process of the test task; based on a breadth-first algorithm, traversing the test task scheduling diagram, calculating the priority of each of the test tasks, and generating a test task scheduling plan based on the priority of each of the test tasks; performing a batch comparison test on the system to be tested based on the test task scheduling plan, and generating a comparison test result.

[0030] The test scenario represents the scenario corresponding to the function of the system to be tested. The test task scheduling diagram is the initial arrangement of the test task execution process, and the test task scheduling scheme is the optimal test task execution process based on the breadth-first algorithm. The test task scheduling diagram is traversed by the breadth-first algorithm, the priority of each test task is calculated, and the execution process of the test task is determined according to the priority of each test task, that is, the test task scheduling scheme is generated.

[0031] The present invention aims at the system to be tested, sorts out the test tasks that need to be compared and tested, and obtains the test task scheduling diagram. Then, the test task scheduling diagram is traversed through the breadth-first algorithm, the execution priority of each test task is calculated, and a better test task scheduling scheme is generated. The present invention realizes automatic scheduling of test tasks through the breadth-first algorithm, so that the test tasks can be executed concurrently, which greatly improves the efficiency of batch comparison testing. Compared with the existing testing methods, the present invention realizes multi-task and multi-concurrency, the test performance is improved by more than 300%, and the multi-tenant access flexibility of the batch comparison test platform is improved by 100%.

[0032] Optionally, in an embodiment, obtaining a test task scheduling diagram based on the test scenario to be compared and the test task includes: judging whether a preconfigured existing test process can be reused based on the test scenario to be compared and the test task, and if it can be reused, obtaining a test task scheduling diagram corresponding to the existing test process as the test task scheduling diagram; otherwise, arranging the test tasks to generate the test task scheduling diagram.

[0033] The existing test process is obtained by sorting out common test tasks, which are typical and commonly used test tasks, and then arranging the common test tasks to obtain the existing test process. And use batch test data to test the existing test process. Pre-configure the existing test process. When the existing test process can be reused, the test task scheduling diagram corresponding to the existing test process can be directly used for subsequent processing without re-arranging the test tasks, thereby improving the overall test efficiency.

[0034] When the existing test process cannot be reused, the test tasks need to be arranged according to business rules. The arrangement of test tasks can be directly generated by the program. It is also possible to manually arrange the test tasks in series and in parallel according to business rules by dragging and dropping, which improves flexibility.

[0035] Optionally, in an embodiment, judging whether the preconfigured existing test process can be reused based on the test scenarios to be compared and the test tasks includes: respectively obtaining a first number of the test scenarios to be compared and a second number of the test tasks; judging whether the first number is less than a preset threshold value of the number of test scenarios, and judging whether the second number is less than a preset threshold value of the number of test tasks; if the first number is less than the threshold value of the number of test scenarios and the second number is less than the threshold value of the number of test tasks, judging that the existing test process can be reused; otherwise, judging that the existing test process cannot be reused.

[0036] The complexity of the test is reflected by the number of test scenarios to be compared and the number of test tasks. For simple tests, that is, when the number of test scenarios to be compared is less than the test scenario number threshold and the number of test tasks is less than the test task number threshold, the existing test process can be reused.

[0037] Optionally, in an embodiment, the system to be tested includes a new system and an old system, the new system represents the updated system, and the old system represents the system before the update; the batch comparison test is performed on the systems to be tested according to the test task scheduling scheme to generate comparison test results, including: according to the test task scheduling scheme, the new system and the old system are used to respectively execute each of the test tasks, and new system test results and old system test results corresponding to each of the test tasks are respectively generated; for each of the test tasks, the new system test results and the old system test results corresponding to the test task are compared and analyzed to generate comparison test results.

[0038] For the execution process of each test task, such as Figure 2As shown, first start the cleaning program to clean up the historical data, and then stop the comparison program. Generate the data required for the test task through the intermediate program, and input the data into the old program for processing. The old program is the program corresponding to the old system. After the old program is completed, the test results of the old system are generated. Then generate the data required for the test task through the intermediate program, and input the data into the new program for processing. The new program is the program corresponding to the new system. After the new program is completed, the test results of the new system are generated. Through the comparison program, compare and analyze the test results of the new system and the test results of the old system. Start the result script to generate the comparison test results.

[0039] Optionally, in an embodiment, for each of the test tasks, the new system test results corresponding to the test task and the old system test results are compared and analyzed to generate a comparison test result, including: for each of the test tasks, the new system test results corresponding to the test task and the old system test results are compared and analyzed to generate a comparison analysis result, the comparison analysis result is that the new system test result and the old system test result are the same or the new system test result and the old system test result are different; determine whether the comparison analysis result meets expectations, and generate the comparison test result, the comparison test result is met expectations or does not meet expectations; wherein, when there is an update to the content corresponding to the test task in the new system, the expectation is that the new system test result and the old system test result are different; otherwise, the expectation is that the new system test result and the old system test result are the same.

[0040] Optionally, in an embodiment, the method further comprises: generating a batch comparison test report according to each of the comparison test results. By generating a batch comparison test report, it is convenient to integrate and display the comparison test results, thereby facilitating the analysis of the comparison test results.

[0041] Embodiment 2

[0042] like Figure 3 As shown, this embodiment provides a batch comparison test device based on a breadth-first algorithm, comprising:

[0043] A test scenario acquisition module is used to acquire a test scenario to be compared for the system to be tested;

[0044] A test task acquisition module, used to respectively acquire the test tasks corresponding to each of the test scenarios to be compared, each of the test tasks representing the task of executing the test case corresponding to the test scenario to be compared;

[0045] A scheduling diagram acquisition module, used to acquire a test task scheduling diagram according to the test scenario to be compared and the test task, wherein the test task scheduling diagram represents a preliminary execution flow of the test task;

[0046] A scheduling scheme generating module, used to traverse the test task scheduling graph based on a breadth-first algorithm, calculate the priority of each of the test tasks, and generate a test task scheduling scheme according to the priority of each of the test tasks;

[0047] The test module is used to perform batch comparison test on the systems to be tested according to the test task scheduling plan and generate comparison test results.

[0048] Optionally, in an embodiment, the scheduling diagram acquisition module includes: a scheduling diagram acquisition unit, used to determine whether the pre-configured existing test process can be reused based on the test scenario to be compared and the test task; if it can be reused, obtaining the test task scheduling diagram corresponding to the existing test process as the test task scheduling diagram; otherwise, the test task is arranged to generate the test task scheduling diagram.

[0049] Optionally, in an embodiment, judging whether the preconfigured existing test process can be reused based on the test scenarios to be compared and the test tasks includes: respectively obtaining a first number of the test scenarios to be compared and a second number of the test tasks; judging whether the first number is less than a preset threshold value of the number of test scenarios, and judging whether the second number is less than a preset threshold value of the number of test tasks; if the first number is less than the threshold value of the number of test scenarios and the second number is less than the threshold value of the number of test tasks, judging that the existing test process can be reused; otherwise, judging that the existing test process cannot be reused.

[0050] Optionally, in an embodiment, the system to be tested includes a new system and an old system, the new system represents the updated system, and the old system represents the system before the update. The test module includes:

[0051] An execution unit, configured to execute each of the test tasks respectively using the new system and the old system according to the test task scheduling scheme, and to generate a new system test result and an old system test result corresponding to each of the test tasks respectively;

[0052] The comparison unit is used to compare and analyze the new system test result and the old system test result corresponding to each test task, and generate a comparison test result.

[0053] Optionally, in an embodiment, for each of the test tasks, the new system test results corresponding to the test task and the old system test results are compared and analyzed to generate a comparison test result, including: for each of the test tasks, the new system test results corresponding to the test task and the old system test results are compared and analyzed to generate a comparison analysis result, the comparison analysis result is that the new system test result and the old system test result are the same or the new system test result and the old system test result are different; determine whether the comparison analysis result meets expectations, and generate the comparison test result, the comparison test result is met expectations or does not meet expectations; wherein, when there is an update to the content corresponding to the test task in the new system, the expectation is that the new system test result and the old system test result are different; otherwise, the expectation is that the new system test result and the old system test result are the same.

[0054] Optionally, in an embodiment, the device further includes: a report generating module, configured to generate a batch comparison test report according to each of the comparison test results.

[0055] Embodiment 3

[0056] This embodiment provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, a batch comparison test method based on a breadth-first algorithm as described in Embodiment 1 is implemented.

[0057] Embodiment 4

[0058] This embodiment provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute a batch comparison test method based on a breadth-first algorithm as described in Embodiment 1.

[0059] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0060] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0061] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0062] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0063] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0064] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A batch comparison test method based on breadth-first algorithm, characterized in that: include: Obtain the test scenario to be compared for the system to be tested; Respectively obtain the test tasks corresponding to each of the test scenarios to be compared, each of the test tasks representing the task of executing the test case corresponding to the test scenario to be compared; According to the test scenario to be compared and the test task, a test task scheduling diagram is obtained, wherein the test task scheduling diagram represents a preliminary execution flow of the test task; Based on the breadth-first algorithm, traverse the test task scheduling graph, calculate the priority of each test task, and generate a test task scheduling plan according to the priority of each test task; According to the test task scheduling scheme, batch comparison tests are performed on the systems to be tested to generate comparison test results.

2. According to claim 1, a batch comparison test method based on breadth-first algorithm is characterized in that: The step of obtaining a test task scheduling diagram according to the test scenario to be compared and the test task includes: Based on the test scenario to be compared and the test task, determine whether the pre-configured existing test process can be reused. If it can be reused, obtain the test task scheduling diagram corresponding to the existing test process as the test task scheduling diagram; otherwise, arrange the test task to generate the test task scheduling diagram.

3. The batch comparison test method based on breadth-first algorithm according to claim 2 is characterized in that: The determining whether the preconfigured existing test process can be reused according to the test scenario to be compared and the test task includes: Respectively obtaining a first number of the test scenarios to be compared and a second number of the test tasks; Determine whether the first number is less than the preset test scenario number threshold, and determine whether the second number is less than the preset test task number threshold. If the first number is less than the test scenario number threshold and the second number is less than the test task number threshold, it is determined that the existing test process can be reused; otherwise, it is determined that the existing test process cannot be reused.

4. The batch comparison test method based on breadth-first algorithm according to claim 1 is characterized in that: The system to be tested includes a new system and an old system, the new system represents an updated system, and the old system represents a system before the update; performing batch comparison tests on the system to be tested according to the test task scheduling scheme to generate comparison test results includes: According to the test task scheduling scheme, the new system and the old system are used to respectively execute each of the test tasks, and new system test results and old system test results corresponding to each of the test tasks are respectively generated; For each of the test tasks, a comparison analysis is performed on the new system test result and the old system test result corresponding to the test task to generate a comparison test result.

5. The batch comparison test method based on breadth-first algorithm according to claim 4 is characterized in that: For each of the test tasks, comparing and analyzing the new system test results and the old system test results corresponding to the test task to generate a comparison test result includes: For each of the test tasks, a comparison analysis is performed on the new system test result and the old system test result corresponding to the test task to generate a comparison analysis result, wherein the comparison analysis result is that the new system test result is the same as the old system test result or the new system test result is different from the old system test result; Determine whether the comparison analysis result meets expectations, and generate the comparison test result, wherein the comparison test result meets expectations or does not meet expectations; Among them, when there is an update in the content corresponding to the test task in the new system, the expectation is that the test result of the new system is different from the test result of the old system; otherwise, the expectation is that the test result of the new system is the same as the test result of the old system.

6. The batch comparison test method based on breadth-first algorithm according to claim 1 is characterized in that: Also includes: A batch comparison test report is generated according to each of the comparison test results.

7. A batch comparison test device based on breadth-first algorithm, characterized in that: include: A test scenario acquisition module is used to acquire a test scenario to be compared for the system to be tested; A test task acquisition module, used to respectively acquire the test tasks corresponding to each of the test scenarios to be compared, each of the test tasks representing the task of executing the test case corresponding to the test scenario to be compared; A scheduling diagram acquisition module, used to acquire a test task scheduling diagram according to the test scenario to be compared and the test task, wherein the test task scheduling diagram represents a preliminary execution flow of the test task; A scheduling scheme generating module, used to traverse the test task scheduling graph based on a breadth-first algorithm, calculate the priority of each of the test tasks, and generate a test task scheduling scheme according to the priority of each of the test tasks; The test module is used to perform batch comparison test on the systems to be tested according to the test task scheduling plan and generate comparison test results.

8. A batch comparison test device based on breadth-first algorithm according to claim 7, characterized in that: The scheduling diagram acquisition module includes: A scheduling diagram acquisition unit is used to determine whether the pre-configured existing test process can be reused based on the test scenario to be compared and the test task. If it can be reused, the test task scheduling diagram corresponding to the existing test process is obtained as the test task scheduling diagram; otherwise, the test task is arranged to generate the test task scheduling diagram.

9. An electronic device, characterized in that: It comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, a batch comparison test method based on a breadth-first algorithm as described in any one of claims 1 to 6 is implemented.

10. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable a computer to execute a batch comparison test method based on a breadth-first algorithm as described in any one of claims 1 to 6.

Images