A batch comparison automation testing method and system for a business system

Abstract

The application discloses a kind of batch comparison automation test method and system for business system, it is related to data testing technical field, method includes: constructing process engine, preconfiguring process engine test process, and according to test process executes following test process: according to test environment, clean historical data information;Generation test data, and verify its accuracy and integrity;Run start old system, test to the old system that starts normally;Real-time tracking data processing process of old system, and backup processing result;Re-clean test environment, and update deployment new system;Run start new system, test to the new system that starts normally;Real-time tracking data processing process of new system, and backup processing result;The processing result of old system and new system is batch compared, generates new and old system data difference comparison report.Through the technical scheme of the application, the probability of manual operation error is greatly reduced, and the test efficiency is improved.

Description

Technical Field

[0001] This invention relates to the field of data testing technology, and in particular to an automated batch comparison testing method and an automated batch comparison testing system for business systems. Background Technology

[0002] Currently, after the rapid development of 3G and 4G technologies, the telecommunications industry is now witnessing a rapid commercialization of 5G technology. In the 5G era, telecommunications systems are becoming increasingly complex, and the demands for testing quality and efficiency are rising during the promotion of new services. Simultaneously, the system's zero-tolerance policy for faults and problems requires that any configuration changes or program modifications undergo not only complete functional regression testing but also comprehensive business scenario testing before system deployment. To achieve comprehensive coverage of business scenario testing, large-scale comparative testing of pre- and post-upgrade systems using business scenario data is necessary to ensure zero faults and problems after system deployment. However, due to the large volume of batch comparative testing data, lengthy processing procedures, numerous manual operation issues, and significant workload and time consumption, there is an urgent need for an efficient and accurate automated batch comparative testing method to address these pain points. Summary of the Invention

[0003] To address the aforementioned issues, this invention provides a batch comparison automated testing method and system for business systems. By configuring a batch comparison testing process through a process engine, the old and new systems are tested using test data, and the test results of the old and new systems are compared in batches. Test reports are automatically generated, enabling customized testing processes, automated data and call detail record (CDR) construction, and intelligent test result reporting. This significantly reduces the probability of human error and greatly improves testing efficiency.

[0004] To achieve the above objectives, this invention provides an automated batch comparison testing method for business systems, comprising:

[0005] Build a process engine, pre-configure the test process of the process engine for the business system, and execute the following test procedures according to the test process:

[0006] Based on the selected test environment, clear the historical data information of the test environment;

[0007] Generate the test data required for the test, and verify the accuracy and completeness of the test data;

[0008] Run the old system to start, and use the test data to test the old system that starts normally;

[0009] Track the data processing process of the old system in real time and back up the processing results of the old system;

[0010] The test environment was cleaned up again, and the new system was updated and deployed.

[0011] Run and start the new system, and use the test data to test the new system that starts normally;

[0012] The data processing process of the new system is tracked in real time, and the processing results of the new system are backed up.

[0013] The processing results of the old system and the new system are compared in batches to generate a data difference comparison report between the old and new systems.

[0014] In the above technical solution, preferably, the test data includes data and business data. In the process of verifying the accuracy and completeness of the test data, if the accuracy and completeness of the test data are successfully verified, the next operation is performed; if the verification fails, new test data is reconstructed and generated.

[0015] In the above technical solution, preferably, before testing the old system using the test data and before testing the new system using the test data, system verification is performed on the old system and the new system after startup. If the verification shows that the system startup is normal, the test process is executed. If the verification shows that the system startup fails, the startup function is rerun until the system startup is verified to be normal.

[0016] In the above technical solution, preferably, if there is a processing abnormality or error during the real-time tracking of the data processing of the old system or the new system, new test data is regenerated and the system is retested.

[0017] In the above technical solution, preferably, the batch comparison and the generated data difference comparison report determine whether the data volume of the old system and the new system is completely consistent, whether the new system has data that is not present in the old system, whether the old system has data that is not present in the new system, and whether the data in the new system is consistent with the data in the old system.

[0018] This invention also proposes an automated batch comparison testing system for business systems, applying the automated batch comparison testing method for business systems disclosed in any of the above technical solutions, including:

[0019] The process engine configuration module is used to build the process engine, pre-configure the test process of the process engine for the business system, and execute the following test procedures according to the test process:

[0020] The historical data cleaning module is used to clean up the historical data information of the selected test environment.

[0021] The test data generation module is used to generate the test data required for the test and to verify the accuracy and completeness of the test data.

[0022] The old system operation test module is used to run and start the old system, and to test the old system that starts normally using the test data;

[0023] The legacy system test tracking module is used to track the data processing process of the legacy system in real time and back up the processing results of the legacy system.

[0024] The new system update deployment module is used to clean up the test environment and update and deploy the new system;

[0025] The new system operation test module is used to run and start the new system, and to test the new system that starts normally using the test data;

[0026] The new system test tracking module is used to track the data processing process of the new system in real time and back up the processing results of the new system.

[0027] The old and new batch comparison module is used to compare the processing results of the old system and the new system in batches and generate a data difference comparison report between the old and new systems.

[0028] In the above technical solution, preferably, during the process of verifying the accuracy and completeness of the test data, if the accuracy and completeness of the test data are successfully verified, the test data generation module will proceed to the next operation; if the verification fails, new test data will be reconstructed and generated.

[0029] In the above technical solution, preferably, the old system operation test module and the new system operation test module perform system verification on the old system and the new system after startup before testing the system using the test data. If the verification shows that the system startup is normal, the test process is executed. If the verification shows that the system startup fails, the startup function is rerun until the system startup is verified to be normal.

[0030] In the above technical solution, preferably, if there is a processing abnormality or error during the real-time tracking data processing of the old system test tracking module and the new system test tracking module, new test data will be regenerated and the system will be retested.

[0031] In the above technical solution, preferably, the data difference comparison report generated by the new and old batch comparison module determines whether the data volume of the old system and the new system is completely consistent, whether the data exists in the new system but not in the old system, whether the data exists in the old system but not in the new system, and whether the data in the new system is consistent with the data in the old system.

[0032] Compared with the prior art, the beneficial effects of the present invention are as follows: by configuring the batch comparison test process through the process engine, the old system and the new system are tested using test data respectively, and the test results of the old and new systems are compared in batches, and test reports are automatically generated. This realizes the customization of the test process, the automation of data and call detail record construction, and the intelligentization of test result reports, which greatly reduces the probability of human operation errors and greatly improves test efficiency. Attached Figure Description

[0033] Figure 1 This is a flowchart illustrating an automated batch comparison testing method for business systems disclosed in one embodiment of the present invention.

[0034] Figure 2 This is a schematic diagram of a batch comparison automated testing system for business systems disclosed in one embodiment of the present invention.

[0035] In the diagram, the correspondence between the components and the reference numerals is as follows:

[0036] 1. Process Engine Configuration Module, 2. Historical Data Cleanup Module, 3. Test Data Generation Module, 4. Old System Run Test Module, 5. Old System Test Tracking Module, 6. New System Update and Deployment Module, 7. New System Run Test Module, 8. New System Test Tracking Module, 9. New and Old Batch Comparison Module. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0038] The present invention will now be described in further detail with reference to the accompanying drawings:

[0039] like Figure 1 As shown, a batch comparison automated testing method for business systems provided by the present invention includes:

[0040] Build a process engine, pre-configure the process engine for the test process of the business system, and execute the following test procedures according to the test process:

[0041] Clean up historical data information in the selected test environment;

[0042] Generate the test data required for the test, and verify the accuracy and completeness of the test data;

[0043] Run the old system to boot, and use the test data to test the old system that boots normally;

[0044] Track the data processing process of the old system in real time and back up the processing results of the old system;

[0045] Clean up the test environment and update and deploy the new system;

[0046] Run the new system and test the system that starts normally using test data;

[0047] Track the data processing process of the new system in real time and back up the processing results of the new system;

[0048] The processing results of the old system and the new system are compared in batches to generate a data difference comparison report between the old and new systems.

[0049] In this implementation, a batch comparison test process is configured through a process engine. Test data is used to test the old system and the new system respectively, and the test results of the old and new systems are compared in batches. Test reports are automatically generated, realizing customized test processes, automated data and call detail record construction, and intelligent test result reporting. This greatly reduces the probability of human error and significantly improves test efficiency.

[0050] Specifically, this invention employs a process engine to achieve customized test processes, automated data and call detail record (CDR) construction, and intelligent test result reporting. It primarily addresses the issues of lengthy processes, frequent human errors, and large data volumes that lead to time-consuming batch comparison tests. Through automated batch comparison testing, it achieves a significant improvement in both quality and efficiency.

[0051] In the above embodiments, preferably, the test data includes data and business data. During the process of verifying the accuracy and completeness of the test data, if the accuracy and completeness of the test data are successfully verified, the next operation is performed; if the verification fails, new test data is reconstructed and generated.

[0052] In the above embodiments, preferably, before testing the old system with test data and before testing the new system with test data, system verification is performed on the old system and the new system after startup. If the verification shows that the system startup is normal, the test process is executed. If the verification shows that the system startup fails, the startup function is rerun until the system startup is verified to be normal.

[0053] In the above embodiments, preferably, if there is a processing abnormality or error during the real-time tracking of data processing of the old or new system, new test data is regenerated and the system is retested.

[0054] The automated batch comparison testing method for business systems disclosed in the above implementation method includes the following specific steps:

[0055] 1. Batch comparison is achieved through the process engine. Each process can be flexibly customized and configured through the process engine. To start batch comparison testing, the test environment is first selected and the historical data information of the test environment is cleared.

[0056] 2. After the environment cleanup is completed, generate the test data required for testing, including data files and call detail records, and verify the accuracy and completeness of the data. If the test data generation fails, return to the environment cleanup and reconstruct and generate the data.

[0057] 3. After the test data is constructed, the old system is started. After startup, the system is verified. If the verification fails, a restart function is provided. The next step is not started until the system has finished starting.

[0058] 4. After the old system starts up normally, proceed to test data processing. Track the processing progress of the data in each module of the old system in real time. If any processing exception or error is encountered during the processing, return to step 2 and start processing again.

[0059] 5. After the old system is processed, back up the processing results data and clean it up again. Then update the program and deploy the new program. If the program deployment fails, go back to the previous step and process it again.

[0060] 6. After the new system program is updated and deployed, the new system will start running. After startup, the system will be verified. If the verification fails, a restart function will be provided. The system will not proceed to the next step until it has started up completely.

[0061] 7. After the new system starts up normally, proceed to test data processing. Track the processing progress of the data in each module of the new system in real time. If any processing exception or error is encountered during the processing, return to step 5 and start processing again.

[0062] 8. After the new system has finished processing, perform a batch comparison of the results data between the new and old systems, and generate a comparison report of the differences between the data volume that is completely consistent between the new and old systems, the data that is present in the new system but not in the old system, the data that is present in the old system but not in the new system, and the data that is present in both the new and old systems but is inconsistent.

[0063] 9. Automatically generate reports and provide export and download functions; the entire function is executed automatically.

[0064] like Figure 2 As shown, the present invention also proposes an automated batch comparison testing system for business systems, which applies the automated batch comparison testing method for business systems disclosed in any of the above embodiments, including:

[0065] Process Engine Configuration Module 1 is used to build the process engine, pre-configure the test process of the process engine for the business system, and execute the following test procedures according to the test process:

[0066] Historical data cleanup module 2 is used to clean up historical data information of the selected test environment;

[0067] Test data generation module 3 is used to generate the test data required for testing and to verify the accuracy and completeness of the test data;

[0068] The old system operation test module 4 is used to run and start the old system, and to test the old system that starts normally using test data;

[0069] The legacy system test tracking module 5 is used to track the data processing process of the legacy system in real time and back up the processing results of the legacy system.

[0070] The new system update deployment module 6 is used to clean up the test environment and update and deploy the new system;

[0071] The new system operation test module 7 is used to run and start the new system, and to test the new system that starts normally using test data;

[0072] The new system test tracking module 8 is used to track the data processing process of the new system in real time and back up the processing results of the new system.

[0073] The new and old batch comparison module 9 is used to compare the processing results of the old system and the new system in batches and generate a data difference comparison report between the old and new systems.

[0074] In this implementation, a batch comparison test process is configured through a process engine. Test data is used to test the old system and the new system respectively, and the test results of the old and new systems are compared in batches. Test reports are automatically generated, realizing customized test processes, automated data and call detail record construction, and intelligent test result reporting. This greatly reduces the probability of human error and significantly improves test efficiency.

[0075] In the above embodiments, preferably, during the process of verifying the accuracy and completeness of the test data, if the accuracy and completeness of the test data are successfully verified, the test data generation module 3 will proceed to the next operation; if the verification fails, it will reconstruct and generate new test data.

[0076] In the above embodiments, preferably, the old system operation test module 4 and the new system operation test module 7 perform system verification on the old system and the new system after startup before testing the system using test data. If the verification shows that the system startup is normal, the test process is executed. If the verification shows that the system startup fails, the startup function is rerun until the system startup is verified to be normal.

[0077] In the above embodiments, preferably, if there is a processing abnormality or error during the real-time tracking data processing of the old system test tracking module 5 and the new system test tracking module, new test data will be regenerated and the system will be retested.

[0078] In the above implementation, preferably, the data difference comparison report generated by the old and new batch comparison module 9 determines whether the data volume in the old system and the new system is completely consistent, whether the data exists in the new system but not in the old system, whether the data exists in the old system but not in the new system, and whether the data in the new system and the old system are consistent.

[0079] According to the automated batch comparison testing system for business systems disclosed in the above embodiments, the functions to be implemented by each module are consistent with the steps of the automated batch comparison testing method for business systems in the above embodiments. The specific implementation process is as described in the above embodiments and will not be repeated here.

[0080] The above are merely preferred embodiments of the present invention and are not intended to limit the present invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A batch comparison automated testing method for business systems, characterized in that, include: Build a process engine, pre-configure the test process of the process engine for the business system, and execute the following test procedures according to the test process: Based on the selected test environment, clear the historical data information of the test environment; Generate the test data required for the test, and verify the accuracy and completeness of the test data; Run the old system to start, and use the test data to test the old system that starts normally; Track the data processing process of the old system in real time and back up the processing results of the old system; The test environment was cleaned up again, and the new system was updated and deployed. Run and start the new system, and use the test data to test the new system that starts normally; The data processing process of the new system is tracked in real time, and the processing results of the new system are backed up. The processing results of the old system and the new system are compared in batches to generate a data difference comparison report between the old and new systems. The test data includes data and business data. During the process of verifying the accuracy and completeness of the test data, if the accuracy and completeness of the test data are successfully verified, the next operation is executed; if the verification fails, new test data is reconstructed and generated. Before testing the old system using the test data, and before testing the new system using the test data, system verification is performed on the old system and the new system after startup. If the verification shows that the system starts normally, the test process is executed. If the verification shows that the system fails to start, the startup function is rerun until the system startup is verified to be normal. If any processing anomalies or errors occur during the real-time tracking of the data processing of the old system or the new system, new test data will be regenerated and the system will be retested. In the batch comparison and the generated data difference comparison report, it is determined whether the amount of data in the old system and the new system is completely consistent, whether the data exists in the new system but not in the old system, whether the data exists in the old system but not in the new system, and whether the data in the new system is consistent with the data in the old system.

2. An automated batch comparison testing system for business systems, characterized in that, The application of the automated batch comparison testing method for business systems as described in claim 1 includes: The process engine configuration module is used to build the process engine, pre-configure the test process of the process engine for the business system, and execute the following test procedures according to the test process: The historical data cleaning module is used to clean up the historical data information of the selected test environment. The test data generation module is used to generate the test data required for the test and to verify the accuracy and completeness of the test data. The old system operation test module is used to run and start the old system, and to test the old system that starts normally using the test data; The legacy system test tracking module is used to track the data processing process of the legacy system in real time and back up the processing results of the legacy system. The new system update deployment module is used to clean up the test environment and update and deploy the new system; The new system operation test module is used to run and start the new system, and to test the new system that starts normally using the test data; The new system test tracking module is used to track the data processing process of the new system in real time and back up the processing results of the new system. The old and new batch comparison module is used to compare the processing results of the old system and the new system in batches and generate a data difference comparison report between the old and new systems.

3. The automated batch comparison testing system for business systems according to claim 2, characterized in that, In the process of verifying the accuracy and completeness of the test data, the test data generation module will proceed to the next operation if the verification of the accuracy and completeness of the test data is successful, and reconstruct and generate new test data if the verification fails.

4. The automated batch comparison testing system for business systems according to claim 2, characterized in that, Before testing the system using the test data, the old system operation test module and the new system operation test module respectively perform system verification on the old system and the new system after startup. If the verification shows that the system starts normally, the test process is executed. If the verification shows that the system fails to start, the startup function is rerun until the system startup is verified to be normal.

5. The automated batch comparison testing system for business systems according to claim 2, characterized in that, If any processing abnormalities or errors occur during the real-time data processing of the old system test tracking module and the new system test tracking module, new test data will be regenerated and the system will be retested.

6. The automated batch comparison testing system for business systems according to claim 2, characterized in that, The data difference comparison report generated by the new and old batch comparison module determines whether the data volume in the old system and the new system is completely consistent, whether the data exists in the new system but not in the old system, whether the data exists in the old system but not in the new system, and whether the data in the new system and the old system are consistent.

Images