An online differential packet production function test system

Abstract

The present invention provides an online differential package production function test system, including: a data acquisition module, used to obtain multiple source version packages and corresponding target version packages, each source version package and the corresponding target version package are associated with corresponding test parameters; a scenario storage module, used to pre-store multiple test scenarios; a package test module, used for each test scenario, using the source version package and the target version package associated with the corresponding test parameters to perform online differential package production function test and output the produced differential package; a verification and restoration module, used to verify whether the corresponding target version package can be restored according to the differential package corresponding to each test scenario, and output the verification report under each test scenario to show the online differential package production function test results corresponding to each test scenario. The beneficial effect is that the system performs online differential package production function test for different test scenarios, improves production efficiency and accuracy, and provides error logs to provide a basis for subsequent tests.

Description

Technical Field

[0001] The present invention relates to the technical field of differential packet testing, and in particular to an online differential packet production function testing system. Background Art

[0002] With the popularization of smart products and smart applications, version upgrades are becoming more and more frequent. Upgrade packages are pushed for upgrades every once in a while. However, traditional upgrade packages are full package upgrades, which are inefficient and time-consuming. Differential upgrades upgrade the difference parts based on the difference information between the source version and the target version, which can effectively improve efficiency and reduce time.

[0003] Currently, the production of differential packages is mainly carried out offline, and cannot be directly connected to the software version of the platform. In addition, the upgrade and restoration methods of different devices or systems are different. The online application scenarios for the production of differential packages are not tested separately, which lacks security. Summary of the invention

[0004] In view of the problems existing in the prior art, the present invention provides an online differential packet production function test system, comprising:

[0005] A data acquisition module, used to acquire a plurality of source version packages and corresponding target version packages, each of the source version packages and the corresponding target version package being associated with corresponding test parameters;

[0006] A scenario storage module, used to pre-store multiple test scenarios;

[0007] a package making test module, connected to the data acquisition module and the scenario storage module respectively, for performing an online differential package making function test on the source version package and the target version package associated with the corresponding test parameters for each test scenario and outputting the made differential package;

[0008] A verification and restoration module is connected to the package making test module, and is used to verify whether the corresponding target version package can be restored according to the differential package corresponding to each test scenario, and output a verification report under each test scenario to display the online differential package production function test results corresponding to each test scenario.

[0009] Preferably, the test scenario includes a basic test scenario, and the test parameters associated with the basic test scenario include multiple operating systems and multiple device types;

[0010] The package testing module includes a first testing unit, which is used to test whether differential packages can be produced online according to the source version package and the target version package associated with each operating system and each device type in the basic test scenario; when differential packages are produced, the differential packages are output to the verification and restoration module; when differential packages are not produced, the corresponding error logs are output.

[0011] Preferably, the test scenario includes a forward test scenario, and the test parameters associated with the forward test scenario include multiple accounts, multiple operating systems, multiple device types, multiple version relationships, and multiple difference sizes;

[0012] The package testing module includes a second testing unit, which is used to test whether the source version package and the target version package associated with each account or each operating system or each device type or each version relationship or each difference size in the forward test scenario can produce a differential package online; when a differential package is produced, the differential package is output to the verification and restoration module; when a differential package is not produced, a corresponding error log is output.

[0013] Preferably, the test scenario includes an abnormal test scenario, and the test parameters associated with the abnormal test scenario include multiple operating systems, multiple device types, multiple script files, and multiple execution commands;

[0014] The package testing module includes a third testing unit, which is used to test whether the source version package and the target version package associated with each operating system and each device type in the abnormal test scenario, as well as each script file and each execution command can produce differential packages online; when a differential package is produced, the differential package is output to the verification and restoration module; when a differential package is not produced, a corresponding error log is output.

[0015] Preferably, the third test unit includes:

[0016] The first test sub-unit is used to obtain the source version package and the target version package associated with any of the operating system and the device type in the abnormal test scenario, and execute the same execution command to test whether a differential sub-package can be made online when different script files are configured, and output an error log representing the script file error when a differential sub-package is not made;

[0017] The second test sub-unit is used to obtain the source version package and the target version package associated with any of the operating system and the device type in the abnormal test scenario, and configure the same script file to test whether a differential sub-package can be made online when executing different execution commands, and output an error log representing the execution command error when a differential sub-package is not made;

[0018] A third test sub-unit is used to obtain the source version packages and the target version packages associated with multiple different operating systems or different device types in the abnormal test scenario, configure the same script file and execute the same execution command, and test whether the source version packages and the target version packages associated with different operating systems or different device types can be made into differential packages online, and when differential packages are not made, output an error log representing the operating system errors associated with the source version packages and the target version packages; or

[0019] An error log indicating the device type error associated with the source version package and the target version package is output.

[0020] Preferably, the test scenario includes a compatible test scenario, and the test parameters associated with the compatible test scenario include multiple operating systems, multiple device types, multiple script files, multiple execution commands, and multiple browsers;

[0021] The package making test module includes a fourth test unit, which is used to obtain the source version package and the target version package associated with any of the operating system and the device type in the compatibility test scenario, configure the same script file and execute the same execution command, and test whether differential packages can be made online in different browsers respectively; when differential packages are made, the differential packages are output to the verification and restoration module; when differential packages are not made, the corresponding error log is output.

[0022] Preferably, the test scenario includes a parallel test scenario, and the test parameters associated with the parallel test scenario include multiple accounts, multiple operating systems, multiple device types, multiple version relationships, multiple browsers, multiple script files, multiple execution commands, and multiple processes;

[0023] The package making test module includes a fifth test unit, which is used to obtain the source version package and the target version package associated with any of the accounts, the operating system, the device type, and the version relationship in the parallel test scenario, configure the same script file and the same browser and execute the same execution command, and test whether differential packages can be made online in each process respectively. When differential packages are made, the differential packages are output to the verification and restoration module, and when differential packages are not made, the corresponding error logs are output.

[0024] Preferably, the verification and restoration module includes:

[0025] a first restoration unit, configured to restore the source version package corresponding to the differential package according to a restoration tool and verify whether the corresponding target version package can be restored, and output a verification report indicating a successful restoration when the target version package is successfully restored, and output a verification report indicating a failed restoration when the target version package is not successfully restored; and / or

[0026] The second restoration unit is used to download the differential package and the source version package corresponding to the differential package to a device end for restoration and verify whether the corresponding target version package can be restored. When the target version package is successfully restored, a verification report indicating a successful restoration is output; when the target version package is not successfully restored, a verification report indicating a failed restoration is output.

[0027] The above technical solution has the following advantages or beneficial effects: For different test scenarios, the system uses source version packages and target version packages associated with corresponding test parameters to perform online differential package production function tests, thereby improving the efficiency and accuracy of online differential package production, and providing error logs to provide a basis for subsequent tests. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a structural schematic diagram of the system in a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0029] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. The present invention is not limited to this embodiment, and other embodiments may also fall within the scope of the present invention as long as they conform to the gist of the present invention.

[0030] In a preferred embodiment of the present invention, based on the above problems existing in the prior art, an online differential packet production function test system is provided. Figure 1 As shown, including:

[0031] A data acquisition module 1, used to acquire multiple source version packages and corresponding target version packages, each source version package and the corresponding target version package are associated with corresponding test parameters;

[0032] A scenario storage module 2, used to pre-store multiple test scenarios;

[0033] A package test module 3, connected to the data acquisition module 1 and the scenario storage module 2, for performing online differential package production function test for each test scenario using the source version package and the target version package associated with the corresponding test parameters and outputting the produced differential package;

[0034] A verification and restoration module 4 is connected to the package making test module 3, and is used to verify whether the corresponding target version package can be restored according to the differential package corresponding to each test scenario, and output a verification report under each test scenario to display the online differential package making function test results corresponding to each test scenario.

[0035] Specifically, the system is implemented based on an online differential platform, so the test scenarios in the scenario storage module 2 need to determine the test scope in combination with the business relationship of the online differential platform.

[0036] Specifically, in this embodiment, it is necessary to configure the source version package of the source version and the target version package of the target version in advance to perform subsequent online production of the differential package.

[0037] In a preferred embodiment of the present invention, the test scenario includes a basic test scenario, and the test parameters associated with the basic test scenario include multiple operating systems and multiple device types;

[0038] The package testing module 3 includes a first testing unit 31, which is used to test whether the source version package and the target version package associated with each operating system and each device type in the basic test scenario can produce differential packages online. When differential packages are produced, the differential packages are output to the verification and restoration module. When differential packages are not produced, the corresponding error logs are output.

[0039] Specifically, in this embodiment, in the basic test scenario, it is tested whether source version packages and target version packages of different operating systems and device types can be used to create differential packages online.

[0040] In a preferred embodiment of the present invention, the test scenario includes a forward test scenario, and the test parameters associated with the forward test scenario include multiple accounts, multiple operating systems, multiple device types, multiple version relationships, and multiple difference sizes;

[0041] The package testing module 3 includes a second testing unit 32, which is used to test whether the source version package and the target version package associated with each account or each operating system or each device type or each version relationship or each difference size in the forward test scenario can produce differential packages online, and output the differential packages to the verification and restoration module when producing differential packages, and output the corresponding error log when not producing differential packages.

[0042] Specifically, in this embodiment, in the forward test scenario, for the source version package and the target version package, each test only changes one of the five test parameters, namely, account, operating system, device type, version relationship, and difference size, and keeps the other four test parameters the same to test whether a differential package can be produced online.

[0043] In a preferred embodiment of the present invention, the test scenario includes an abnormal test scenario, and the test parameters associated with the abnormal test scenario include multiple operating systems, multiple device types, multiple script files, and multiple execution commands;

[0044] The package testing module 3 includes a third testing unit 33, which is used to test the source version package and the target version package associated with each operating system and each device type in the abnormal test scenario, as well as each script file and each execution command whether a differential package can be produced online; when a differential package is produced, the differential package is output to the verification and restoration module; when a differential package is not produced, the corresponding error log is output.

[0045] In a preferred embodiment of the present invention, the third testing unit 33 includes:

[0046] The first test subunit 331 is used to obtain the source version package and the target version package associated with any operating system and device type in an abnormal test scenario, and execute the same execution command to test whether a differential subpackage can be made online when different script files are configured, and output an error log representing a script file error when a differential subpackage is not made;

[0047] The second test subunit 332 is used to obtain the source version package and the target version package associated with any operating system and device type in an abnormal test scenario, and configure the same script file to test whether a differential subpackage can be made online when executing different execution commands, and output an error log representing an execution command error when a differential subpackage is not made;

[0048] The third test sub-unit 333 is used to obtain source version packages and target version packages associated with multiple different operating systems or different device types in an abnormal test scenario, configure the same script file and execute the same execution command, test whether the source version packages and target version packages associated with different operating systems or different device types can be made into differential sub-packages online, and output an error log representing an operating system error associated with the source version package and the target version package when a differential sub-package is not made; or

[0049] Outputs error logs indicating device type errors associated with the source version package and the target version package.

[0050] Specifically, in this embodiment, considering that the script files required for producing differential packages for different operating systems and device types may also be different, the first test sub-unit 331 only changes the test parameter of the script file to test whether a differential package can be produced. In actual testing, it is also possible to consider directly using an erroneous script file to test whether anomalies, jams, etc. will occur during the production of the differential package.

[0051] Specifically, in this embodiment, the second test subunit 332 only changes the test parameter of the execution command to test whether a differential subpacket can be produced. In actual testing, it is also possible to consider removing or adding some commands in the execution command to test whether a differential subpacket can be produced.

[0052] Specifically, in this embodiment, the third test sub-unit 333 only changes the source version package and the target version package to test whether a differential package can be produced. In actual testing, you can consider using a source version package and a target version package that do not meet the specifications, or using the same two source version packages, or using the same two target version packages, or using source version packages and target version packages of different operating systems, or using source version packages and target version packages of different device types for testing respectively.

[0053] Preferably, considering that errors in the source version package and the target version package are a very common error type, the corresponding error prompts and error logs also need to be relatively comprehensive and accurate. When the first test sub-unit 331, the second test sub-unit 332 and the third test sub-unit 333 fail to produce differential packages and output error prompts and error logs, the operator is required to verify whether the error prompts and error logs are described correctly and whether there are any error prompts or error logs missing.

[0054] Specifically, in this embodiment, according to different requirements, some operations of interrupting packet making need to be designed. When the making process is interrupted, the operator checks whether the system is proceeding in the expected direction and whether it will affect the making of the next differential packet.

[0055] In a preferred embodiment of the present invention, the test scenario includes a compatible test scenario, and the test parameters associated with the compatible test scenario include multiple operating systems, multiple device types, multiple script files, multiple execution commands, and multiple browsers;

[0056] The package testing module 3 includes a fourth testing unit 34, which is used to obtain the source version package and the target version package associated with any operating system and device type in the compatible test scenario, configure the same script file and execute the same execution command, and test whether differential packages can be made online in different browsers. When differential packages are made, the differential packages are output to the verification and restoration module, and when differential packages are not made, the corresponding error logs are output.

[0057] Specifically, in this embodiment, considering that in actual scenarios, the browser used by users is uncontrollable, and the display effects of the same page on different browsers may also be different, browser compatibility testing is required. First, the online differential platform is opened in different browsers, and the source version package, target version package, execution command and script file are configured, and then the online differential package production operation is performed. The operator checks whether the page displayed in the browser is normal during the entire production process and whether a differential package can be produced. He can also check whether the error prompt is correct and whether the error log export is normal.

[0058] In a preferred embodiment of the present invention, the test scenario includes a parallel test scenario, and the test parameters associated with the parallel test scenario include multiple accounts, multiple operating systems, multiple device types, multiple version relationships, multiple browsers, multiple script files, multiple execution commands, and multiple processes;

[0059] The package testing module 3 includes a fifth testing unit 35, which is used to obtain the source version package and the target version package associated with any account, operating system, device type, and version relationship in a parallel testing scenario, configure the same script file and the same browser and execute the same execution command, and test whether differential packages can be made online in each process. When differential packages are made, the differential packages are output to the verification and restoration module, and when differential packages are not made, the corresponding error logs are output.

[0060] Specifically, in this embodiment, considering that multiple processes will be started simultaneously in actual scenarios to perform parallel online differential packet production, the following five situations are specifically divided into tests:

[0061] In the first case, start two processes, keep the source version package, target version package, execution command, script file, and browser the same, execute differential package production, check whether each process can produce differential packages and check whether the differential packages are automatically deployed;

[0062] In the second case, five processes are started, and only the accounts of the source version package and the target version package are changed. It is checked whether each process can produce a differential package and whether the differential package is automatically deployed.

[0063] In the third case, increase the number of processes started in sequence, keep the source version package, target version package, execution command, script file, and browser the same, execute differential package creation, and check the upper limit of the number of processes for parallel package creation;

[0064] In the fourth case, five processes are started, and only the operating system, device type, and version relationship of the source version package and the target version package are changed. It is checked whether each process can produce a differential package and whether the differential package is automatically deployed, and whether the automatic deployment paths of the differential packages produced in different processes are disordered;

[0065] In the fifth case, five processes are started, and only the version relationship and browser of the source version package and the target version package are changed. It is checked whether each process can produce a differential package and whether the differential package is automatically deployed, and whether the automatic deployment paths of the differential packages produced in different processes are disordered.

[0066] Specifically, in this embodiment, since there are many types of test scenarios, when testing each test scenario, it is necessary to configure the source version package, target version package, script file and execution command to be tested in advance, and the first test unit 31, the second test unit 32, the third test unit 33, the fourth test unit 34 and the fifth test unit 35 automatically select the combination corresponding to the test scenario to execute the differential package production operation, and export the successfully produced differential package. When the production fails, the error log needs to be saved to facilitate the analysis of the problem.

[0067] Preferably, the system will automatically record the process log and error log of differential package production and save them as log files for the operator to export and view. When at least one of the first test unit 31, the second test unit 32, the third test unit 33, the fourth test unit 34 and the fifth test unit 35 uses an unmatched test scenario, the system will output an error prompt to the operator. The operator needs to check whether the information description in the error prompt is accurate and whether the content description of the log file is clear and traceable.

[0068] In a preferred embodiment of the present invention, the verification and restoration module 4 includes:

[0069] A first restoration unit 41 is used to restore the source version package corresponding to the differential package according to a restoration tool and verify whether the corresponding target version package can be restored, and output a verification report indicating a successful restoration when the target version package is successfully restored, and output a verification report indicating a failed restoration when the target version package is not successfully restored; and / or

[0070] The second restoration unit 42 is used to download the differential package and the source version package corresponding to the differential package to a device end for restoration and verify whether the corresponding target version package can be restored. When the target version package is successfully restored, a verification report indicating a successful restoration is output; when the target version package is not successfully restored, a verification report indicating a failed restoration is output.

[0071] Specifically, in this embodiment, the second restoration unit 42 adopts a device restoration method, first burning the source version through the device end, then downloading the differential package through the cloud or directly storing the differential package in a specified directory on the device end, triggering the restoration program on the device end and waiting for the restoration to be completed. After the restoration is completed, it is verified whether the device end is the corresponding target version and whether the device can be used normally.

[0072] Preferably, the tool restoration method and the device restoration method each have their own advantages and disadvantages. In the actual testing process, the restoration tool should be used to perform a large number of restoration verifications, and then different types of device-side verification restoration processes should be used to improve the verification scope and efficiency and ensure the verification effect.

[0073] Specifically, in embodiment 1:

[0074] In the Android system, differential packages are made. Since the differential packages of the Android system are generally large, more memory is required to make differential packages. Therefore, generally only one process is supported to make differential packages. In actual testing, differential packages of different difference sizes are first made to verify whether differential packages can be made normally when the difference between the source version package and the target version package is large. Then, two or more processes are executed at the same time to check whether the subsequently started processes automatically enter the queue mode. After the previous process successfully makes a differential package, check whether the next process automatically makes a package and verify whether the differential package is successfully made.

[0075] Specifically, in Embodiment 2:

[0076] When the source version package V1, the target version package V2, and the V1-V2 differential package already exist on the online differential platform, the online differential platform no longer allows the creation of a reverse differential package of V2-V1 and will give a corresponding error prompt. In actual testing, first manually upload the V1-V2 differential package to verify whether a reverse differential package of V2-V1 can be created, create a V1-V2 differential package through the online differential platform, verify whether a reverse differential package of V2-V1 can be created online, and verify whether the interface prompts an error prompt. Then delete the existing V1-V2 differential package, verify whether a reverse differential package of V2-V1 can be created online, and continue to create the V1-V2 differential package online to check whether it can be created.

[0077] Specifically, in Embodiment 3:

[0078] Different types of devices in the real-time operating system may have different parameter information required for differential production. In actual testing, prepare the target version packages, parameter combinations, and expected result tables for different types of devices in advance. Use the restore tool to automatically read the target version packages and parameter combinations, perform online differential package operations, and check whether the production results are consistent with the expected result table. If the parameter combination is correct, the expected result table shows that the differential package can be produced normally. If the parameter combination is incorrect, the expected result table shows that the differential production has failed. Then check whether the error log is automatically collected when the production fails.

[0079] The above description is only a preferred embodiment of the present invention, and does not limit the implementation mode and protection scope of the present invention. For those skilled in the art, it should be aware that all solutions obtained by equivalent substitutions and obvious changes made using the contents of this specification and illustrations should be included in the protection scope of the present invention.

Claims

1. An online differential packet production function test system, characterized in that: include: A data acquisition module, used to acquire a plurality of source version packages and corresponding target version packages, each of the source version packages and the corresponding target version package being associated with corresponding test parameters; A scenario storage module, used to pre-store multiple test scenarios; a package making test module, connected to the data acquisition module and the scenario storage module respectively, for performing an online differential package making function test on the source version package and the target version package associated with the corresponding test parameters for each test scenario and outputting the made differential package; A verification and restoration module, connected to the package making test module, is used to verify whether the corresponding target version package can be restored according to the differential package corresponding to each test scenario, and output a verification report under each test scenario to show the online differential package making function test result corresponding to each test scenario; The test scenario includes an abnormal test scenario, and the test parameters associated with the abnormal test scenario include multiple operating systems, multiple device types, multiple script files, and multiple execution commands; Then the package making test module includes a third test unit, which is used to test whether the source version package and the target version package associated with each operating system and each device type in the abnormal test scenario, as well as each script file and each execution command can make a differential package online, and when making a differential package, output the differential package to the verification and restoration module, and when not making a differential package, output a corresponding error log; The third test unit comprises: The first test sub-unit is used to obtain the source version package and the target version package associated with any of the operating system and the device type in the abnormal test scenario, and execute the same execution command to test whether a differential sub-package can be made online when different script files are configured, and output an error log representing the script file error when a differential sub-package is not made; The second test sub-unit is used to obtain the source version package and the target version package associated with any of the operating system and the device type in the abnormal test scenario, and configure the same script file to test whether a differential sub-package can be made online when executing different execution commands, and output an error log representing the execution command error when a differential sub-package is not made; A third test sub-unit is used to obtain the source version packages and the target version packages associated with multiple different operating systems or different device types in the abnormal test scenario, configure the same script file and execute the same execution command, and test whether the source version packages and the target version packages associated with different operating systems or different device types can be made into differential packages online, and when differential packages are not made, output an error log representing the operating system errors associated with the source version packages and the target version packages; or An error log indicating the device type error associated with the source version package and the target version package is output.

2. The online differential packet production function test system according to claim 1, characterized in that: The test scenario includes a basic test scenario, and the test parameters associated with the basic test scenario include multiple operating systems and multiple device types; The package testing module includes a first testing unit, which is used to test whether differential packages can be produced online according to the source version package and the target version package associated with each operating system and each device type in the basic test scenario; when differential packages are produced, the differential packages are output to the verification and restoration module; when differential packages are not produced, the corresponding error logs are output.

3. The online differential packet production function test system according to claim 1, characterized in that: The test scenario includes a forward test scenario, and the test parameters associated with the forward test scenario include multiple accounts, multiple operating systems, multiple device types, multiple version relationships, and multiple difference sizes; The package testing module includes a second testing unit, which is used to test whether the source version package and the target version package associated with each account or each operating system or each device type or each version relationship or each difference size in the forward test scenario can produce a differential package online; when a differential package is produced, the differential package is output to the verification and restoration module; when a differential package is not produced, a corresponding error log is output.

4. The online differential packet production function test system according to claim 1, characterized in that: The test scenario includes a compatible test scenario, and the test parameters associated with the compatible test scenario include multiple operating systems, multiple device types, multiple script files, multiple execution commands, and multiple browsers; The package making test module includes a fourth test unit, which is used to obtain the source version package and the target version package associated with any of the operating system and the device type in the compatibility test scenario, configure the same script file and execute the same execution command, and test whether differential packages can be made online in different browsers respectively; when differential packages are made, the differential packages are output to the verification and restoration module; when differential packages are not made, the corresponding error log is output.

5. The online differential packet production function test system according to claim 1, characterized in that: The test scenario includes a parallel test scenario, and the test parameters associated with the parallel test scenario include multiple accounts, multiple operating systems, multiple device types, multiple version relationships, multiple browsers, multiple script files, multiple execution commands, and multiple processes; The package making test module includes a fifth test unit, which is used to obtain the source version package and the target version package associated with any of the accounts, the operating system, the device type, and the version relationship in the parallel test scenario, configure the same script file and the same browser and execute the same execution command, and test whether differential packages can be made online in each process respectively. When differential packages are made, the differential packages are output to the verification and restoration module, and when differential packages are not made, the corresponding error logs are output.

6. The online differential packet production function test system according to claim 1, characterized in that: The verification and restoration module comprises: a first restoration unit, configured to restore the source version package corresponding to the differential package according to a restoration tool and verify whether the corresponding target version package can be restored, and output a verification report indicating a successful restoration when the target version package is successfully restored, and output a verification report indicating a failed restoration when the target version package is not successfully restored; and / or The second restoration unit is used to download the differential package and the source version package corresponding to the differential package to a device end for restoration and verify whether the corresponding target version package can be restored. When the target version package is successfully restored, a verification report indicating a successful restoration is output; when the target version package is not successfully restored, a verification report indicating a failed restoration is output.

Images