An iterative testing method, platform, device, and readable storage medium

Abstract

The present application discloses an iterative testing method, platform, device, and readable storage medium. The method includes: obtaining a differential configuration file corresponding to the current version number input by a user, and a baseline version number corresponding to the baseline configuration file of the differential configuration file, where the differential configuration file contains the content updated by the user to the baseline configuration file; searching for configuration files corresponding to each version number in a target version number sequence in a stored configuration file set; generating a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence; and establishing a task workflow according to the target configuration file. When performing iterative testing in the present application, only the differential configuration file needs to be manually edited, without the need to fully edit the configuration file every time a test is performed, and at the same time, there is no need to fully store the complete configuration file, greatly reducing the occupation of storage resources.

Description

Technical Field

[0001] This application relates to the field of application testing, and more specifically, to an iterative testing method, platform, device, and readable storage medium. Background Art

[0002] With the continuous development and improvement of computer intelligence, various rich application software has been developed and applied to all aspects of life and production, among which the algorithm testing link ensures the reliability of software algorithms. However, due to the complexity and variability of business logic and the continuous exploration and improvement of software development process methods, the speed of update and upgrade is accelerating. Most software applications will adopt the iterative development method, that is, an iterative test will be performed after each iterative development is completed to test the functions, security, etc. of the entire application.

[0003] In the process of existing intelligent algorithm research and development, whenever developers upgrade the software, they need to re-edit a set of brand-new configuration files corresponding to the current version to generate the task workflow used for testing. Therefore, in the process of adjusting the algorithm model, testers need to continuously fine-tune and iterate the task configuration based on certain scenarios, and each time a task is initiated, all task configurations need to be resubmitted to generate a new task workflow, and each configuration file will be saved in full. In this way, during a large number of tests, it is not only not conducive to tracking the rapid evolution of simulation tasks, but also causes a large amount of storage resources to be occupied.

[0004] Based on the above situation, there is an urgent need for an iterative testing solution to solve the problem of a large amount of storage resources occupied during the iterative testing process. Summary of the Invention

[0005] In view of this, this application provides an iterative testing method, platform, device, and readable storage medium to solve the problem of a large amount of storage resources occupied during the iterative testing process.

[0006] An iterative testing method includes:

[0007] Obtain the differential configuration file corresponding to the current version number input by the user, and the reference version number corresponding to the reference configuration file of the differential configuration file, where the differential configuration file contains the content updated by the user to the reference configuration file;

[0008] In the set of stored configuration files, find the configuration files corresponding to each version number in the target version number sequence. The target version number sequence takes the reference version number and the base version number as the head and tail. In the order from the reference version number to the base version number, the configuration file corresponding to the latter version number is the reference configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file;

[0009] Generate a target configuration file based on the difference configuration file and the configuration files corresponding to each version number in the found target version number sequence;

[0010] Establish a task workflow according to the target configuration file.

[0011] Preferably, it further includes:

[0012] Store the difference configuration file, the current version number, and the reference version number in the configuration file set correspondingly.

[0013] Preferably, it further includes:

[0014] In the stored log file set, find the log files corresponding to each version number in the target version number sequence;

[0015] Generate a reference log file based on the log files corresponding to each version number in the found target version number sequence;

[0016] Generate a difference log file according to the difference content between the current log file generated according to the task workflow and the reference log file, and store the difference log file, the current version number, and the reference version number in the log file set correspondingly.

[0017] Preferably, it further includes:

[0018] In the stored log file set, find the log files corresponding to each version number in the target version number sequence;

[0019] Determine the node log files corresponding to each operation node of the task workflow in the log files corresponding to each version number in the target version number sequence;

[0020] Generate a reference node log file for each operation node based on the node log files corresponding to each operation node;

[0021] Generate a node difference log file for each operation node according to the difference content between the current node log file generated for each operation node in the task workflow and the reference node log file for each operation node;

[0022] Form the node difference log files into a difference log file, and store the difference log file, the current version number, and the reference version number in the log file set correspondingly.

[0023] Preferably, the generating a target configuration file based on the difference configuration file and the configuration files corresponding to each version number in the found target version number sequence includes:

[0024] Determine the construction order of the configuration files corresponding to each version number in the target version number sequence. The construction order is a file order starting from the base configuration file corresponding to the base version number and ending with the reference registration file corresponding to the reference version number. Among them, for any two adjacent configuration files in the construction order, the previous configuration file is the reference configuration file for the next configuration file;

[0025] Construct the configuration files corresponding to each version number in the target version number sequence according to the construction order to generate a reference configuration file;

[0026] Generate a target configuration file based on the reference configuration file and the differential configuration file.

[0027] Preferably, it further includes:

[0028] In the stored result file set, search for the result files corresponding to each version number in the target version number sequence;

[0029] Generate a reference result file based on the found result files corresponding to each version number in the target version number sequence;

[0030] Generate a differential result file according to the differential content between the current result file generated according to the task workflow and the reference result file, and store the differential result file corresponding to the current version number and the reference version number in the result file set.

[0031] An iterative test platform, including:

[0032] A configuration file acquisition unit, configured to acquire the differential configuration file corresponding to the current version number input by the user, and the reference version number corresponding to the reference configuration file of the differential configuration file. The differential configuration file contains the content updated by the user to the reference configuration file;

[0033] A configuration file search unit, configured to search for the configuration files corresponding to each version number in the target version number sequence in the stored configuration file set. The target version number sequence takes the reference version number and the base version number as the head and the tail, and in the order from the reference version number to the base version number, the configuration file corresponding to the next version number is the reference configuration file for the configuration file corresponding to the previous version number. The base version number is the version number corresponding to the base configuration file;

[0034] A configuration file generation unit, configured to generate a target configuration file based on the differential configuration file and the found configuration files corresponding to each version number in the target version number sequence;

[0035] A task flow establishment unit, configured to establish a task workflow according to the target configuration file.

[0036] Preferably, it further includes:

[0037] A configured storage unit for storing the difference profile corresponding to the current version number and the reference version number in the profile set.

[0038] Preferably, it further includes:

[0039] A log search unit for searching for the log files corresponding to each version number in the target version number sequence in the stored log file set;

[0040] A log generation unit for generating a reference log file based on the log files corresponding to each version number in the target version number sequence obtained by searching;

[0041] A log storage unit for generating a difference log file according to the difference content between the current log file generated by the task workflow and the reference log file, and storing the difference log file corresponding to the current version number and the reference version number in the log file set.

[0042] Preferably, it further includes:

[0043] A result search unit for searching for the result files corresponding to each version number in the target version number sequence in the stored result file set;

[0044] A result generation unit for generating a reference result file based on the result files corresponding to each version number in the target version number sequence obtained by searching;

[0045] A result storage unit for generating a difference result file according to the difference content between the current result file generated by the task workflow and the reference result file, and storing the difference result file corresponding to the current version number and the reference version number in the result file set.

[0046] An iterative test device, including a memory and a processor;

[0047] The memory is used for storing programs;

[0048] The processor is used for executing the program to implement each step of the application iterative test method as described in any one of the above.

[0049] A readable storage medium, on which a computer program is stored, characterized in that when the computer program is executed by a processor, each step of the iterative test method as described in any one of the above is implemented.

[0050] As can be seen from the above technical solutions, an iterative testing method, platform, device, and readable storage medium provided by an embodiment of the present application obtain a differential configuration file corresponding to the current version number input by a user, and a reference version number corresponding to a reference configuration file of the differential configuration file, and search for configuration files corresponding to each version number in a target version number sequence in a stored set of configuration files. Among them, the differential configuration file contains the content updated by the user to the reference configuration file, that is, the differential configuration file only contains the differential content updated and upgraded on the basis of the reference registration file, rather than a full-scale edit of the configuration file. The target version number sequence uses the reference version number and the base version number as the head and tail, and in the order from the reference version number to the base version number, the configuration file corresponding to the latter version number is the reference configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file, that is, all configuration files related to the reference configuration file in series are found. Based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence, a target configuration file is generated, and the target configuration file is a complete full-scale configuration file. Finally, a task workflow is established according to the target configuration file.

[0051] In the present application, during iterative testing, only the differential content updated and upgraded needs to be manually edited, that is, the differential configuration file, and there is no need to perform a full-scale edit of the configuration file every time a test is performed. At the same time, when storing, only the differential content updated each time, that is, the differential configuration file, needs to be stored. Then, by querying all configuration files related to the reference configuration file in series corresponding to the differential configuration file and combining the currently edited differential configuration file, a target configuration file required for establishing a task workflow for the current test can be generated, without the need to perform a full-scale storage of the complete configuration file, which greatly reduces the occupation of storage resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for describing the embodiments or the prior art. Obviously, the drawings in the following description are only the embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without creative efforts.

[0053] Figure 1 It is a flowchart of an iterative testing method disclosed in the present application;

[0054] Figure 2 It is a schematic diagram of a target version number sequence disclosed in the present application;

[0055] Figure 3 It is a schematic diagram of a node log file disclosed in the present application;

[0056] Figure 4 It is a structural block diagram of an iterative test platform disclosed in this application;

[0057] Figure 5 It is another structural block diagram of an iterative test platform disclosed in this application;

[0058] Figure 6 It is a hardware structural block diagram of an iterative test device disclosed in this application. Specific implementation manners

[0059] Next, the accompanying drawings in the embodiments of this application will be used to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0060] Next, the solution of this application will be introduced. This application proposes the following technical solution. For details, please refer to the following text.

[0061] Figure 1 It is a flowchart of an iterative test method disclosed in an embodiment of this application. This iterative test method can be applied to an iterative test platform, such as Figure 1 As shown, this method may include:

[0062] Step A1: Obtain the differential configuration file corresponding to the current version number input by the user, and the baseline version number corresponding to the baseline configuration file of the differential configuration file.

[0063] Specifically, the differential configuration file contains the content updated by the user to the baseline configuration file. Each update is regarded as a new version. During the iterative update process, the new version is an update and upgrade based on an old version. The current version number is the version number of this upgrade and update, and the baseline version number is the version number of the old version used as the basis for this upgrade and update. Any old version number can be used as the baseline version number of the current version. That is to say, any one can be selected from the configuration files stored locally as the baseline registration file, and the content updated on the basis of this baseline registration file forms the differential configuration file of the current version, and this differential configuration file corresponds to this baseline configuration file.

[0064] Generally, compared with the old version, some content remains unchanged in the new version, while some other content is modified or new content is added. In this application, the user only needs to compile and modify the content that is modified or added to the old version based on an old version, that is, input the differential configuration file and the base version number corresponding to the base configuration file of the differential configuration file. The base version number can be attached to the differential configuration file in the form of a file label or the corresponding base version number can be marked in the naming. This application does not limit the marking method of the base version number. Through the base version number, the corresponding base configuration file can be found in the set of configuration files stored locally. The differential configuration file can be generated in advance on the user side and stored on the local disk of the user side. The user can view and modify the differential configuration file without the network and then submit the differential configuration file to the iterative test platform after connecting to the network, reducing the dependence of some work on the network and the server. The generation of the differential configuration file can be compiled and modified by multiple users simultaneously on the specified version of a certain task and then submitted to the iterative test platform to merge these compiled and modified contents to generate the final differential configuration file, improving the collaboration efficiency.

[0065] It can be understood that for the development of different functions of software, a large number of versions may be generated, and the functions targeted by different versions may be different. For example, the software is updated and upgraded three times. V0 is the base version number, and three updates form three versions V1 - V3 in sequence. Both V1 and V2 are developed and updated based on V0, and V3 is developed and updated based on V1. V1 and V3 mainly upgrade Function 1 of the software, and V2 mainly upgrades Function 2 of the software. It can be seen that the base version is the version used as the basis for this upgrade and is not necessarily the version of the previous update. The base registration file is the configuration file used as the basis for this upgrade and is not necessarily the configuration file of the previous update.

[0066] Step A2: In the set of stored configuration files, find the configuration files corresponding to each version number in the target version number sequence.

[0067] Specifically, it is first necessary to determine the target version number sequence. The target version number sequence takes the base version number and the base version number as the head and tail. In the order from the base version number to the base version number, the configuration file corresponding to the subsequent version number is the base configuration file of the configuration file corresponding to the previous version number. The base version number is the version number corresponding to the base configuration file. The determination method of the target version number sequence is to determine the next base version number corresponding to the base version number of the current version based on the base version number of the current version, and then determine the relevant subsequent version numbers one by one until the subsequent version number is the base version number.

[0068] The local configuration file set stores a base configuration file and differential configuration files generated by each version compared to its corresponding baseline configuration file. As Figure 2 shown in the local configuration file set, there are 10 versions of configuration files stored. Among them, V0 is the base configuration file. For each "XX_YY" configuration file, "XX" is the current version number, and "YY" is the baseline version number relative to version "XX". The differential configuration file input by the user is "V10_V9". Taking the baseline version number and the base version number as the start and end, a total of 7 serially related versions as shown in the figure can be queried in sequence. According to the rule that the configuration file corresponding to the latter version number is the baseline configuration file of the configuration file corresponding to the previous version number in the direction from the baseline version number to the base version number, the target version number sequence in the figure can be obtained.

[0069] After that, based on the target version number sequence, in the stored configuration file set, each configuration file corresponding to each version number in the target version number sequence can be searched for and pulled one by one.

[0070] Step A3: Generate a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence.

[0071] Specifically, the target configuration file is a complete full-scale configuration file. Since the pulled configuration files are such that the configuration file corresponding to the latter version number is the baseline configuration file of the configuration file corresponding to the previous version number, a target configuration file can be generated based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence.

[0072] For example, in the case as Figure 2 shown, for the differential configuration file "V10_V9" input by the user, its corresponding target configuration file is generated by Figure 2 the configuration files corresponding to each version number in the target version number sequence in the figure, in combination with the differential configuration file "V10_V9".

[0073] Step A4: Establish a task workflow according to the target configuration file.

[0074] Specifically, the application software to be tested executes this task workflow to generate log files during the execution process and finally obtained result files.

[0075] As can be seen from the above technical solution, an iterative testing method provided by an embodiment of the present application obtains a differential configuration file corresponding to the current version number input by a user, and a reference version number corresponding to the reference configuration file of the differential configuration file, and searches for configuration files corresponding to each version number in a target version number sequence in a stored configuration file set. Among them, the differential configuration file contains the content updated by the user to the reference configuration file, that is, the differential configuration file only contains the differential content updated and upgraded again on the basis of the reference registration file, rather than a full-scale edit of the configuration file. The target version number sequence uses the reference version number and the base version number as the head and tail. In the order from the reference version number to the base version number, the configuration file corresponding to the latter version number is the reference configuration file of the configuration file corresponding to the previous version number. The base version number is the version number corresponding to the base configuration file, that is, all configuration files related to the reference configuration file in series are found. Based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence, a target configuration file is generated. The target configuration file is a complete full-scale configuration file. Finally, a task workflow is established according to the target configuration file.

[0076] In the present application, during iterative testing, only the differential content updated and upgraded, that is, the differential configuration file, needs to be manually edited, and there is no need to fully edit the configuration file every time a test is performed. At the same time, during storage, only the differential content updated each time, that is, the differential configuration file, needs to be stored. By querying all configuration files related to the reference configuration file in series corresponding to the differential configuration file and combining the currently edited differential configuration file, a target configuration file required for establishing a task workflow for the current test can be generated, without the need to fully store the complete configuration file, greatly reducing the occupation of storage resources.

[0077] Optionally, after obtaining the differential configuration file corresponding to the current version number input by the user, it may further include:

[0078] Step A5: Store the differential configuration file, the current version number, and the reference version number in the configuration file set correspondingly.

[0079] Specifically, during each upgrade and update, the differential configuration file can also be stored in the configuration file set corresponding to the current version number and the reference version number. When the next upgrade and update is based on this version as the reference version, the differential configuration file can be queried according to the current version number, and other version numbers connected in series with it can be confirmed according to the reference version number. This application only needs to store the differential configuration file, and generates the target configuration file by querying other connected configuration files, so as to achieve iterative testing. There is no need to compile the complete full-scale configuration file every time there is an update and upgrade, nor to store the complete full-scale configuration file. Compared with the prior art, the process of compiling the configuration file in this application takes less time and effort, and requires less storage resources.

[0080] In some embodiments of the present application, the process of step A3, generating a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence, is introduced. Specifically, it may include:

[0081] ① Determine the construction order of the configuration files corresponding to each version number in the target version number sequence.

[0082] Specifically, after finding the configuration files corresponding to each version number in the target version number sequence from the stored configuration file set and pulling out these configuration files, it is also necessary to determine the construction order of the configuration files corresponding to each version number in the target version number sequence. The construction order starts from the basic configuration file corresponding to the basic version number and ends with the reference registration file corresponding to the reference version number. Among them, for any two adjacent configuration files in the construction order, the previous configuration file is the reference configuration file of the next configuration file.

[0083] For example, in Figure 2 the shown case, the configuration files corresponding to each version number in the target version number sequence are pulled out, namely, a total of seven configuration files: "V9_V8", "V8_V6", "V6_V5", "V5_V2", "V2_V1", "V1_V0", and "V0". Starting from the basic configuration file corresponding to the basic version number and ending with the reference registration file corresponding to the reference version number, the construction order of the configuration files should be "V0" → "V1_V0" → "V2_V1" → "V5_V2" → "V6_V5" → "V8_V6" → "V9_V8".

[0084] ② Build the configuration files corresponding to each version number in the target version number sequence according to the construction order to generate a reference configuration file.

[0085] Specifically, the generated reference configuration file, which is the configuration file generated according to the construction order of the said configuration file, is the target configuration file corresponding to the base version number of the current version number. When testing the base version number, it is the target configuration file that is relative to the complete full amount of the base version and is used in the construction task workflow.

[0086] ③ Generate a target configuration file based on the said reference configuration file and the differential configuration file.

[0087] Specifically, by combining the content of the reference configuration file and the differential configuration file, a target configuration file that is complete and full for the current version can be generated. Based on the said target configuration file, a task workflow for the current version can be generated.

[0088] Considering that log files will be continuously generated during the execution of the task workflow, and in the prior art, the log files are also stored in a full - volume storage manner, which also has the problem of occupying a large amount of storage resources. Therefore, in some embodiments of the present application, two alternative implementation methods are provided, that is, for log files, differential files are also generated, and the storage of log files during the iterative testing process is achieved by storing the differential files.

[0089] The following introduces these two alternative methods, which specifically may include:

[0090] The first one:

[0091] Step B11: In the stored set of log files, find the log files corresponding to each version number in the said target version number sequence.

[0092] Specifically, the target version number sequence is the target version number sequence determined in step A2, that is, with the base version number and the base configuration version number as the head and tail, in the order from the base version number to the base configuration version number, the configuration file corresponding to the subsequent version number is the base configuration file of the configuration file corresponding to the previous version number, and the base configuration version number is the version number corresponding to the base configuration file.

[0093] For log files, in the order from the base version number to the base configuration version number, the log file corresponding to the subsequent version number is also the base log file of the log file corresponding to the previous version number. In the stored set of log files, find the log files corresponding to each version number in the said target version number sequence, and pull the log files corresponding to each version number in it.

[0094] Step B12: Generate a reference log file based on the log files corresponding to each version number in the target version number sequence found.

[0095] Specifically, since among the log file set, except for the basic log file, other log files are incomplete log files that are generated based on another log file and only record the differential content, after the log files corresponding to each version number in the obtained target version number sequence are found, a complete and full log file for the baseline version of the current version can be formed, and the complete and full log file of the baseline version is used as the reference log file.

[0096] Step B13: Generate a differential log file according to the differential content between the current log file generated according to the task workflow and the reference log file, and store the differential log file, the current version number, and the baseline version number in the log file set in a corresponding manner.

[0097] Specifically, the current log file is a complete and full log file for the current version. By comparing the content of this log file with the complete and full log file of the baseline version, that is, the reference log file, the differential content of the current log file compared with the reference log file can be obtained. The differential content is used as the differential log file and stored in the log file set in a corresponding manner with the current version number and the baseline version number, without the need to store the current log file in full.

[0098] If the user hopes to view the current log file, the differential log file corresponding to the current version number and the log files corresponding to each version number in the target version number sequence can be extracted, and then the current log file can be generated.

[0099] Second,

[0100] Step B21: In the stored log file set, find the log files corresponding to each version number in the target version number sequence.

[0101] Specifically, the target version number sequence is the target version number sequence determined in step A2, that is, with the baseline version number and the base version number as the head and tail, in the order from the baseline version number to the base version number, the configuration file corresponding to the latter version number is the baseline configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file.

[0102] For log files, in the order from the baseline version number to the base version number, the log file corresponding to the latter version number is also the baseline log file of the log file corresponding to the previous version number. In the stored log file set, find the log files corresponding to each version number in the target version number sequence, and pull the log files corresponding to each version number in it.

[0103] Step B22: Determine the node log files corresponding to each operation node of the task workflow among the log files corresponding to each version number in the target version number sequence.

[0104] Specifically, considering that there are usually several operation nodes in the task workflow, and each operation node will generate its own node log file during the execution process. Therefore, after obtaining the log files corresponding to each version number in the target version number sequence, it is also necessary to determine the node log files corresponding to each operation node of the task workflow in each log file.

[0105] As Figure 3 shown, the log files corresponding to each version number in the target version number sequence are the "V5_V2" log file, the "V2_V0" log file, and the "V0" log file. The task workflow is divided into three working nodes, and the node log files corresponding to each operation node can be determined in each log file. For the "V5_V2" log file, it includes the "V5_V2_1" node log file, the "V5_V2_2" node log file, and the "V5_V2_3" node log file, which are the node log files corresponding to operation node one, operation node two, and operation node three, respectively.

[0106] Step B23: Generate a reference node log file for each operation node based on the node log files corresponding to each operation node.

[0107] Specifically, since in addition to the basic node log files in the node log files, that is Figure 3 the three node log files included in V0 in, the other log files are incomplete node log files that only record the differential content generated based on another log file. Therefore, after finding the log files corresponding to each version number in the target version number sequence and determining the node log files corresponding to each node therein, a complete and full-scale node log file of the benchmark version for the current version corresponding to each operation node can be formed based on the node log files corresponding to each operation node, and the complete and full-scale node log file of the benchmark version is used as the reference node log file.

[0108] In Figure 3 the example, for the current version V6 with V5 as the benchmark version, the "V5_V2_3" node log file, the "V2_V0_3" node log file, and the "V0_3" node log file can be used to generate a reference node log file for operation node three.

[0109] Step B24: Generate a node differential log file for each operation node according to the differential content between the current node log file generated by each operation node in the task workflow and the reference node log file of each operation node.

[0110] Specifically, the current node log file is a complete full-volume node log file for each operation node corresponding to the current version. By comparing this current node log file with the complete full-volume node log files of each operation node in the baseline version, that is, the content of the reference node log file for each operation node, the difference content of the current node log file compared to the reference log file can be obtained for each operation node. The difference content is used as the node difference log file for this operation node.

[0111] In Figure 3 In the case shown, if the user wishes to view the node log file of operation node three of version V5, the difference log file corresponding to the current version number can be extracted, that is, the "V5_V2_3" node log file, and the node log files corresponding to operation node three in the log files corresponding to each version number in the target version number sequence, that is, the "V2_V0_3" node log file and the "V0_3" node log file. Based on the "V5_V2_3" node log file, the "V2_V0_3" node log file, and the "V0_3" node log file, the node log file of operation node three of version V5 can be generated.

[0112] Step B25: Combine the node difference log files into a difference log file and store them in the log file set corresponding to the current version number and the baseline version number.

[0113] Specifically, the node difference log files of each node in the current version are combined into a difference log file and stored in the log file set corresponding to the current version number and the baseline version number, without the need to store the current node log file in full volume.

[0114] Considering that the task workflow will generate result files such as production metric data after execution, and in the prior art, full-volume storage is also used for result files, which also has the problem of occupying a large amount of storage resources. Therefore, in some embodiments of the present application, an alternative implementation method is provided, that is, for result files, differential files are also generated, and the result files in the iterative test process are stored by storing the differential files.

[0115] The following is a specific introduction, which may include:

[0116] Step C1: In the stored result file set, search for the result files corresponding to each version number in the target version number sequence.

[0117] Specifically, the target version number sequence is the target version number sequence determined in step A2, that is, using the reference version number and the base version number as the head and tail, in the order from the reference version number to the base version number, the configuration file corresponding to the latter version number is the reference configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file.

[0118] For the result files, in the order from the reference version number to the base version number, the result file corresponding to the latter version number is also the reference result file of the result file corresponding to the previous version number. In the set of stored result files, search for the result files corresponding to each version number in the target version number sequence, and pull the result files corresponding to each version number in the target version number sequence.

[0119] Step C2: Generate a reference result file based on the result files corresponding to each version number in the target version number sequence obtained by searching.

[0120] Specifically, since except for the base result file in the result file set, other result files are incomplete result files that only record the differential content and are generated based on another result file. Therefore, after the result files corresponding to each version number in the target version number sequence obtained by searching, a complete and full-scale result file for the reference version of the current version can be formed, and the complete and full-scale result file of the reference version is used as the reference result file.

[0121] Step C3: Generate a differential result file based on the differential content between the current result file generated according to the task workflow and the reference result file, and store the differential result file corresponding to the current version number and the reference version number in the result file set.

[0122] Specifically, the current result file is a complete and full-scale result file for the current version. By comparing the content of this result file with the complete and full-scale result file of the reference version, that is, the reference result file, the differential content of the current result file compared with the reference result file can be obtained. The differential content is used as the differential result file and stored in the result file set corresponding to the current version number and the reference version number, without the need to store the current result file in full.

[0123] If the user hopes to view the current result file, the differential result file corresponding to the current version number and the result files corresponding to each version number in the target version number sequence can be extracted to generate the current result file.

[0124] The iterative test platform provided by the embodiments of the present application will be described below. The iterative test platform described below can be correspondingly referred to the iterative test method described above.

[0125] SeeFigure 4 , Figure 4 It is a structural block diagram of an iterative test platform disclosed in an embodiment of the present application.

[0126] As Figure 4 shown, the iterative test platform may include:

[0127] A configuration file acquisition unit 110, configured to acquire a differential configuration file corresponding to the current version number input by a user, and a reference version number corresponding to the reference configuration file of the differential configuration file, where the differential configuration file contains the content updated by the user to the reference configuration file;

[0128] A configuration file search unit 120, configured to search, in a stored set of configuration files, for configuration files corresponding to each version number in a target version number sequence, where the target version number sequence uses the reference version number and the base version number as the head and tail, and in the order from the reference version number to the base version number, the configuration file corresponding to the subsequent version number is the reference configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file;

[0129] A configuration file generation unit 130, configured to generate a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence;

[0130] A task flow establishment unit 140, configured to establish a task workflow according to the target configuration file.

[0131] It can be seen from the above technical solutions that an iterative test platform provided by an embodiment of the present application, by acquiring a differential configuration file corresponding to the current version number input by a user, and a reference version number corresponding to the reference configuration file of the differential configuration file, searches for configuration files corresponding to each version number in a target version number sequence in a stored set of configuration files. Among them, the differential configuration file contains the content updated by the user to the reference configuration file, that is, the differential configuration file only contains the differential content updated and upgraded again on the basis of the reference registration file, rather than a full-scale edit of the configuration file. The target version number sequence uses the reference version number and the base version number as the head and tail, and in the order from the reference version number to the base version number, the configuration file corresponding to the subsequent version number is the reference configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file, that is, all configuration files related to the reference configuration file in series are found. Based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence, a target configuration file is generated, and the target configuration file is a complete full-scale configuration file. Finally, a task workflow is established according to the target configuration file.

[0132] In this application, during iterative testing, only the differential content to be updated and upgraded needs to be manually edited, that is, the differential configuration file, without the need to fully edit the configuration file every time a test is performed. At the same time, during storage, only the differential content updated each time needs to be stored, that is, the differential configuration file is stored. All relevant configuration files can be concatenated by querying the baseline configuration file corresponding to the differential configuration file. Combining the currently edited differential configuration file, the target configuration file required for the current test to establish a task workflow can be generated without the need to fully store the complete configuration file, greatly reducing the occupation of storage resources.

[0133] Optionally, the iterative test platform may further include:

[0134] A configuration storage unit 150, configured to store the differential configuration file corresponding to the current version number and the baseline version number in the configuration file set.

[0135] Optionally, the iterative test platform may further include the following two optional structures, namely:

[0136] The first type,

[0137] A log search unit 210, configured to search for the log files corresponding to each version number in the target version number sequence in the stored log file set;

[0138] A log generation unit 220, configured to generate a reference log file based on the log files corresponding to each version number in the target version number sequence obtained by searching;

[0139] A log storage unit 230, configured to generate a differential log file according to the differential content between the current log file generated by the task workflow and the reference log file, and store the differential log file corresponding to the current version number and the baseline version number in the log file set.

[0140] The second type,

[0141] A log search unit 240, configured to search for the log files corresponding to each version number in the target version number sequence in the stored log file set;

[0142] A node log determination unit 250, configured to determine the node log files corresponding to each operation node of the task workflow in the log files corresponding to each version number in the target version number sequence;

[0143] A node log generation unit 260, configured to generate a reference node log file for each operation node based on the node log files corresponding to each operation node;

[0144] A log generation unit 270, configured to generate a node difference log file for each operation node according to the difference content between the current node log file generated by each operation node in the task workflow and the reference node log file of each operation node;

[0145] A log storage unit 280, configured to form a difference log file from the node difference log files, and store them in the log file set corresponding to the current version number and the reference version number.

[0146] Optionally, the configuration file generation unit 130 may include:

[0147] A build order determination unit 131, configured to determine the build order of the configuration files corresponding to each version number in the target version number sequence. The build order starts from the base configuration file corresponding to the base version number and ends with the reference registration file corresponding to the reference version number. Among them, for any two adjacent configuration files in the build order, the previous configuration file is the reference configuration file for the next configuration file;

[0148] A reference configuration construction unit 132, configured to construct the configuration files corresponding to each version number in the target version number sequence according to the build order to generate reference configuration files;

[0149] A target configuration construction unit 133, configured to generate a target configuration file based on the reference configuration file and the difference configuration file.

[0150] Optionally, the iterative test platform may further include:

[0151] A result search unit 310, configured to search for the result files corresponding to each version number in the target version number sequence in the stored result file set;

[0152] A result generation unit 320, configured to generate a reference result file based on the result files corresponding to each version number in the target version number sequence obtained by searching;

[0153] A result storage unit 330, configured to generate a difference result file according to the difference content between the current result file generated by the task workflow and the reference result file, and store the difference result file in the result file set corresponding to the current version number and the reference version number.

[0154] See Figure 5 , Figure 5 which is a structural block diagram of another iterative test platform disclosed in the embodiments of the present application.

[0155] In practical applications, the iterative test platform can also be divided into Figure 5The structure shown, the platform may include a task launcher 10, a task execution module 20, and a result processor 30.

[0156] Among them, the task launcher 10 may include a configuration file acquisition unit 110, a configuration file search unit 120, a configuration file generation unit 130, and a task flow establishment unit 140; the task execution module 20 may include a log search unit 210, a log generation unit 220, a log storage unit 230, or a log search unit 240, a node log determination unit 250, a node log generation unit 260, a log generation unit 270, a log storage unit 280; the result processor 30 may include a result search unit 310, a result generation unit 320, and a result storage unit 330.

[0157] The iterative test platform provided by the embodiments of the present application can be applied to iterative test devices. Figure 6 The hardware structure block diagram of the iterative test device is shown. Refer to Figure 6 , the hardware structure of the iterative test device may include: at least one processor 1, at least one communication interface 2, at least one memory 3, and at least one communication bus 4;

[0158] In the embodiments of the present application, the number of the processor 1, the communication interface 2, the memory 3, and the communication bus 4 is at least one, and the processor 1, the communication interface 2, and the memory 3 complete mutual communication through the communication bus 4;

[0159] The processor 1 may be a central processing unit CPU, or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present invention, etc.;

[0160] The memory 3 may include a high-speed RAM memory, and may also include a non-volatile memory, etc., such as at least one disk memory;

[0161] Among them, the memory stores a program, and the processor can call the program stored in the memory. The program is used for:

[0162] Obtain the differential configuration file corresponding to the current version number input by the user, and the reference version number corresponding to the reference configuration file of the differential configuration file. The differential configuration file contains the content updated by the user to the reference configuration file;

[0163] In the set of stored configuration files, find the configuration files corresponding to each version number in the target version number sequence. The target version number sequence starts with the reference version number and the base version number and ends with them. In the order from the reference version number to the base version number, the configuration file corresponding to the latter version number is the reference configuration file of the configuration file corresponding to the previous version number. The base version number is the version number corresponding to the base configuration file;

[0164] Generate a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence;

[0165] Establish a task workflow according to the target configuration file.

[0166] Optionally, the refinement function and expansion function of the program can be referred to the above description.

[0167] The embodiment of the present application also provides a readable storage medium, which can store a program suitable for execution by a processor. The program is used for:

[0168] Obtain the differential configuration file corresponding to the current version number input by the user, and the reference version number corresponding to the reference configuration file of the differential configuration file. The differential configuration file contains the content updated by the user to the reference configuration file;

[0169] In the set of stored configuration files, find the configuration files corresponding to each version number in the target version number sequence. The target version number sequence starts with the reference version number and the base version number and ends with them. In the order from the reference version number to the base version number, the configuration file corresponding to the latter version number is the reference configuration file of the configuration file corresponding to the previous version number. The base version number is the version number corresponding to the base configuration file;

[0170] Generate a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence;

[0171] Establish a task workflow according to the target configuration file.

[0172] Optionally, the refinement function and expansion function of the program can be referred to the above description.

[0173] Finally, it should also be noted that in this text, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprising", "including" or any other variant thereof are intended to cover non-exclusive inclusion, such that a process, method, article or device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or device comprising said element.

[0174] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. For the same or similar parts among the various embodiments, reference may be made to each other.

[0175] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An iterative testing method, characterized in that, Including: Obtain the differential configuration file corresponding to the current version number input by the user, and the reference version number corresponding to the reference configuration file of the differential configuration file, where the differential configuration file contains the content updated by the user to the reference configuration file; In the stored configuration file set, search for the configuration files corresponding to each version number in the target version number sequence. The target version number sequence takes the reference version number and the base version number as the head and tail. In the order from the reference version number to the base version number, the configuration file corresponding to the latter version number is the reference configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file; Generate a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence; Establish a task workflow according to the target configuration file; The generating a target configuration file based on the differential configuration file and the configuration files corresponding to each version number in the found target version number sequence includes: Determine the construction order of the configuration files corresponding to each version number in the target version number sequence. The construction order starts from the base configuration file corresponding to the base version number and ends with the reference configuration file corresponding to the reference version number. Among them, for any two adjacent configuration files in the construction order, the previous configuration file is the reference configuration file of the latter configuration file; Construct the configuration files corresponding to each version number in the target version number sequence according to the construction order to generate a reference configuration file; Generate a target configuration file based on the reference configuration file and the differential configuration file.

2. The method according to claim 1, wherein Also including: Correspondingly store the differential configuration file, the current version number, and the reference version number in the configuration file set.

3. The method according to claim 2, characterized in that Also including: In the stored log file set, search for the log files corresponding to each version number in the target version number sequence; Generate a reference log file based on the log files corresponding to each version number in the found target version number sequence; Generate a differential log file according to the differential content between the current log file generated according to the task workflow and the reference log file, and correspondingly store the differential log file, the current version number, and the reference version number in the log file set.

4. The method according to claim 2, wherein Also including: In the stored log file set, search for the log files corresponding to each version number in the target version number sequence; Determine the node log files corresponding to each operation node of the task workflow in the log files corresponding to each version number in the target version number sequence; Generate a reference node log file for each operation node based on the node log files corresponding to each operation node of the task workflow; Generate a node differential log file for each operation node according to the differential content between the current node log file generated for each operation node in the task workflow and the reference node log file for each operation node; Form the node differential log files into a differential log file, and correspondingly store the differential log file, the current version number, and the reference version number in the log file set.

5. The method according to any one of claims 1-4, characterized in that, Also including: In the set of stored result files, search for the result files corresponding to each version number in the target version number sequence; Based on the result files corresponding to each version number in the target version number sequence obtained by the search, generate a reference result file; Generate a difference result file according to the difference content between the current result file generated according to the task workflow and the reference result file, and store the difference result file, the current version number, and the baseline version number correspondingly in the result file set.

6. An iterative test platform, characterized in that, Includes: A configuration file acquisition unit, configured to acquire the difference configuration file corresponding to the current version number input by the user, and the baseline version number corresponding to the baseline configuration file of the difference configuration file, where the difference configuration file contains the content updated by the user to the baseline configuration file; A configuration file search unit, configured to search for the configuration files corresponding to each version number in the target version number sequence in the set of stored configuration files, where the target version number sequence takes the baseline version number and the base version number as the head and the tail, and in the order from the baseline version number to the base version number, the configuration file corresponding to the latter version number is the baseline configuration file of the configuration file corresponding to the previous version number, and the base version number is the version number corresponding to the base configuration file; A configuration file generation unit, configured to generate a target configuration file based on the difference configuration file and the configuration files corresponding to each version number in the target version number sequence obtained by the search; A task flow establishment unit, configured to establish a task workflow according to the target configuration file; The generating a target configuration file based on the difference configuration file and the configuration files corresponding to each version number in the target version number sequence obtained by the search includes: Determine the construction order of the configuration files corresponding to each version number in the target version number sequence, where the construction order starts from the base configuration file corresponding to the base version number and ends with the baseline configuration file corresponding to the baseline version number, and for any two adjacent configuration files in the construction order, the previous configuration file is the baseline configuration file of the latter configuration file; Construct the configuration files corresponding to each version number in the target version number sequence according to the construction order to generate a reference configuration file; Generate a target configuration file based on the reference configuration file and the difference configuration file.

7. The platform according to claim 6, characterized in that, Also includes: A configuration storage unit, configured to store the difference configuration file, the current version number, and the baseline version number correspondingly in the configuration file set.

8. The platform according to claim 7, wherein Also includes: A log search unit, configured to search for the log files corresponding to each version number in the target version number sequence in the set of stored log files; A log generation unit, configured to generate a reference log file based on the log files corresponding to each version number in the target version number sequence obtained by the search; A log storage unit, configured to generate a difference log file according to the difference content between the current log file generated according to the task workflow and the reference log file, and store the difference log file, the current version number, and the baseline version number correspondingly in the log file set.

9. The platform according to any one of claims 6 - 8, characterized in that, Also includes: A result search unit for searching for result files corresponding to each version number in the target version number sequence in a stored set of result files; A result generation unit for generating a reference result file based on the result files corresponding to each version number in the found target version number sequence; A result storage unit for generating a differential result file according to the differential content between the current result file generated by the task workflow and the reference result file, and storing the differential result file, the current version number, and the reference version number correspondingly in the result file set.

10. An iterative test device, characterized in that, It includes a memory and a processor; The memory is used for storing programs; The processor is used for executing the program to implement each step of the iterative test method described in any one of claims 1-5.

11. A readable storage medium, on which a computer program is stored, characterized in that, When the computer program is executed by the processor, each step of the iterative test method described in any one of claims 1-5 is implemented.

Images