Test method and test system

Abstract

The embodiment of the invention relates to the field of communication, and provides a test method and a test system.The test method comprises the steps that a test case is edited, and an executable script is generated according to the test case; the executable scripts are sent to a plurality of target machines, the target machines execute the executable scripts after receiving an execution command, an execution table is arranged in each target machine, the execution table comprises a plurality of cells arranged in the column direction, the cells are filled with the executable scripts, and one cell corresponds to one executable script at most; and the target machine sequentially executes the executable scripts along the arrangement sequence of the cells. The universality of the test method can be improved.

Description

Technical Field

[0001] The present disclosure relates to the field of communications, and in particular to a testing method and a testing system. Background Art

[0002] In normal software testing, testers need to first design reasonable test cases, implement software testing based on the test cases and obtain test results according to the predetermined test plan process, and finally compare them with the expected results to form a software testing conclusion.

[0003] Currently, most commonly used test methods are executed sequentially on a single machine, which results in low test efficiency. Summary of the invention

[0004] The embodiments of the present disclosure provide a testing method and a testing system, which can at least improve the versatility of the testing method.

[0005] According to some embodiments of the present disclosure, on the one hand, an embodiment of the present disclosure provides a testing method, comprising: editing a test case, and generating an executable script according to the test case; sending the executable script to multiple target machines, and the target machines execute the executable script after receiving an execution command, wherein each of the target machines is provided with an execution table, and the execution table includes a plurality of cells arranged in columns, and the executable script is filled in the cells, one cell corresponds to at most one executable script, and the target machines execute the executable scripts in sequence along the arrangement order of the cells.

[0006] In some embodiments, the method for executing the executable script by multiple target machines includes: an asynchronous concurrent combined execution method in which each target machine does not affect the execution process of each other, and each target machine executes the executable script in sequence according to the arrangement order of the cells.

[0007] In some embodiments, the method for executing the executable script by multiple target machines includes: an asynchronous concurrent combined execution method, wherein the asynchronous concurrent combined execution method is that each target machine does not affect the execution process of each other, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine starts executing the next executable script before the previous executable script is completed.

[0008] In some embodiments, the method for executing the executable script by multiple target machines includes: a synchronous execution combination execution mode, wherein the execution between each target machine affects each other, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine synchronously executes the first executable script, and each target machine executes the next executable script after all the target machines have executed the previous executable script.

[0009] In some embodiments, any cell of the execution table is empty.

[0010] In some embodiments, before the target machine executes the executable script, the method further includes: adjusting the arrangement order of the executable scripts in the execution table.

[0011] In some embodiments, before sending the executable scripts to multiple target machines, the method further includes: classifying the executable scripts, and placing the executable scripts of the same type in the cells of the same execution order of different target machines.

[0012] In some embodiments, the executable script is divided into a host computer test case and a slave computer test case, and the execution table includes a first area and a second area arranged vertically, and one of the host computer test case or the slave computer test case is completely filled in the first area of ​​the execution table, and the other of the host computer test case or the slave computer test case is completely filled in the second area of ​​the execution table.

[0013] In some embodiments, before executing the next executable script, the target machine further includes: detecting the execution status of the previous executable script, and feeding back the execution status of the executable script into the cell.

[0014] According to some embodiments of the present disclosure, another aspect of the present disclosure further provides a testing system, including: a processor, wherein the processor can be used to execute the above-mentioned testing method.

[0015] The technical solution provided by the embodiment of the present disclosure has at least the following advantages: first, the test case is edited, the test case is created according to the action to be executed, and an executable script is generated according to the test case, and then the generated executable script is sent to multiple target machines. After receiving the execution command, the target machine executes the executable script accordingly, and each target machine can be provided with an execution table, the execution table includes a plurality of cells arranged in columns, and a cell corresponds to at most one executable script. For the target machine, the executable script filled in the target machine can be controlled, so that the execution mode can be freely edited, and the executable scripts in the target machine can be freely combined, thereby improving the versatility of the test method; secondly, by setting the execution table in the target machine, it is very convenient to view the operating relationship between multiple target machines horizontally, and it is also possible to view the execution order of a single target machine vertically, and at the same time clearly understand how many target machines currently need to execute the test case. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] One or more embodiments are exemplarily illustrated by pictures in the corresponding drawings, and these exemplified descriptions do not constitute a limitation on the embodiments. Unless otherwise specified, the pictures in the drawings do not constitute a scale limitation. In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the traditional technology, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 A flow chart of a testing method provided by an embodiment of the present disclosure;

[0018] Figure 2 A schematic diagram of a module of a target machine provided by an embodiment of the present disclosure;

[0019] Figure 3 Another flow chart of a testing method provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0020] As can be seen from the background technology, the commonly used execution methods are mostly executed sequentially by a single machine and batch executed by multiple machines. Although they can meet the current needs of users, if the test cases between the machines need to be executed synchronously and in a more complex operating mode, they cannot be displayed through an intuitive arrangement method, and the program needs to be modified; in addition, the arrangement interface is commonly used in a tree view or a graphical view. Although the execution method can be edited in this way, it is impossible to cover complex scenarios in the case of multiple target machines, and it is impossible to change and combine according to the actual situation, and it is impossible to intuitively see the relationship between all target machines. In summary, the commonly used test case execution methods at present have singleness and fixedness when specifically editing, and cannot fully meet the arrangement requirements under complex environments.

[0021] The disclosed embodiment provides a testing method, which first edits a test case, creates a test case according to the action to be executed, and generates an executable script according to the test case, and then sends the generated executable script to multiple target machines. After receiving the execution command, the target machine executes the executable script accordingly, and each target machine can be provided with an execution table, the execution table includes a plurality of cells arranged in columns, and a cell corresponds to at most one executable script. For the target machine, the executable script filled in the target machine can be controlled, so that the execution mode can be freely edited, and the executable scripts in the target machine can be freely combined, thereby improving the versatility of the testing method; secondly, by setting the execution table in the target machine, it is very convenient to view the operating relationship between multiple target machines horizontally, and it is also possible to view the execution order of a single target machine vertically, and at the same time clearly understand how many target machines currently need to execute the test case.

[0022] Terms such as first or second can be used to describe various components, but these components are not limited by the above terms. The above terms are used to distinguish one component from another component, for example, without departing from the scope of the concept according to the present disclosure, a first component can be referred to as a second component, and similarly, a second component can be referred to as a first component.

[0023] According to the concept, various modifications and changes can be applied to the examples of the embodiments, so that the examples of the embodiments will be illustrated in the drawings and described in the specification. However, the examples of the embodiments according to the concept are not limited to the specific embodiments, but include all changes, equivalents or replacements included in the spirit and technical scope of the present disclosure.

[0024] The terms used in this specification are only used to describe specific examples of the embodiments and are not intended to limit the present disclosure. If there is no clear opposite meaning in the context, the singular form may include the plural form. In this specification, it should be understood that the term "including" or "having" indicates the presence of the features, quantities, steps, operations, components, parts or combinations thereof described in the specification, but the possibility of the presence or addition of one or more other features, quantities, steps, operations, components, parts or combinations thereof cannot be precluded.

[0025] If there is no contrary definition, all terms (including technical terms or scientific terms) used herein have the same meaning as those generally understood by ordinary technicians in the field. If the terms defined in the commonly used dictionary are not clearly defined in this specification, they should be interpreted as having the same meaning as in the context of the relevant technology, and not interpreted as ideal or overly formal meanings.

[0026] Descriptions of well-known components and processing techniques may be omitted so as not to unnecessarily obscure the embodiments of the disclosure.

[0027] Throughout the specification, the same reference numerals refer to the same elements. Thus, even if a reference numeral is not mentioned or described with reference to one figure, it may be mentioned or described with reference to another figure. Furthermore, even if a reference numeral is not shown in one figure, it may be mentioned or described with reference to another figure.

[0028] The following will describe the various embodiments of the present disclosure in detail with reference to the accompanying drawings. However, it will be appreciated by those skilled in the art that in the various embodiments of the present disclosure, many technical details are provided in order to enable the reader to better understand the present disclosure. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solutions claimed in the present disclosure can be implemented.

[0029] refer to Figures 1 to 3 , Figure 1 A flow chart of a testing method provided by an embodiment of the present disclosure, Figure 2 A schematic diagram of a module of a target machine provided by an embodiment of the present disclosure; Figure 3 Another flow chart of a testing method provided in an embodiment of the present disclosure.

[0030] refer to Figure 1 In some embodiments, the testing method may include: S11. Editing a test case and generating an executable script according to the test case.

[0031] The testing method may include: S12. Sending the executable script to multiple target machines, the target machines execute the executable scripts after receiving the execution command, wherein each target machine is provided with an execution table, the execution table includes multiple cells arranged in columns, the executable scripts are filled in the cells, one cell corresponds to at most one executable script, and the target machines execute the executable scripts in sequence along the arrangement order of the cells.

[0032] The disclosed embodiment provides a testing method, which first edits a test case, creates a test case according to the action to be executed, and generates an executable script according to the test case, and then sends the generated executable script to multiple target machines. After receiving the execution command, the target machine executes the executable script accordingly, and each target machine can be provided with an execution table, the execution table includes a plurality of cells arranged in columns, and a cell corresponds to at most one executable script. For the target machine, the executable script filled in the target machine can be controlled, so that the execution mode can be freely edited, and the executable scripts in the target machine can be freely combined, thereby improving the versatility of the testing method; secondly, by setting the execution table in the target machine, it is very convenient to view the operating relationship between multiple target machines horizontally, and it is also possible to view the execution order of a single target machine vertically, and at the same time clearly understand how many target machines currently need to execute the test case.

[0033] Combined with reference Figure 1 and Figure 3 In some embodiments, before editing the test case, the following steps may be included: adding a target machine and setting the IP address of the target machine.

[0034] In some embodiments, editing a test case may include: first, creating an action script. The action script is a tree-shaped editor. Various actions can be created through the right-click menu in the action script editor, such as assignment, expected expression, sending signal, and receiving signal.

[0035] In some embodiments, editing a test case may involve external input of data.

[0036] After editing the test case, the code will be generated and the executable script will be compiled according to the actions created in the action script compiler. After the executable script is completed, it will be sent to each target machine.

[0037] In some embodiments, after the editing of the test case is completed, the combined execution mode can be set first, that is, the correspondence between the executable script and the target machine is pre-set, the executable script required to be executed by each target machine is first confirmed, and then the executable script is filled in the execution table corresponding to each target machine according to the set combined execution mode.

[0038] When the target machine receives the execution command, it will execute the executable scripts in sequence according to the order of the cells arranged in the columns in the execution table set in the target machine.

[0039] In some embodiments, the target machine may refer to a computer that executes an executable script.

[0040] Combined with reference Figure 2 and Figure 3 In some embodiments, the method for executing executable scripts by multiple target machines includes: an asynchronous sequential combination execution mode, in which each target machine does not affect the execution process of each other, and each target machine executes the executable script in sequence according to the arrangement order of the cells. In other words, each target machine receives its own execution command and executes the executable script arranged in the target machine. By setting each target machine so that the execution process does not affect each other, and each target machine executes the executable script in sequence according to the arrangement order of the cells, the execution order of each target machine can be flexibly adjusted according to demand, the execution order of the executable script can be controlled, and different target machines can be selected according to the test environment, thereby improving the versatility of the test method provided by the embodiment of the present disclosure.

[0041] For example, taking the number of target machines as three, namely the first target machine, the second target machine and the third target machine, each target machine does not affect the execution process of each other, and each target machine executes the executable script in sequence according to the arrangement order of the cells. It can be: after the second target machine receives the execution command, it runs the executable script in the second target machine. After a certain period of time, the first target machine receives the execution command and runs the executable script in the first target machine. After a certain period of time, the third target machine receives the execution command and runs the executable script in the third target machine. The first target machine, the second target machine and the third target machine will not interfere with other target machines in the process of running the executable scripts in their own target machines, nor will they be interfered by the executable scripts in other target machines. Each target machine is a relatively independent individual.

[0042] In some embodiments, the method for executing executable scripts by multiple target machines may also include: an asynchronous concurrent combined execution method, wherein the asynchronous concurrent combined execution method is that each target machine does not affect the execution process, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine starts to execute the next executable script before the previous executable script is completed. In other words, each target machine receives the execution command at the same time and executes the executable script, but during the execution process, it will not be affected by the executable scripts of other target machines. By not affecting the execution process between each target machine, each target machine executes the executable script in sequence according to the arrangement order of the cells, and the same target machine does not need to wait for the execution of the executable script in the previous cell to be completed before executing the next executable script, and all target machines can be started at the same time, thereby improving the efficiency of the test method, and for each target machine, the executable script in each target machine is allocated to the corresponding target machine according to the demand during the allocation process, thereby improving the versatility of the test method while improving the efficiency of the test method.

[0043] For example, taking the number of target machines as three, which are respectively the first target machine, the second target machine and the third target machine, each target machine does not affect the execution process of each other, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine starts to execute the next executable script before the previous executable script is completed. It can mean that there are the first executable script, the second executable script and the third executable script in the first target machine, and the first target machine is installed to execute the first executable script, the second executable script and the third executable script in sequence, but during the execution process, the second executable script can be started when the first executable script is not completed, and the third executable script can be started when the second executable script is not completed, thereby speeding up the execution speed of the executable scripts in the target machine and improving the efficiency of the testing method.

[0044] In some embodiments, when the asynchronous sequential combined execution method is adopted, the executable scripts in each cell usually do not affect each other. In this way, the asynchronous sequential combined execution method can greatly improve the execution efficiency of the target machine and reduce the test time.

[0045] In some embodiments, a method for executing executable scripts on multiple target machines includes: a synchronous execution combined execution mode, wherein the synchronous execution combined execution mode is that the execution between each target machine affects each other, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine synchronously executes the first executable script, and each target machine executes the next executable script after all target machines have executed the previous executable script. In other words, the execution process of all target machines is synchronous, and the next executable script will only be executed after all target machines have executed the current executable script. By setting the execution between each target machine to affect each other, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine synchronously executes the first executable script, and each target machine executes the next executable script after all target machines have executed the previous executable script, it is convenient to monitor the execution status of all target machines.

[0046] In some embodiments, the method of selecting multiple target machines to execute executable scripts can be selected according to the test environment. For example, if all test environments can be met, each target machine can be selected so that it does not affect the execution process of each other, and each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine synchronously executes the first executable script. This method can maximize the test efficiency of the entire test method.

[0047] In some embodiments, any cell in the execution table is empty. In other words, no executable script may be set in any cell of any target machine, and no executable script may be executed when the target machine executes an empty cell. This can further improve the versatility of the test method. When the target machine does not use the current test environment, the cell in the target machine can be set to empty, thereby avoiding execution errors of the target machine. Moreover, when the test environment changes, the executable script that can be run can be executed immediately, thereby improving the test efficiency of the test method.

[0048] For example, the execution table in the target machine includes 5 cells, namely the first cell, the second cell, the third cell, the fourth cell and the fifth cell, wherein the first cell and the third cell are empty, then, for the target machine, when the executable script corresponding to the first cell is executed, the executable script corresponding to the test case is not executed, and similarly, when the executable script corresponding to the third cell is executed, the executable script corresponding to the test case is not executed.

[0049] Furthermore, the number of target machines is 3, which serve as the first target machine, the second target machine and the third target machine respectively. The execution table in each target machine includes 5 cells, namely the first cell, the second cell, the third cell, the fourth cell and the fifth cell. Among them, the third cell of the first target machine is empty, and the other target machines have no empty cells. For the method of executing executable scripts by multiple target machines, each target machine does not affect the execution process of each other. Regardless of whether there are empty cells in each target machine, it will not affect the test process; for the method of executing executable scripts by multiple target machines, the execution of each target machine affects each other. When the first target machine, the second target machine and the third target machine all execute to their corresponding third cells, since the third cell of the first target machine is empty, the first target machine needs to wait until the second target machine and the third target machine have completed executing their respective executable scripts before executing the executable script in the fourth cell.

[0050] In some embodiments, before the target machine executes the executable script, the method further includes: adjusting the arrangement order of the executable scripts in the execution table. That is, the executable scripts can be adjusted before execution, thereby changing the execution order of the executable scripts, thereby further improving the versatility of the test method, and executable scripts in the same test environment can be adjusted to be adjacent, so that the executable scripts in the test environment can be executed at one time, and the complexity of the test method execution can be reduced.

[0051] Taking the execution table in the target machine as an example, which includes 5 cells, namely the first cell, the second cell, the third cell, the fourth cell and the fifth cell, when the arrangement order of the executable scripts in the execution table needs to be adjusted, the executable scripts in each cell can be freely swapped, for example, the executable script in the first cell is swapped with the executable script in the third cell, or the executable script in the third cell is adjusted to the first cell, and the execution order before the third cell (that is, the executable scripts in the first cell and the second cell) is postponed by one cell.

[0052] In some embodiments, before sending the executable scripts to the multiple target machines, the method further includes: classifying the executable scripts and placing the executable scripts of the same type in cells of the same execution order of the different target machines. By classifying the executable scripts and placing the executable scripts of the same type in cells of the same execution order of the different target machines, the smoothness of the execution of the executable scripts by the multiple target machines can be improved, and the executable scripts of the multiple target machines can be executed at one time under the same test environment.

[0053] In some embodiments, before sending the executable scripts to the multiple target machines, the method further includes: classifying the executable scripts and placing the executable scripts of the same type in adjacent cells of the same target machine. In this way, for a target machine, executing the executable scripts of the same type can be executed faster for the target machine without frequently switching the test conditions.

[0054] In some embodiments, the executable script is divided into a host computer test case and a slave computer test case, and the execution table includes a first area and a second area arranged up and down, and one of the host computer test case or the slave computer test case is completely filled in the first area of ​​the execution table, and the other of the host computer test case or the slave computer test case is completely filled in the second area of ​​the execution table. For example, the execution table is divided into the first area and the second area, and during the execution of the target machine, the host computer test case is completely executed in the first half, and the slave computer test case is completely executed in the second half, so that for a target machine, there is no need to frequently switch the test environment, so that the target machine can execute the executable script, and such a setting can also distinguish the operating environment of the host machine and the slave machine, which is not easy to make mistakes.

[0055] In some embodiments, the executable scripts can also be classified according to the executable scripts that can be currently executed by the target machine. For example, three target machines are provided, namely a first target machine, a second target machine and a third target machine, wherein the executable scripts that can be executed by the three target machines are different from each other. Then, when classifying the executable scripts, they can be divided into: executable scripts that can be executed by the first target machine, executable scripts that can be executed by the second target machine and executable scripts that can be executed by the third target machine, and these three types of executable scripts are sent to the corresponding target machines respectively, so as to avoid the target machine being unable to execute the executable script.

[0056] In some embodiments, before executing the next executable script, the target machine also includes: detecting the execution status of the previous executable script, and feeding back the execution status of the executable script in the cell. That is to say, the execution status of each executable script can be clearly seen through the execution table. For example, when the cell color is green, it means: the executable script has been executed and there is no abnormality; when the cell color is yellow, it means: the current executable script is being executed; when the cell color is red, it means: the executable script corresponding to the cell is abnormal. By setting the target machine to also include: detecting the execution status of the previous executable script before executing the next executable script, and feeding back the execution status of the executable script in the cell, it is easy to monitor abnormal conditions during the entire test process, so that it can be easy to repair and adjust.

[0057] It should be noted that the above feedback by color is merely an example for ease of understanding, and feedback may also be provided in other ways, and the present disclosure does not limit the specific feedback method.

[0058] The testing method provided in the embodiments of the present disclosure is applicable to simulation testing experiments for simulating the execution of test cases in various complex environments during the execution of test tasks in the fields of rail transit, medical equipment, smart grid, and aerospace.

[0059] The disclosed embodiment provides a testing method, which first edits a test case, creates a test case according to the action to be executed, and generates an executable script according to the test case, and then sends the generated executable script to multiple target machines. After receiving the execution command, the target machine executes the executable script accordingly, and each target machine can be provided with an execution table, the execution table includes a plurality of cells arranged in columns, and a cell corresponds to at most one executable script. For the target machine, the executable script filled in the target machine can be controlled, so that the execution mode can be freely edited, and the executable scripts in the target machine can be freely combined, thereby improving the versatility of the testing method; secondly, by setting the execution table in the target machine, it is very convenient to view the operating relationship between multiple target machines horizontally, and it is also possible to view the execution order of a single target machine vertically, and at the same time clearly understand how many target machines currently need to execute the test case.

[0060] Another embodiment of the present disclosure further provides a testing system, including: a processor, which can be used to execute the testing methods in some or all of the above embodiments. It should be noted that the same or corresponding parts of the above embodiments can refer to the corresponding description of the above embodiments, and will not be repeated below.

[0061] Those skilled in the art can understand that the above-mentioned embodiments are specific examples for implementing the present disclosure, and in practical applications, various changes can be made to them in form and detail without departing from the spirit and scope of the embodiments of the present disclosure. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the embodiments of the present disclosure, so the protection scope of the embodiments of the present disclosure shall be based on the scope defined in the claims.

Claims

1. A testing method, characterized in that: include: Edit test cases and generate executable scripts based on the test cases; The executable script is sent to multiple target machines, and the target machines execute the executable script after receiving the execution command, wherein each of the target machines is provided with an execution table, and the execution table includes a plurality of cells arranged in columns, the executable script is filled in the cells, one cell corresponds to at most one executable script, and the target machines execute the executable scripts in sequence along the arrangement order of the cells.

2. The testing method according to claim 1, characterized in that: The method for executing the executable script by multiple target machines includes: an asynchronous sequential combination execution mode, wherein each target machine does not affect the execution process of each other, and each target machine executes the executable script in sequence according to the arrangement order of the cells.

3. The testing method according to claim 1, characterized in that: The method for executing the executable script by multiple target machines includes: an asynchronous concurrent combined execution method, wherein the asynchronous concurrent combined execution method is that each target machine does not affect the execution process of each other, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine starts to execute the next executable script before the previous executable script is completed.

4. The testing method according to claim 1, characterized in that: The method for executing the executable script by multiple target machines includes: a synchronous execution combined execution mode, wherein the executions of each target machine affect each other, each target machine executes the executable script in sequence according to the arrangement order of the cells, and each target machine synchronously executes the first executable script, and each target machine executes the next executable script after all the target machines have executed the previous executable script.

5. The testing method according to any one of claims 2 to 4, characterized in that: Any cell in the execution table is empty.

6. The testing method according to any one of claims 2 to 4, characterized in that: Before the target machine executes the executable script, the method further includes: adjusting the arrangement order of the executable scripts in the execution table.

7. The testing method according to claim 1, characterized in that: Before sending the executable script to multiple target machines, the method further includes: The executable scripts are classified, and the executable scripts of the same type are arranged in the cells of the same execution order of different target machines.

8. The testing method according to claim 7, characterized in that: The executable script is divided into a host computer test case and a slave computer test case. The execution table includes a first area and a second area arranged vertically. One of the host computer test case or the slave computer test case is completely filled in the first area of ​​the execution table, and the other of the host computer test case or the slave computer test case is completely filled in the second area of ​​the execution table.

9. The testing method according to claim 1, characterized in that: Before executing the next executable script, the target machine further includes: detecting the execution status of the previous executable script, and feeding back the execution status of the executable script in the cell.

10. A testing system, characterized in that: include: A processor, wherein the processor is used to execute the test method according to any one of claims 1 to 9.

Images