Test case execution method, test platform, test system and computer-readable storage medium

Abstract

The present application discloses a test case execution method, a test platform, a test system, and a computer-readable storage medium. The execution method includes the following steps: establishing an association relationship between corresponding variables between the test steps of a test case for the reliability test of the object to be tested, and setting an association identifier for the variable; executing the test case to complete the reliability test of the object to be tested of the rail transit, and during the execution process, setting an association identifier for the test result of a test case according to the association relationship, and using the test result with the association identifier in the test steps of other test cases or other test steps of the same test case. Since the test results can be directly used for other test cases or other test steps of the same test case, there is no need to execute the corresponding test case to obtain the test results, which can improve the test efficiency of the reliability of the object to be tested of the rail transit and save computing resources.

Description

Technical Field

[0001] The present application relates to the technical field of testing an object to be tested for rail transit, and in particular to a test case execution method, a test platform, a test system, and a computer-readable storage medium for an object to be tested for rail transit. Background Art

[0002] With the rapid development of the rail transit industry, the types and complexity of UUTs used in rail transit are constantly increasing, and the reliability testing requirements for various UUTs are also increasing. For these reasons, the number of instruments and test cases required during UUT testing is also increasing.

[0003] Therefore, it is necessary to develop a testing method and a testing system to improve the testing efficiency and save computing resources while completing the reliability test of the object to be tested. Summary of the Invention

[0004] The purpose of this application is to provide a test case execution method, a test platform, a test system, and a computer-readable storage medium, all of which can improve test efficiency and save computing resources.

[0005] The present application provides a test case execution method. The execution method is used to perform black box testing on the reliability of a test object of rail transit, and includes the following steps: establishing an association relationship between corresponding variables between test steps of a test case for the reliability test of the test object, and setting an association identifier for the variable; executing the test case to complete the reliability test of the test object of rail transit, and during the execution process, setting the association identifier for the test result of a test case according to the association relationship, and using the test result with the association identifier in the test step of the other test case or other test steps of the same test case. The above execution method has at least the following advantages: due to the setting of the association relationship and the association identifier, during the execution of the test case of the test object of rail transit, the test result of a test case is set to the association identifier, and the test result can be directly used for other test cases or other test steps of the same test case according to the association relationship and the association identifier. In this way, there is no need to execute the corresponding test case to obtain the test result, thereby improving the test efficiency of the reliability of the test object of rail transit, and because there is no need to execute the test case to obtain the test result, computing resources can be saved.

[0006] Optionally, the execution method includes: determining whether the test result meets the performance index, and returning the test result if the test result meets the corresponding performance index of the object to be tested; otherwise, returning the correct value corresponding to the test result according to the performance index. The above embodiment has at least the following advantages: by returning the test result only when the test result meets the performance index, or returning the correct value when the performance index is not met, it is ensured that other test cases or other test steps of the same test case can always obtain correct test results, the reliability test of the object to be tested is not affected by erroneous results, and the accuracy of the reliability test is ensured while improving test efficiency and saving computing resources.

[0007] Optionally, the execution method includes: determining whether the test result meets the performance index, and if the test result meets the corresponding performance index of the object to be tested, returning the test result; otherwise, receiving an adjustment instruction, and adjusting the execution order between the test cases or the execution order of other test steps of the same test case according to the adjustment instruction. The above embodiment has at least the following advantages: by adjusting the execution order of test cases (between test cases or between other test steps of the same test case), it is possible to avoid executing the test case that requires the test result or other test steps of the same test case, thereby ensuring that the test process of the object to be tested of rail transit is completed.

[0008] Optionally, the adjustment instruction is a change instruction, which is used to change the execution order between the test cases or the execution order of other test steps of the same test case; and / or, the adjustment instruction is a deletion instruction, which is used to delete the test case or other test steps of the same test case.

[0009] Optionally, the execution method further includes: obtaining a calculation call count for the test result based on the association relationship, and determining unexecuted test cases or unexecuted test steps of the same test case based on the calculation call count, the actual number of test result delivery times, and the execution order of the test cases. The above embodiment has at least the following advantages: while improving testing efficiency and conserving computing resources, it can easily identify unexecuted test cases or test steps of test cases, thereby reducing the burden on testers.

[0010] On the other hand, an embodiment of the present application discloses a test platform. The test platform is used to cooperate with instruments and meters to perform reliability testing on the object to be tested of rail transit, and includes an input module, an association module and an execution module. The input module is used to input test instructions; the association module is used to establish an association relationship between corresponding variables between the test steps of the test case of the reliability test of the object to be tested, and set an association identifier for the variable; the execution module is used to execute the test case to complete the reliability test of the object to be tested of the rail transit. During the execution process, the association identifier is set for the test result of a test case according to the association relationship, and the test result with the association identifier is used in the test steps of the other test cases or other test steps of the same test case. With such a configuration, the test platform has at least the following advantages: since the association module is used to set the association relationship and the association identifier, the execution module sets the test result of a test case with the association identifier during the execution of the test case of the rail transit object to be tested, and can directly use the test result for other test cases or other test steps of the same test case according to the association relationship and the association identifier. In this way, there is no need to execute the corresponding test case to obtain the test result, thereby improving the test efficiency of the reliability of the rail transit object to be tested. Moreover, since there is no need to execute the test case to obtain the test result, computing resources can be saved.

[0011] Optionally, the test platform includes a judgment module, the judgment module is used to judge whether the test result meets the performance index; the judgment module transmits the test result to the execution module when the test result meets the corresponding performance index of the object to be tested; the judgment module sends an instruction request to the input module when the test result does not meet the performance index, and the instruction request is used to request the tester to return the correct value corresponding to the test result according to the performance index. The test platform has at least the following advantages: by returning the test result only when the test result meets the performance index, or returning the correct value when the performance index is not met, it is ensured that other test cases or other test steps of the same test case can always obtain correct test results, the reliability test of the object to be tested is not affected by erroneous results, and the accuracy of the reliability test is ensured while improving test efficiency and saving computing resources.

[0012] Optionally, the test platform includes a judgment module and an adjustment module, wherein the judgment module is used to judge whether the test result meets the performance index; if the test result meets the corresponding performance index of the object to be tested, the judgment module transmits the test result to the execution module; if the test result does not meet the performance index, the judgment module sends an adjustment instruction to the adjustment module, and the adjustment module is used to adjust the execution order of the test case according to the adjustment instruction. The test platform has at least the following advantages: by adjusting the execution order of the test case, it is possible to avoid executing the test case that requires the test result or other test steps of the same test case, thereby ensuring that the test process of the rail transit object to be tested is completed.

[0013] Optionally, the execution module further obtains the actual number of times the test result is delivered; the test platform includes a determination module that obtains the calculated call count of the test result based on the association relationship, and further determines unexecuted test cases or unexecuted test steps of the same test case based on the calculated call count, the actual number of times the test result is delivered, and the execution order of the test cases. The test platform has at least the following advantages: while improving testing efficiency and saving computing resources, it can easily discover unexecuted test cases or test steps of test cases, thereby reducing the burden on testers.

[0014] On the other hand, an embodiment of the present application discloses a test system. The test system is used to test the reliability of an object to be tested for rail transit, and includes a computer and instruments. The computer is connected to the object to be tested through the instruments; the computer includes a memory and a processor; the memory stores a computer program that can be run on the processor; the processor executes the computer program to implement any of the aforementioned execution methods to perform a black box test on the reliability of the object to be tested, and also generates a test report for judging the reliability of the object to be tested based on the test results and corresponding performance indicators. The advantages of the test system can be found in the advantages of the test platform, which will not be repeated here.

[0015] In another aspect, embodiments of the present application disclose a computer-readable storage medium. The computer-readable storage medium stores a computer program that, when executed, implements any of the aforementioned execution methods to perform black-box testing on the reliability of electronic control systems for rail transit, and further generates a test report for determining the reliability of the test object based on the test results and corresponding performance indicators. The advantages achievable with the storage medium are described in detail in the advantages of the test platform and are not further elaborated. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1is a flowchart of a first test case execution method according to an embodiment of the present application;

[0017] Figure 2 is a schematic diagram showing the connection between a test system and an object to be tested according to an embodiment of the present application;

[0018] Figure 3 is a flowchart of a second test case execution method according to an embodiment of the present application;

[0019] Figure 4 is a flowchart of a third test case execution method according to an embodiment of the present application;

[0020] Figure 5 is a flowchart illustrating a fourth test case execution method according to an embodiment of the present application;

[0021] Figure 6 is a schematic diagram of a first test platform according to an embodiment of the present application;

[0022] Figure 7 is a schematic diagram of a second test platform according to an embodiment of the present application;

[0023] Figure 8 is a schematic diagram of a third test platform according to an embodiment of the present application;

[0024] Figure 9 It is a schematic diagram of a fourth test platform according to an embodiment of the present application. DETAILED DESCRIPTION

[0025] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of devices consistent with certain aspects of the present application, as detailed in the appended claims.

[0026] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. Unless otherwise defined, technical or scientific terms used in this application should have the ordinary meaning understood by a person of ordinary skill in the art to which this application belongs. The terms "first," "second," and similar words used in this specification and claims do not denote any order, quantity, or importance, but are simply used to distinguish different components. Similarly, the terms "a" or "an" and similar words do not denote a limitation of quantity, but rather denote the presence of at least one. The terms "plurality" or "several" mean two or more. Unless otherwise indicated, the terms "front," "rear," "lower," and / or "upper" and similar words are for convenience only and are not intended to limit to a single position or spatial orientation. The terms "include," "comprising," and similar words mean that the elements or objects preceding the term "include" or "comprising" include the elements or objects listed after the term and their equivalents, and do not exclude other elements or objects. The terms "connected," "connected," and similar words are not limited to physical or mechanical connections and can include electrical connections, whether direct or indirect. As used in this specification and the appended claims, the singular forms "a," "an," "said," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0027] The various test case execution methods, test platforms, test systems, and computer-readable storage media disclosed in this application can all perform black-box testing on the reliability of a rail transit test object. The test object can be a single electronic controller, or various sub-control systems of a vehicle including an electronic controller (such as a traction system or a door lighting system), or a vehicle control system composed of these sub-control systems. Figure 2A hardware block diagram of a test system for implementing the test case execution method is shown. Various test case execution methods can be implemented using the hardware block diagram. The test cases are obtained based on the functions to be tested. For example, the functions to be tested on the object under test typically include a combination of power input and output test functions, digital input and output test functions, analog input and output test functions, pulse input and output test functions, optical fiber input and output test functions, temperature test functions, whole-machine stress test functions, and load operation test functions. Accordingly, various test items are included under each function. For example, the power input and output test includes test items for input voltage range, input voltage short-time interruption test, input overvoltage protection test, input undervoltage value test, line regulation test, load regulation test, load dynamic response test, output voltage range test, output voltage accuracy test, output voltage ripple and noise test, output short-circuit protection test, output overcurrent protection test, input power test, and output power test. For another example, digital test items include test items for digital input "1" voltage range test, digital input "0" voltage range test, and digital input "1" current range test.

[0028] The following describes in detail the various ways to execute test cases:

[0029] See also Figure 1 and Figure 2 , Figure 1 The first embodiment of the test case execution method of the present application is illustrated. Any method may be used to implement the test case execution method through the test system, for example, by installing a program that implements the test case execution method in the computer 10. The execution method includes the following steps:

[0030] S11 , establishing association relationships between corresponding variables between test steps of a test case for reliability testing of the object to be tested, and setting association identifiers for the variables.

[0031] In this step, the association is determined based on the call relationship between variables between test cases or test steps. For example, if step b of test case B requires the test results of step a of test case A, then step a of test case A is associated with step b of test case B. The association identifier can be any identifier that indicates an association between variables, and its type is not limited. The association relationship and association identifier can be stored in a database.

[0032] S12. Execute the test case to complete the reliability test of the rail transit object to be tested. During the execution process, set the association identifier for the test result of a test case according to the association relationship, and use the test result with the association identifier set in the test steps of the other test cases or other test steps of the same test case.

[0033] In this step, the test case can be executed in a variety of ways, for example, according to the order in which the test process of the object under test is performed. During the execution process, for example, if step B requires the test result of step A, the test result of step A is set with an association identifier. In this way, based on the association identifier, if step B or other steps need the test result, the test result can be directly obtained based on the association identifier and the association relationship.

[0034] The above-mentioned execution method has at least the following advantages: since the association relationship and the association identifier are set, in the process of executing the test case of the object to be tested of the rail transit, the test result of a test case is set with the association identifier, and the test result can be directly used for other test cases or other test steps of the same test case according to the association relationship and the association identifier. In this way, there is no need to execute the corresponding test case to obtain the test result, thereby improving the test efficiency of the reliability of the object to be tested of the rail transit. Moreover, since there is no need to execute the test case to obtain the test result, computing resources can be saved.

[0035] See also Figure 3 , Figure 3 A second embodiment of the test case execution method is illustrated. Compared to the first embodiment, the second embodiment is implemented in the same manner as step S21 and step S11, while steps S22 to S25 as a whole are different from step S22. More specifically, the execution method includes: determining whether the test result meets the performance indicator; if the test result meets the corresponding performance indicator of the object under test, returning the test result; otherwise, returning the correct value corresponding to the test result based on the performance indicator.

[0036] In this embodiment, the test result is returned to other test cases or other test steps of the same test case only if the test result meets the corresponding performance indicator. If the corresponding performance indicator is not met, the correct value corresponding to the test result is returned based on the performance indicator. The correct value is determined based on the performance indicator. For example, if the performance indicator is a numerical range, the correct value is any value within the numerical range.

[0037] The second embodiment has at least the following advantages: by returning the test result only when the test result meets the performance index, or returning the correct value when the performance index is not met, it is ensured that other test cases or other test steps of the same test case can always obtain correct test results, and the reliability test of the object to be tested is not affected by incorrect results. The accuracy of the reliability test is ensured while improving test efficiency and saving computing resources. Of course, in the above embodiment, if the test result does not meet the performance index, the test item corresponding to the test result can be displayed in the test report with a distinguishing mark, so that the tester can more easily know which test item of the rail transit object to be tested has a problem.

[0038] See also Figure 4 , Figure 4 A third implementation method of the test case execution method is disclosed. Compared with the second implementation method, this implementation method is the same as step S31 and step S11, and steps S32 to S35 are different from step S12 as a whole. The more specific difference is that: when the test result does not meet the performance index, the way of returning the value is different. In this implementation method, the execution method includes: judging the test result and the performance index, and returning the test result when the test result meets the corresponding performance index of the object to be tested; otherwise, receiving an adjustment instruction, and adjusting the execution order of the test case according to the adjustment instruction. Any method can be used for adjustment. This implementation method has at least the following advantages: by adjusting the execution order of the test case, it is possible to avoid executing the test case that requires the use of the test result or other test steps of the same test case, thus ensuring that the test process of the electronic reliability of rail transit is completed. Of course, when the performance index is not met, the test can be continued using the aforementioned second implementation method after checking the test case or the object to be tested.

[0039] In some embodiments, the adjustment instruction is a change instruction, which is used to change the execution order between the test cases or the execution order of other test steps of the same test case; and / or, the adjustment instruction is a deletion instruction, which is used to delete the test case or other test steps of the same test case.

[0040] See also Figure 5 , Figure 5A fourth implementation of the test case execution method is disclosed. Step S41 of the fourth implementation is identical to step S11, and step S42 is identical to step S12, except that the fourth implementation includes step S43. More specifically, the test case execution method further comprises: obtaining a calculated call count for the test result based on the association relationship, and determining unexecuted test cases based on the calculated call count, the actual number of transfers of the test result, and the execution order of the test cases. In this implementation, the calculated call count refers to the number of times the test result should be called if the test case is fully executed. The actual number of transfers refers to the number of times the test result is actually called during the execution of the test case. If the actual number of transfers is less than the calculated call count, it indicates that a test case or a test step of a test case has not been executed. Based on this, the test case or test step of the test case that has not been executed can be determined based on the execution order of the test case. The fourth implementation has at least the following advantages: while improving testing efficiency and conserving computing resources, it can easily identify unexecuted test cases or test steps of test cases, thereby reducing the burden on testers.

[0041] On the other hand, embodiments of the present application disclose a test platform. The following describes the structure of the test platform in conjunction with the relevant drawings. The test platform is used to cooperate with instruments and meters to perform reliability tests on rail transit test objects.

[0042] exist Figure 6In the embodiment shown, the test platform includes an input module 1, an association module 2 and an execution module 3. The input module 1 is used to input test instructions. The association module 2 is used to establish an association relationship between corresponding variables between the test steps of the test case of the reliability test of the object to be tested, and set an association identifier for the variable. The execution module 3 is used to execute the test case to complete the reliability test of the object to be tested of the rail transit. During the execution process, the association identifier is set for the test result of a test case according to the association relationship, and the test result with the association identifier set is used in the test steps of the other test cases or other test steps of the same test case. The working process of the first embodiment of the test platform can be referred to the first embodiment of the test case execution method. With such a configuration, the test platform has at least the following advantages: since the association module 2 is used to set the association relationship and the association identifier, the execution module sets the test result of a test case with the association identifier during the execution of the test case of the rail transit object to be tested, and can directly use the test result for other test cases or other test steps of the same test case according to the association relationship and the association identifier. In this way, there is no need to execute the corresponding test case to obtain the test result, thereby improving the test efficiency of the reliability of the rail transit object to be tested. Moreover, since there is no need to execute the test case to obtain the test result, computing resources can be saved.

[0043] See also Figure 7 , Figure 7A second embodiment of the test platform is disclosed. Compared with the first embodiment, this embodiment includes a judgment module 4, which is used to judge whether the test result meets the performance index; when the test result meets the corresponding performance index of the object to be tested, the test result is transmitted to the execution module 3; when the test result does not meet the performance index, an instruction request is sent to the input module 1, and the instruction request is used to request the tester to return the correct value corresponding to the test result according to the performance index. The working process of the test platform of the second embodiment can be referred to the second embodiment of the test case execution method. The test platform disclosed in the second embodiment has at least the following advantages: by returning the test result only when the test result meets the performance index, or returning the correct value when the performance index is not met, it ensures that other test cases or other test steps of the same test case can always obtain correct test results, the reliability test of the object to be tested is not affected by erroneous results, and the accuracy of the reliability test is ensured while improving test efficiency and saving computing resources. Of course, in the above embodiment, if the test result does not meet the performance index, the test item corresponding to the test result can be displayed with a distinguishing mark in the test report, so that the tester can more conveniently know which test item of the rail transit object to be tested has a problem.

[0044] See also Figure 8 , Figure 8 The test platform of the third embodiment of the present application is disclosed. In the third embodiment, the test platform includes a judgment module 4 and an adjustment module 5, wherein the judgment module 4 is used to judge whether the test result meets the performance index, and also transmits the test result to the execution module 3 when the test result meets the corresponding performance index of the object to be tested; when the test result does not meet the performance index, an adjustment instruction is sent to the adjustment module 5, and the adjustment module 5 is used to adjust the execution order of the test case according to the adjustment instruction (the execution order between test cases or the execution order between different test steps of the same test case). The working process of the test platform of the third embodiment can be referred to the third embodiment of the test case execution method. The test platform of the third embodiment has at least the following advantages: by adjusting the execution order of the test case, the test case that needs to use the test result or other test steps of the same test case can be executed, so that the test process of the object to be tested of rail transit is completed. Of course, when the performance index is not met, the test can be continued using the aforementioned second embodiment after checking the test case or the object to be tested.

[0045] See also Figure 9 , Figure 9A test platform of a fourth embodiment is disclosed. In the third embodiment, the execution module 3 also obtains the actual number of transmissions of the test result. The test platform includes a determination module 6, which obtains the calculated number of calls of the test result according to the association relationship, and also determines the test cases that have not been executed according to the calculated number of calls, the actual number of transmissions of the test result and the execution order of the test cases. The working process of the third test platform can be found in the fourth embodiment of the test case execution method. The test platform of the third embodiment has at least the following advantages: on the basis of being able to improve test efficiency and save computing resources, it is possible to easily find test cases or test steps of test cases that have not been executed, thereby reducing the burden on testers.

[0046] See also Figure 2 On the other hand, an embodiment of the present application further discloses a test system. The test system is used to test the reliability of an object to be tested in rail transit, and includes a computer 10 and an instrument 20, wherein the computer 10 is connected to the object to be tested via the instrument 20. The computer includes a memory and a processor. The memory stores a computer program that can be run on the processor. The processor executes the computer program to implement any of the aforementioned execution methods to perform a black box test on the reliability of the object to be tested, and also generates a test report for judging the reliability of the object to be tested based on the test results and corresponding performance indicators.

[0047] In another aspect, embodiments of the present application disclose a computer-readable storage medium storing a computer program that, when executed, performs a black-box test on the reliability of a rail transit object under test using any of the aforementioned execution methods, and generates a test report for determining the reliability of the object under test based on the test results and corresponding performance indicators.

[0048] The above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A test case execution method for performing black box testing on the reliability of a rail transit object to be tested, characterized in that: The execution method comprises the following steps: Establishing an association relationship between corresponding variables of the test steps of the test case of the reliability test of the object to be tested, and setting an association identifier for the variables; Executing the test case to complete the reliability test of the rail transit object to be tested, during the execution process, setting the association identifier for the test result of a test case according to the association relationship, and using the test result with the association identifier in the test steps of other test cases or other test steps of the same test case; The execution method includes: judging whether the test result meets the performance index; if the test result meets the corresponding performance index of the object to be tested, returning the test result; otherwise, returning the correct value corresponding to the test result according to the performance index, and displaying the test items corresponding to the performance index that the test result does not meet with a distinguishing mark in the test report.

2. The test case execution method according to claim 1, characterized in that: The execution method also includes: obtaining the calculation call number of the test result according to the association relationship, and determining the unexecuted test cases or the unexecuted test steps of the same test case according to the calculation call number, the actual delivery number of the test result and the execution order of the test cases.

3. A test platform for performing black box testing on the reliability of a rail transit object in conjunction with instruments and meters, characterized in that: include: Input module, used for inputting test instructions; an association module, configured to establish an association relationship between corresponding variables of the test steps of the test case of the reliability test of the object to be tested, and set an association identifier for the variables; an execution module, configured to execute the test case to complete the reliability test of the rail transit object to be tested, and during the execution process, set the association identifier for the test result of a test case according to the association relationship, and use the test result with the association identifier in the test steps of other test cases or other test steps of the same test case; The test platform includes a judgment module, which is used to judge whether the test result meets the performance index; The judging module transmits the test result to the executing module if the test result satisfies the corresponding performance index of the object to be tested; If the test result does not meet the performance indicator, the judgment module sends an instruction request to the input module, wherein the instruction request is used to request the tester to return a correct value corresponding to the test result according to the performance indicator; The execution module displays in the test report the test items corresponding to the test results that do not meet the performance indicators with distinguishing marks.

4. The test platform according to claim 3, characterized in that: The execution module further obtains the actual number of transmissions of the test result; The test platform includes a determination module, which obtains the calculation call number of the test result based on the association relationship, and also determines the unexecuted test cases or the unexecuted test steps of the same test case based on the calculation call number, the actual transmission number of the test result and the execution order of the test cases.

5. A testing system, characterized in that: It includes a computer and an instrument, wherein the computer is connected to the object to be measured through the instrument; The computer includes a memory and a processor; The memory stores a computer program executable on the processor; The processor executes the computer program to implement the execution method described in any one of claims 1 to 2 to perform black box testing on the reliability of the object to be tested, and also generates a test report for judging the reliability of the object to be tested based on the test results and corresponding performance indicators.

6. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which is executed to implement the execution method described in any one of claims 1 to 2 to perform black box testing on the reliability of electronic control of rail transit, and also generate a test report for judging the reliability of the object to be tested based on the test results and corresponding performance indicators.

Images