Automatic test case management method and device, equipment and storage medium

Abstract

The invention discloses an automatic test case management method and device, equipment and a storage medium. The method comprises the following steps: acquiring multi-dimensional information of a current vehicle in each scene of an automatic test; gathering the multi-dimensional information in an Excel table, and establishing a screening interaction interface of the automated test cases in the Excel table at a web end; the selected target test case is converted in the screening interaction interface, a corresponding test script is generated, automatic testing is carried out according to the test script, the complete management requirement of an enterprise for the automatic test case can be met, and the test efficiency is improved through effective combination of a test scene and a simulation test process. According to the method, the conversion process of the test case can be automatically realized in the background without depending on a simulation environment and automatic test software, so that the time consumed by manually building a test script is shortened, the accuracy of automatic test is improved, and the speed and efficiency of automatic test case management are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of automobile simulation testing, and in particular to an automated test case management method, device, equipment and storage medium. Background Art

[0002] As one of the "three-pillar method", simulation testing is an internationally recognized effective testing method for the development and verification process of intelligent driving functions in addition to road testing and site testing; using automated testing software connected to an in-the-loop simulation system (model-in-the-loop, software-in-the-loop, hardware-in-the-loop, etc.) to carry out automated testing is a common method for companies to conduct efficient simulation testing; automated testing implements the testing process by executing each automated test case; the simulation scenario serves as the operating environment of the object under test and corresponds to each specific test target and each test case one by one.

[0003] At present, the industry usually manages scenarios and simulation test cases separately. A scenario management platform is built to uniformly manage scenarios, while the application of test cases is generally only written in Excel tables. The scenarios and simulation test cases are not effectively managed in a coordinated manner. In the actual test execution process, multiple rounds of testing are required. Test cases that fail the previous tests need to be paid special attention to, which results in the inability to efficiently use consistent screening methods to screen out target test cases when actually executing the test tasks. In the actual execution of the test, there are also testing requirements for certain specific scenarios, such as the need to screen out simulation test cases in severe weather conditions or the need to screen out simulation test cases containing vulnerable traffic participants in the scene. In addition, test evaluation is a measure of whether the simulation test has passed. When the test is implemented, there is a need to focus on a certain type of evaluation indicator.

[0004] The PEGASUS project proposed a six-layer model of scenarios, which can effectively organize scenario elements. However, this model is only related to scenario design, and does not involve scenario evaluation or correlate with test results.

[0005] The current development and verification of autonomous driving system products requires a large number of test cases to perform simulation tests on a certain domain control hardware product or on algorithms and models. The number of simulation test cases for testing a single domain control or algorithm is generally in the tens of thousands. How to effectively screen and manage automated test cases is a practical problem that companies need to solve urgently.

[0006] Currently, when conducting simulation automation testing, most companies use automated testing software such as ECU-TEST, TAE and other software to achieve fast and efficient simulation testing; however, these automated testing software require manual construction of test scripts, and the construction process of these test scripts is highly dependent on the simulation environment and automated testing software, and companies generally only have one or several simulation benches; faced with a large number of test cases, the construction process is very time-consuming, and limited by bench resources, only one test engineer can carry out test case construction work at the same time. Summary of the invention

[0007] The main purpose of the present invention is to provide an automated test case management method, device, equipment and storage medium, aiming to solve the technical problems in the prior art that current automobile simulation automated testing requires manual construction of test scripts, is highly dependent on the simulation environment and automated testing software, the construction process is very time-consuming, the automated testing efficiency is low, and the automated testing results are not accurate enough.

[0008] In a first aspect, the present invention provides an automated test case management method, the automated test case management method comprising the following steps:

[0009] Obtain multi-dimensional information of the current vehicle in various scenarios of automated testing;

[0010] Summarize the multi-dimensional information in an Excel table, and establish an interactive interface for screening automated test cases in the Excel table on a web terminal;

[0011] The selected target test cases are converted in the screening interactive interface to generate corresponding test scripts, and automated testing is performed according to the test scripts.

[0012] Optionally, the obtaining of multi-dimensional information of the current vehicle in various scenarios of automated testing includes:

[0013] Obtain actual source records from the scenario library of the current vehicle in various scenarios of automated testing;

[0014] Obtaining different types of scene source keywords from the actual source records;

[0015] The test feature points are determined according to the scene source keywords, and the information of the test feature points is used as the multi-dimensional information in each scene.

[0016] Optionally, determining the test feature points according to the scene source keywords and using the information of the test feature points as the multi-dimensional information in each scene includes:

[0017] Performing test scene feature marking on the matched scene elements at the preset test function points according to the scene source keywords to obtain the test feature points of the feature markings;

[0018] The information of the test feature points is used as multi-dimensional information in each scene.

[0019] Optionally, the aggregating the multi-dimensional information in an Excel table and establishing an interactive interface for screening automated test cases in the Excel table on a web terminal includes:

[0020] Summarize the multi-dimensional information in an Excel table, and obtain automated test cases in the Excel table;

[0021] Associating the system background of the automated test with the test case base table of the automated test case;

[0022] After the web terminal detects that the user clicks on the filter field, the test case base table is synchronously refreshed according to the filter field, and the filter range is narrowed to obtain the target filter range;

[0023] A screening interactive interface is established on the web side according to the target screening range.

[0024] Optionally, converting the selected target test case in the screening interaction interface to generate a corresponding test script, and performing automated testing according to the test script includes:

[0025] Determine the selected test case from the automated test cases in the Excel table according to the current screening rule;

[0026] In the screening interactive interface, the selected test case is converted according to a preset conversion rule of the test conversion tool to obtain a test script executable by the automated testing tool;

[0027] Perform automated testing according to the test script.

[0028] Optionally, after converting the selected target test case in the screening interactive interface to generate a corresponding test script and performing automated testing according to the test script, the automated test case management method further includes:

[0029] Extract keywords of the expected results to be examined in each scenario to obtain evaluation feature points;

[0030] Acquiring functional performance requirements of the automated test of the current vehicle, and establishing an objective evaluation index system according to the functional performance requirements and the evaluation feature points;

[0031] The test results of the automated test are obtained, the test results are evaluated according to the objective evaluation index system, and a test evaluation report is obtained.

[0032] Optionally, obtaining the test result of the automated test, evaluating the test result according to the objective evaluation index system, and obtaining a test evaluation report includes:

[0033] Obtaining test results of automated testing, and converting the test results into data analysis scripts executable by the objective evaluation index system;

[0034] The test result is evaluated according to the objective evaluation index system, a test evaluation report is generated, the test evaluation report is saved in a preset format, and the test report path is updated in the current test case base table.

[0035] In a second aspect, in order to achieve the above-mentioned object, the present invention further proposes an automated test case management device, the automated test case management device comprising:

[0036] The information acquisition module is used to obtain multi-dimensional information of the current vehicle in various scenarios of automated testing;

[0037] An interface establishment module, used to summarize the multi-dimensional information in an Excel table, and establish an interactive interface for screening automated test cases in the Excel table on a web terminal;

[0038] The conversion test module is used to convert the selected target test cases in the screening interaction interface, generate corresponding test scripts, and perform automated testing according to the test scripts.

[0039] In the third aspect, to achieve the above-mentioned purpose, the present invention also proposes an automated test case management device, which includes: a memory, a processor, and an automated test case management program stored in the memory and executable on the processor, and the automated test case management program is configured to implement the steps of the automated test case management method as described above.

[0040] In a fourth aspect, in order to achieve the above-mentioned purpose, the present invention also proposes a storage medium, on which an automated test case management program is stored, and when the automated test case management program is executed by a processor, the steps of the automated test case management method described above are implemented.

[0041] The automated test case management method proposed in the present invention obtains multi-dimensional information of the current vehicle in various scenarios of automated testing; summarizes the multi-dimensional information in an Excel table, and establishes a screening interactive interface for automated test cases in the Excel table on a web terminal; transforms the selected target test cases in the screening interactive interface to generate corresponding test scripts, and performs automated testing according to the test scripts, which can meet the complete management requirements of enterprises for automated test cases. Through the effective combination of test scenarios and simulation test processes, the test case conversion process can be automatically realized in the background without relying on a simulation environment and automated testing software, thereby reducing the time spent on manually building test scripts, improving the accuracy of automated testing, and improving the speed and efficiency of automated test case management. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 A schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention;

[0043] Figure 2 A schematic diagram of a flow chart of a first embodiment of an automated test case management method of the present invention;

[0044] Figure 3 A schematic diagram of a flow chart of a second embodiment of the automated test case management method of the present invention;

[0045] Figure 4 A schematic diagram of a flow chart of a third embodiment of the automated test case management method of the present invention;

[0046] Figure 5 It is a schematic diagram of the framework of the automated test case base table in the automated test case management method of the present invention;

[0047] Figure 6 It is a schematic diagram of the bottom of the automated test case in the automated test case management method of the present invention;

[0048] Figure 7 A flowchart of a fourth embodiment of the automated test case management method of the present invention;

[0049] Figure 8 A schematic diagram of the framework of an automated test case management system in the automated test case management method of the present invention;

[0050] Fig. 9 A flowchart of a fifth embodiment of the automated test case management method of the present invention;

[0051] Fig.10 This is a functional module diagram of the first embodiment of the automated test case management device of the present invention.

[0052] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0053] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0054] The solution of the embodiment of the present invention is mainly: by obtaining multi-dimensional information of the current vehicle in various scenarios of automated testing; summarizing the multi-dimensional information in an Excel table, and establishing a screening interactive interface for automated test cases in the Excel table on the web; converting the selected target test cases in the screening interactive interface to generate corresponding test scripts, and performing automated testing according to the test scripts, it can meet the complete management requirements of enterprises for automated test cases. Through the effective combination of test scenarios and simulation test processes, the conversion process of test cases can be automatically realized in the background without relying on simulation environments and automated testing software, thereby reducing the time spent on manual construction of test scripts, improving the accuracy of automated testing, and improving the speed and efficiency of automated test case management. The technical problems in the prior art that current automobile simulation automated testing requires manual construction of test scripts, is highly dependent on simulation environments and automated testing software, and the construction process is very time-consuming, the efficiency of automated testing is low, and the automated testing results are not accurate enough are solved.

[0055] Reference Figure 1 , Figure 1 The figure is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.

[0056] like Figure 1 As shown, the device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed RAM memory, or it may be a stable memory (Non-Volatile Memory), such as a disk memory. The memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.

[0057] Those skilled in the art will understand that Figure 1The device structure shown in the figure does not constitute a limitation of the device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0058] like Figure 1 As shown, the memory 1005 as a storage medium may include an operating device, a network communication module, a user interface module, and an automated test case management program.

[0059] The device of the present invention calls the automated test case management program stored in the memory 1005 through the processor 1001, and performs the following operations:

[0060] Obtain multi-dimensional information of the current vehicle in various scenarios of automated testing;

[0061] Summarize the multi-dimensional information in an Excel table, and establish an interactive interface for screening automated test cases in the Excel table on a web terminal;

[0062] The selected target test cases are converted in the screening interactive interface to generate corresponding test scripts, and automated testing is performed according to the test scripts.

[0063] The device of the present invention calls the automated test case management program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0064] Obtain actual source records from the scenario library of the current vehicle in various scenarios of automated testing;

[0065] Obtaining different types of scene source keywords from the actual source records;

[0066] The test feature points are determined according to the scene source keywords, and the information of the test feature points is used as the multi-dimensional information in each scene.

[0067] The device of the present invention calls the automated test case management program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0068] Performing test scene feature marking on the matched scene elements at the preset test function points according to the scene source keywords to obtain the test feature points of the feature markings;

[0069] The information of the test feature points is used as multi-dimensional information in each scene.

[0070] The device of the present invention calls the automated test case management program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0071] Summarize the multi-dimensional information in an Excel table, and obtain automated test cases in the Excel table;

[0072] Associating the system background of the automated test with the test case base table of the automated test case;

[0073] After the web terminal detects that the user clicks on the filter field, the test case base table is synchronously refreshed according to the filter field, and the filter range is narrowed to obtain the target filter range;

[0074] A screening interactive interface is established on the web side according to the target screening range.

[0075] The device of the present invention calls the automated test case management program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0076] Determine the selected test case from the automated test cases in the Excel table according to the current screening rule;

[0077] In the screening interactive interface, the selected test case is converted according to a preset conversion rule of the test conversion tool to obtain a test script executable by the automated testing tool;

[0078] Perform automated testing according to the test script.

[0079] The device of the present invention calls the automated test case management program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0080] Extract keywords of the expected results to be examined in each scenario to obtain evaluation feature points;

[0081] Acquiring functional performance requirements of the automated test of the current vehicle, and establishing an objective evaluation index system according to the functional performance requirements and the evaluation feature points;

[0082] The test results of the automated test are obtained, the test results are evaluated according to the objective evaluation index system, and a test evaluation report is obtained.

[0083] The device of the present invention calls the automated test case management program stored in the memory 1005 through the processor 1001, and also performs the following operations:

[0084] Obtaining test results of automated testing, and converting the test results into data analysis scripts executable by the objective evaluation index system;

[0085] The test result is evaluated according to the objective evaluation index system, a test evaluation report is generated, the test evaluation report is saved in a preset format, and the test report path is updated in the current test case base table.

[0086] Through the above scheme, this embodiment obtains multi-dimensional information of the current vehicle in various scenarios of automated testing; summarizes the multi-dimensional information in an Excel table, and establishes a screening interactive interface for automated test cases in the Excel table on the web; transforms the selected target test cases in the screening interactive interface to generate corresponding test scripts, and performs automated testing according to the test scripts, which can meet the complete management needs of enterprises for automated test cases. Through the effective combination of test scenarios and simulation test processes, the test case conversion process can be automatically realized in the background without relying on simulation environments and automated testing software, thereby reducing the time spent on manually building test scripts, improving the accuracy of automated testing, and improving the speed and efficiency of automated test case management.

[0087] Based on the above hardware structure, an embodiment of the automated test case management method of the present invention is proposed.

[0088] Reference Figure 2 , Figure 2 It is a flowchart of the first embodiment of the automated test case management method of the present invention.

[0089] In a first embodiment, the automated test case management method comprises the following steps:

[0090] Step S10: Obtain multi-dimensional information of the current vehicle in various scenarios of automated testing.

[0091] It should be noted that the multi-dimensional information is information of multiple scenario data dimensions of the current vehicle in various scenarios of automated testing.

[0092] Step S20: Summarize the multi-dimensional information in an Excel table, and establish an interactive interface for screening automated test cases in the Excel table on a web terminal.

[0093] It should be understood that after the multi-dimensional information is summarized in an Excel table, a filtering interactive interface for the automated test cases in the Excel table can be further established on the web side. The filtering interactive interface is a scenario management interface developed on the web side, which is used to filter automated test cases and realize interactive operations with users.

[0094] Step S30: transform the selected target test case in the screening interaction interface, generate a corresponding test script, and perform automated testing according to the test script.

[0095] It can be understood that in the screening interaction interface, the target test case selected can be converted into data to generate a corresponding test script, and automated testing can be performed according to the test script, that is, the test script is executed to complete the automated testing.

[0096] Through the above scheme, this embodiment obtains multi-dimensional information of the current vehicle in various scenarios of automated testing; summarizes the multi-dimensional information in an Excel table, and establishes a screening interactive interface for automated test cases in the Excel table on the web; transforms the selected target test cases in the screening interactive interface to generate corresponding test scripts, and performs automated testing according to the test scripts, which can meet the complete management needs of enterprises for automated test cases. Through the effective combination of test scenarios and simulation test processes, the test case conversion process can be automatically realized in the background without relying on simulation environments and automated testing software, thereby reducing the time spent on manually building test scripts, improving the accuracy of automated testing, and improving the speed and efficiency of automated test case management.

[0097] Further, Figure 3 FIG. 1 is a flow chart of a second embodiment of the automated test case management method of the present invention. Figure 3 As shown, a second embodiment of the automated test case management method of the present invention is proposed based on the first embodiment. In this embodiment, step S10 specifically includes the following steps:

[0098] Step S11: obtaining actual source records from a scenario library of various scenarios of the current vehicle in the automated test.

[0099] It should be noted that the actual source records of the scenarios can be obtained from the scenario library of each scenario of the current vehicle in the automated test.

[0100] In the specific implementation, during the scenario preparation stage, the actual sources of the scenarios are recorded as different scenario libraries, such as the expert experience scenario library compiled by scenario engineers and test engineers based on functional specifications, the accident data scenario library generated based on real accident data, the standard regulation scenario library compiled based on standard regulations, and the natural driving scenario library compiled based on natural driving road data.

[0101] Step S12: Obtain different types of scene source keywords from the actual source records.

[0102] It can be understood that different types of scene source keywords can be obtained from the actual source record.

[0103] In the specific implementation, each scene source can be further subdivided into different types of scene source keywords. For example, the expert experience scene library is compiled according to the functional scene classification, so the scene source keyword is the corresponding functional scene classification; the accident data scene library has scene source keywords such as vehicle-to-vehicle, vehicle-to-person, vehicle-to-two-wheeled vehicle, etc. according to different collision conditions; the standard and regulation scene library comes from multiple different standard regulations or evaluation procedures, so the scene source keyword is the name of the regulation or procedure; the natural driving scene library comes from natural driving collection data, and when classifying, it refers more to the first-level classification standard in the PEGASUS model, namely the road type.

[0104] Step S13: determining test feature points according to the scene source keywords, and using information of the test feature points as multi-dimensional information in each scene.

[0105] It should be understood that the test feature points can be determined according to the scene source keywords, and the information of the test feature points can be used as multi-dimensional information in each scene.

[0106] Furthermore, the step S13 specifically includes the following steps:

[0107] Performing test scene feature marking on the matched scene elements at the preset test function points according to the scene source keywords to obtain the test feature points of the feature markings;

[0108] The information of the test feature points is used as multi-dimensional information in each scene.

[0109] In the specific implementation, each test scenario is designed with anticipated test functional points, such as requiring the system under test to recognize speed limit signs, implement intelligent following, be able to avoid longitudinal collisions, and achieve lane obstacle avoidance. The test scenario features mark the more special scene elements in this scenario. For example, if this scene contains special weather elements, other traffic participants include vulnerable traffic participants, contains digital information such as V2X, and the road structure is a ramp or curve, etc., the scene will be marked according to the user's special needs for special scene elements, and uniformly managed in the test case management system, so that the information of the test feature points can be used as multi-dimensional information in each scenario.

[0110] Through the above scheme, this embodiment obtains actual source records from the scenario library of each scenario of the current vehicle in the automated test; obtains different types of scenario source keywords from the actual source records; determines test feature points according to the scenario source keywords, and uses the information of the test feature points as multi-dimensional information in each scenario, so as to quickly obtain multi-dimensional information in each scenario and improve the speed and efficiency of automated test case management.

[0111] Further, Figure 4 FIG. 1 is a flow chart of a third embodiment of the automated test case management method of the present invention. Figure 4 As shown, a third embodiment of the automated test case management method of the present invention is proposed based on the first embodiment. In this embodiment, step S20 specifically includes the following steps:

[0112] Step S21: Summarize the multi-dimensional information in an Excel table, and obtain automated test cases in the Excel table.

[0113] It should be noted that the multi-dimensional information is summarized in an Excel table, that is, all dimensional information is summarized in an Excel table for unified management, and then the automated test cases in the Excel table can be obtained.

[0114] Step S22: Associating the system background of the automated test with the test case base table of the automated test case.

[0115] It is understandable that associating the system background of the automated test with the test case base table of the automated test case facilitates the generation of subsequent test scripts.

[0116] In the specific implementation, see Figure 5 , Figure 5 Schematic diagram of the framework of the automated test case table in the automated test case management method of the present invention. Figure 5 As shown, when the scenario source is the expert experience scenario library, the scenario source keywords include but are not limited to HNOP function, FSRA function, TSR function, and the corresponding test function points include but are not limited to speed limit sign recognition, smart following, longitudinal collision avoidance and lane avoidance; the corresponding test scenario characteristics include but are not limited to rainy day scenes, vulnerable traffic participants and temporary facility scenes; the test evaluation focus includes but is not limited to safety, driving comfort, traffic efficiency and false triggering; the test results include but are not limited to pass, fail and not tested; the standard and regulatory scenario library includes but is not limited to ISO22839, ISO17387, C-ICAP and ENCAP; the accident data scenario library includes but is not limited to vehicle-to-vehicle, vehicle-to-person, vehicle-to-two-wheeler; the natural driving scenario library includes but is not limited to ramps, toll booths and tunnels; different scenario sources correspond to different scenario source keywords; test function points, test scenario characteristics, test evaluation focus, test results and scenario sources constitute the automated test case base table framework.

[0117] See also Figure 6 , Figure 6 The following is a schematic diagram of the automated test case in the automated test case management method of the present invention. Figure 6As shown, a test case base table is written, which must include the following columns: scenario source, scenario source keywords, test function points, test scenario characteristics, test evaluation key points, test results, test steps, test evaluation, and of course other information can also be included, which is not limited in this embodiment.

[0118] Step S23: After the web terminal detects that the user clicks on the filter field, the test case base table is synchronously refreshed according to the filter field, and the filter range is narrowed to obtain the target filter range.

[0119] It should be understood that after the web terminal detects that the user clicks on the filter field, the test case base table can be synchronously refreshed according to the filter field, thereby narrowing the filter range and obtaining the target filter range.

[0120] Step S24: establishing a screening interactive interface on the web side according to the target screening range.

[0121] It is understandable that a screening interaction interface may be established on the web side according to the target screening range.

[0122] In the specific implementation, the management system background is associated with the test case base table. After the web user clicks on a field to filter, the background will synchronously refresh the base table content to narrow the scope of further filtering. After each step of filtering, the filtered test cases will be automatically stored in the specified folder; for example, after clicking on the "Expert Experience" and "Standards and Regulations" scenario libraries in the scenario library source, the contents of other filter fields will automatically filter out automated test cases whose scenario library sources are not "Expert Experience" or "Standards and Regulations".

[0123] Through the above scheme, this embodiment obtains the automated test cases in the Excel table by aggregating the multi-dimensional information in the Excel table; associates the system background of the automated test with the test case base table of the automated test case; after detecting that the user clicks on the filter field on the web side, the test case base table is synchronously refreshed according to the filter field, and the filter range is narrowed to obtain the target filter range; a filter interaction interface is established on the web side according to the target filter range, so that the multi-dimensional information in each scenario can be quickly obtained, thereby improving the speed and efficiency of automated test case management.

[0124] Further, Figure 7 FIG. 4 is a flow chart of a fourth embodiment of the automated test case management method of the present invention. Figure 7 As shown, a fourth embodiment of the automated test case management method of the present invention is proposed based on the first embodiment. In this embodiment, step S30 specifically includes the following steps:

[0125] Step S31, determining the selected test case from the automated test cases in the Excel table according to the current screening rule.

[0126] It should be noted that the selected test cases can be determined from the automated test cases in the Excel table according to the preset current screening rules.

[0127] Step S32: converting the selected test cases in the screening interactive interface according to preset conversion rules of the test conversion tool to obtain a test script executable by the automated testing tool.

[0128] It is understandable that, in the screening interactive interface, the selected test case can be converted according to the preset conversion rules corresponding to the test conversion tool to obtain a test script executable by the automated testing tool.

[0129] In the specific implementation, by pre-setting text writing rules in the pre-developed automated test conversion tool and utilizing the open API interface of the automated test tool, the tool can be called through an external program to uniformly convert the test cases in the Excel table into testable scripts according to the conversion rules; the conversion of the scenario test table to the test case is mainly divided into the conversion of "test steps" and the conversion of "expected results", which correspond to the test execution process and the analysis process of the test data after the test is completed.

[0130] Step S33: perform automated testing according to the test script.

[0131] It should be understood that by aggregating all dimensional information in an Excel table for unified management, an automated test case screening interactive interface can be established on the web side. The selected test cases are linked with the conversion program in the background to directly generate test scripts for the target test cases, and then the test scripts are executed to perform automated testing.

[0132] In the specific implementation, see Figure 8 , Figure 8 FIG. 1 is a schematic diagram of the framework of the automated test case management system in the automated test case management method of the present invention. Figure 8As shown, the underlying logic of the automated test case management system is to focus on the entire process of test execution, from scenario data source to test result traceability, to achieve full process coverage of the entire simulation test process, the management system background is associated with the test case base table, when the web user clicks on a field to filter, the background will synchronously refresh the base table content, narrowing the scope of further filtering, after each step of filtering, the filtered test cases will be automatically stored in the specified folder; the automated test case management system calls the dynamic screening test case program through the automated test case base table, the automated test case base table is associated with scenario source, scenario source keywords, test function points, test scenario characteristics, test evaluation focus points, and test results; after dynamic screening, the target test case is obtained, the test case test script is obtained through the test case conversion program, the simulation test result is obtained through the simulation test system, and the test result can be obtained after the simulation test result after the test is executed.

[0133] Through the above scheme, this embodiment determines the selected test case from the automated test cases in the Excel table according to the current screening rules; converts the selected test case according to the preset conversion rules of the test conversion tool in the screening interaction interface to obtain a test script executable by the automated test tool; and performs automated testing according to the test script. This can meet the complete management needs of the enterprise for automated test cases, and through the effective combination of test scenarios and simulation test processes, the conversion process of test cases can be automatically realized in the background without relying on the simulation environment and automated testing software, thereby reducing the time spent on manually building test scripts, improving the accuracy of automated testing, and improving the speed and efficiency of automated test case management.

[0134] Further, Fig. 9 FIG. 5 is a flow chart of a fifth embodiment of the automated test case management method of the present invention. Fig. 9 As shown, a fifth embodiment of the automated test case management method of the present invention is proposed based on the first embodiment. In this embodiment, after step S30, the automated test case management method further includes the following steps:

[0135] Step S40: extract keywords of the expected results to be examined in each scene to obtain evaluation feature points.

[0136] It should be noted that by extracting keywords from the expected results to be examined in each scenario, evaluation feature points can be obtained.

[0137] Step S50: obtaining the functional performance requirements of the automated test of the current vehicle, and establishing an objective evaluation index system according to the functional performance requirements and the evaluation feature points.

[0138] It should be understood that after obtaining the functional performance requirements of the current vehicle's automated test, an objective evaluation index system can be established based on the functional performance requirements and the evaluation feature points.

[0139] In the specific implementation, the test evaluation focus extracts the keyword summary of the expected results that need to be examined in the design of each scenario; according to the functions and performance requirements of the autonomous driving planning control module, a complete objective evaluation index system is established, including evaluation of control accuracy, response speed, robustness, safety, comfort, compliance, energy consumption and other aspects.

[0140] Step S60: Obtain test results of the automated test, evaluate the test results according to the objective evaluation index system, and obtain a test evaluation report.

[0141] It is understandable that after obtaining the test results of the automated test, the test results can be evaluated according to the objective evaluation index system to obtain a corresponding test evaluation report.

[0142] In the specific implementation, the specific evaluation indicators include the evaluated variables and specific values, which are summarized as evaluation keywords in the evaluation focus. For example, the evaluation indicator is "the maximum longitudinal deceleration of the test vehicle is <2m / s2 and the maximum lateral acceleration is <2m / s2", which is summarized as "driving comfort" in the test evaluation focus; the test results show the historical test results of this test case, which are divided into "pass" or "failure". If it has not been tested, it is marked as "not tested".

[0143] Furthermore, the step S60 specifically includes the following steps:

[0144] Obtaining test results of automated testing, and converting the test results into data analysis scripts executable by the objective evaluation index system;

[0145] The test result is evaluated according to the objective evaluation index system, a test evaluation report is generated, the test evaluation report is saved in a preset format, and the test report path is updated in the current test case base table.

[0146] It should be understood that the test case conversion procedure includes converting the test steps in the Excel table into executable test scripts for the automated testing tool; converting the test evaluation into a data analysis script for the test results; saving the test report in Excel, PDF or HTML format, extracting the test results and updating the test results and test report path in the test case base table.

[0147] Through the above scheme, this embodiment obtains evaluation feature points by extracting keywords of the expected results to be examined in each scenario; obtains the functional performance requirements of the automated test of the current vehicle, and establishes an objective evaluation index system based on the functional performance requirements and the evaluation feature points; obtains the test results of the automated test, evaluates the test results based on the objective evaluation index system, and obtains a test evaluation report; can effectively integrate the closed-loop process of scenario classification, use case screening, use case management and use case conversion execution of the automated test process, meet the company's complete management needs for automated test cases, effectively combine test scenarios with simulation test processes, and automatically implement the test case conversion process in the background, providing a convenient way for testers to efficiently use and manage test cases.

[0148] Accordingly, the present invention further provides an automated test case management device.

[0149] Reference Fig.10 , Fig.10 This is a functional module diagram of the first embodiment of the automated test case management device of the present invention.

[0150] In a first embodiment of the automated test case management device of the present invention, the automated test case management device comprises:

[0151] The information acquisition module 10 is used to obtain multi-dimensional information of the current vehicle in various scenarios of automated testing.

[0152] The interface establishment module 20 is used to summarize the multi-dimensional information in an Excel table and establish an interactive interface for screening automated test cases in the Excel table on the web side.

[0153] The conversion test module 30 is used to convert the selected target test case in the screening interaction interface, generate a corresponding test script, and perform automated testing according to the test script.

[0154] The information acquisition module 10 is also used to obtain actual source records from the scene library of each scene in the automated test of the current vehicle; obtain different types of scene source keywords from the actual source records; determine test feature points based on the scene source keywords, and use the information of the test feature points as multi-dimensional information in each scene.

[0155] The information acquisition module 10 is further used to perform test scene feature marking on the matching scene elements at preset test function points according to the scene source keywords to obtain the test feature points of the feature markings; and use the information of the test feature points as multi-dimensional information in each scene.

[0156] The interface establishment module 20 is also used to summarize the multi-dimensional information in an Excel table and obtain the automated test cases in the Excel table; associate the system background of the automated test with the test case base table of the automated test case; after detecting that the user clicks on the filter field on the web side, synchronously refresh the test case base table according to the filter field, narrow the filter range, and obtain the target filter range; establish a filtering interaction interface on the web side according to the target filter range.

[0157] The conversion test module 30 is also used to determine the selected test cases from the automated test cases in the Excel table according to the current screening rules; convert the selected test cases according to the preset conversion rules of the test conversion tool in the screening interaction interface to obtain a test script executable by the automated test tool; and perform automated testing according to the test script.

[0158] The conversion test module 30 is also used to extract keywords of the expected results to be examined in each scenario to obtain evaluation feature points; obtain the functional performance requirements of the automated test of the current vehicle, and establish an objective evaluation index system based on the functional performance requirements and the evaluation feature points; obtain the test results of the automated test, evaluate the test results based on the objective evaluation index system, and obtain a test evaluation report.

[0159] The conversion test module 30 is also used to obtain the test results of the automated test, convert the test results into a data analysis script executable by the objective evaluation index system; evaluate the test results according to the objective evaluation index system, generate a test evaluation report, save the test evaluation report in a preset format, and update the test report path in the current test case base table.

[0160] Among them, the steps implemented by each functional module of the automated test case management device can refer to the various embodiments of the automated test case management method of the present invention, and will not be repeated here.

[0161] In addition, an embodiment of the present invention further provides a storage medium, on which an automated test case management program is stored, and when the automated test case management program is executed by a processor, the following operations are implemented:

[0162] Obtain multi-dimensional information of the current vehicle in various scenarios of automated testing;

[0163] Summarize the multi-dimensional information in an Excel table, and establish an interactive interface for screening automated test cases in the Excel table on a web terminal;

[0164] The selected target test cases are converted in the screening interactive interface to generate corresponding test scripts, and automated testing is performed according to the test scripts.

[0165] Furthermore, when the automated test case management program is executed by the processor, the following operations are also implemented:

[0166] Obtain actual source records from the scenario library of the current vehicle in various scenarios of automated testing;

[0167] Obtaining different types of scene source keywords from the actual source records;

[0168] The test feature points are determined according to the scene source keywords, and the information of the test feature points is used as the multi-dimensional information in each scene.

[0169] Furthermore, when the automated test case management program is executed by the processor, the following operations are also implemented:

[0170] Performing test scene feature marking on the matched scene elements at the preset test function points according to the scene source keywords to obtain the test feature points of the feature markings;

[0171] The information of the test feature points is used as multi-dimensional information in each scene.

[0172] Furthermore, when the automated test case management program is executed by the processor, the following operations are also implemented:

[0173] Summarize the multi-dimensional information in an Excel table, and obtain automated test cases in the Excel table;

[0174] Associating the system background of the automated test with the test case base table of the automated test case;

[0175] After the web terminal detects that the user clicks on the filter field, the test case base table is synchronously refreshed according to the filter field, and the filter range is narrowed to obtain the target filter range;

[0176] A screening interactive interface is established on the web side according to the target screening range.

[0177] Furthermore, when the automated test case management program is executed by the processor, the following operations are also implemented:

[0178] Determine the selected test case from the automated test cases in the Excel table according to the current screening rule;

[0179] In the screening interactive interface, the selected test case is converted according to a preset conversion rule of the test conversion tool to obtain a test script executable by the automated testing tool;

[0180] Perform automated testing according to the test script.

[0181] Furthermore, when the automated test case management program is executed by the processor, the following operations are also implemented:

[0182] Extract keywords of the expected results to be examined in each scenario to obtain evaluation feature points;

[0183] Acquiring functional performance requirements of the automated test of the current vehicle, and establishing an objective evaluation index system according to the functional performance requirements and the evaluation feature points;

[0184] The test results of the automated test are obtained, the test results are evaluated according to the objective evaluation index system, and a test evaluation report is obtained.

[0185] Furthermore, when the automated test case management program is executed by the processor, the following operations are also implemented:

[0186] Obtaining test results of automated testing, and converting the test results into data analysis scripts executable by the objective evaluation index system;

[0187] The test result is evaluated according to the objective evaluation index system, a test evaluation report is generated, the test evaluation report is saved in a preset format, and the test report path is updated in the current test case base table.

[0188] Those skilled in the art will appreciate that all or part of the steps in the above-mentioned implementation method can be accomplished by instructing related hardware through a program, and the program is stored in a storage medium, including a number of instructions for enabling a device (which may be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each implementation method of the present application; and the aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program codes.

[0189] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0190] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0191] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An automated test case management method, characterized in that: The automated test case management method comprises: Obtain multi-dimensional information of the current vehicle in various scenarios of automated testing; Summarize the multi-dimensional information in an Excel table, and establish an interactive interface for screening automated test cases in the Excel table on a web terminal; The selected target test cases are converted in the screening interactive interface to generate corresponding test scripts, and automated testing is performed according to the test scripts.

2. The automated test case management method according to claim 1, characterized in that: The multi-dimensional information of the current vehicle in various scenarios of automated testing is obtained, including: Obtain actual source records from the scenario library of the current vehicle in various scenarios of automated testing; Obtaining different types of scene source keywords from the actual source records; The test feature points are determined according to the scene source keywords, and the information of the test feature points is used as the multi-dimensional information in each scene.

3. The automated test case management method according to claim 2, characterized in that: The step of determining the test feature points according to the scene source keywords and using the information of the test feature points as multi-dimensional information in each scene includes: Performing test scene feature marking on the matched scene elements at the preset test function points according to the scene source keywords to obtain the test feature points of the feature markings; The information of the test feature points is used as multi-dimensional information in each scene.

4. The automated test case management method according to claim 1, wherein: The step of aggregating the multi-dimensional information in an Excel table and establishing a screening interactive interface for automated test cases in the Excel table on a web terminal includes: Summarize the multi-dimensional information in an Excel table, and obtain automated test cases in the Excel table; Associating the system background of the automated test with the test case base table of the automated test case; After the web terminal detects that the user clicks on the filter field, the test case base table is synchronously refreshed according to the filter field, and the filter range is narrowed to obtain the target filter range; A screening interactive interface is established on the web side according to the target screening range.

5. The automated test case management method according to claim 1, characterized in that: The step of converting the selected target test case in the screening interactive interface to generate a corresponding test script, and performing automated testing according to the test script includes: Determine the selected test case from the automated test cases in the Excel table according to the current screening rule; In the screening interactive interface, the selected test case is converted according to a preset conversion rule of the test conversion tool to obtain a test script executable by the automated testing tool; Perform automated testing according to the test script.

6. The automated test case management method according to claim 1, characterized in that: After converting the selected target test case in the screening interactive interface to generate a corresponding test script and performing automated testing according to the test script, the automated test case management method further includes: Extract keywords of the expected results to be examined in each scenario to obtain evaluation feature points; Acquiring functional performance requirements of the automated test of the current vehicle, and establishing an objective evaluation index system according to the functional performance requirements and the evaluation feature points; The test results of the automated test are obtained, the test results are evaluated according to the objective evaluation index system, and a test evaluation report is obtained.

7. The automated test case management method according to claim 6, characterized in that: The step of obtaining the test results of the automated test, evaluating the test results according to the objective evaluation index system, and obtaining a test evaluation report includes: Obtaining test results of automated testing, and converting the test results into data analysis scripts executable by the objective evaluation index system; The test result is evaluated according to the objective evaluation index system, a test evaluation report is generated, the test evaluation report is saved in a preset format, and the test report path is updated in the current test case base table.

8. An automated test case management device, characterized in that: The automated test case management device comprises: The information acquisition module is used to obtain multi-dimensional information of the current vehicle in various scenarios of automated testing; An interface establishment module, used to summarize the multi-dimensional information in an Excel table, and establish an interactive interface for screening automated test cases in the Excel table on a web terminal; The conversion test module is used to convert the selected target test cases in the screening interaction interface, generate corresponding test scripts, and perform automated testing according to the test scripts.

9. An automated test case management device, characterized in that: The automated test case management device comprises: a memory, a processor, and an automated test case management program stored in the memory and executable on the processor, wherein the automated test case management program is configured to implement the steps of the automated test case management method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: An automated test case management program is stored on the storage medium, and when the automated test case management program is executed by the processor, the steps of the automated test case management method according to any one of claims 1 to 7 are implemented.

Images