Vehicle OTA automatic test system and method with rack and cloud combined

Abstract

The invention belongs to the technical field of OTA automatic testing, and relates to a rack and cloud combined vehicle OTA automatic testing system and method, which comprises the steps of creating a test case and a script correspondingly executed, then creating a test task, and automatically executing the test task according to the steps of the test case. The system firstly executes the test case of the cloud, and then issues an OTA task to the vehicle and the rack; meanwhile, the system issues the test task to the upper computer, and the upper computer continues to carry out the automatic test task of the vehicle and the rack. Each test task is executed by one thread, and a plurality of test tasks can be executed in parallel, so that a tester does not need to stare at a rack or a real vehicle in real time and all the test tasks are processed by automated scripts of an upper computer and a server, and manpower is liberated; during the waiting period, the tester can also put energy on test case design and script maintenance; the test case can be quickly created, the rack can be selected, and the test task can be executed by one key.

Description

Technical Field

[0001] The present invention belongs to the technical field of OTA automated testing, and in particular relates to a vehicle OTA automated testing system and method that combines a test bench with the cloud. Background Art

[0002] Vehicle OTA upgrades refer to online upgrades of vehicle ECU and other software. For OTA testing of vehicles and test benches, existing testing methods require testers to monitor progress in real time next to the actual vehicle or test bench. After each step is completed, the status must be recorded and the next step initiated. Due to the lengthy OTA testing process and the time required for each step, a large number of testers are required. However, these testers spend most of their time waiting, resulting in a waste of manpower and very low testing efficiency.

[0003] Typically, ECU OTA upgrade testing is divided into two parts: the cloud and the vehicle. The cloud refers to the HTTP server, including the server where the system is located and the server where the OTA system under test is located. Testers need to first upload the upgrade package to the cloud, select the corresponding vehicle and parts, and create an upgrade task to push it. When the vehicle (or test bench) receives the upgrade task, it will download, decrypt, and verify the signature of the upgrade package, and a pop-up window will prompt whether the test task should be upgraded. The entire process takes about 1-2 hours to complete. Whenever the OTA component version changes, a huge number of test cases and a long time are required.

[0004] In the prior art, when establishing a use case library, testers use Excel to write test cases. After testing is complete, they compile test reports based on the execution of each use case. This results in a lengthy testing process and requires manual maintenance and compilation. For cloud-based OTA testing, testers need to manually click on pages or use Python scripts to implement partial automated testing, and then maintain these test results in Excel. For OTA testing on the vehicle or test bench, testers need to manually operate CanOE to connect to the vehicle computer to send and receive signals, or manually operate the vehicle computer screen to test OTA upgrades, and then maintain these test results in Excel. Test cases have a dedicated management platform, eliminating the need for Excel management, and some automated Python scripts are available in the cloud. However, there is no place to maintain scripts; they are all on the tester's computer. The vehicle or test bench has some Canoe scripts for automatic signal transmission and reception, but these cannot be serially and uniformly orchestrated with the cloud-based use cases. Overall, cloud-based and vehicle-based testing cannot be serially connected and fully automated.

[0005] In summary, existing testing methods have a low degree of automation, often only achieving partial automation. There's no unified system, and no comprehensive automated testing across the cloud and vehicle. Furthermore, OTA testing on both real vehicles and test benches is lengthy and inefficient. Therefore, there's an urgent need to develop a vehicle OTA automated testing method that combines both the test bench and the cloud to effectively address these issues. Summary of the Invention

[0006] The purpose of the present invention is to provide a vehicle OTA automated testing system and method that combines a test bench and the cloud, so as to solve the problem of unifying all cloud-side and vehicle-side automation scripts, creating automated tasks, outputting overall test reports, and freeing up manpower during the test waiting period.

[0007] The purpose of the present invention is achieved through the following technical solutions:

[0008] A vehicle OTA automated testing method combining a test bench and the cloud comprises the following steps:

[0009] A. Testers create automated test tasks in the OTA automated test system;

[0010] B. The OTA system under test issues an OTA upgrade task and sends the OTA task-related information to the vehicle and test bench via the MQTT protocol;

[0011] C. The OTA automated test system sends the automated test tasks and scripts of the host computer to the host computer;

[0012] D. The host computer is connected to the IVI of the vehicle computer through ADB. ADB controls the IVI vehicle computer and automatically operates the vehicle computer interface.

[0013] E. The host computer controls CANOE through CAPL automation scripts to send and receive CAN messages, send related signals, and simulate different OTA strategies for testing;

[0014] F. CANOE control console and vehicle computer sending and receiving messages;

[0015] G. While executing the task, the host computer will upload the execution log to the OTA automated test system in real time; testers can monitor the execution status in real time in the test system and view the test report;

[0016] H. Server Deployment: The OTA automated test system and the OTA system under test are deployed to a cloud server. Testers only need to access the corresponding page through a browser to operate remotely. After the tester creates the automated test task, the server executes the corresponding automated Python script to obtain the OTA upgrade task status. The vehicle and test bench report the OTA upgrade task status to the OTA system under test.

[0017] Furthermore, in step A, the OTA automated test system executes a python script to automatically create vehicles, parts, upgrade packages, and upgrade tasks in the OTA system under test.

[0018] Furthermore, in step B, when connecting to the test bench or the actual vehicle, the server will execute the scp command to send the corresponding CAPL automation script to the host computer of the test bench and the actual vehicle.

[0019] Furthermore, in step D, the host computer has a built-in corresponding automation script, which uses adb to connect to the vehicle computer. The script will automatically recognize the text on the vehicle computer screen and perform automatic click upgrade operations.

[0020] Furthermore, in step E, the vehicle speed, gear position signal and battery power are simulated.

[0021] Furthermore, in step G, the log of the host computer can be transmitted to the server in real time through websocket, and the server can also establish a real-time two-way connection with the browser through websocket to realize real-time viewing of the log of the host computer and the log of the server.

[0022] Furthermore, in step H, the OTA automated test system and the OTA system under test are deployed in a cloud server and are connected via a network.

[0023] Furthermore, the OTA automated test system used includes a cloud service organization, a host computer, a test bench, and a real vehicle; wherein the cloud service organization includes a user microservice module, a test case service module, a database module, a Redis cache database module, and a front-end service module;

[0024] Among them, the user microservice module is used to manage users and log in;

[0025] The test case service module is used to manage test cases and test tasks;

[0026] The database module uses a Mysql relational database to store relational data such as test cases;

[0027] The Redis cache database is used to store real-time changing data such as test task status;

[0028] The front-end service module is used to display the browser interface.

[0029] Compared with the prior art, the present invention has the following beneficial effects:

[0030] The present invention establishes an automated testing method that can realize functions such as test case management, test task management, test bench management, and vehicle management; each test task is executed by a thread, and multiple test tasks can be executed in parallel. The original testers only need to maintain the automated scripts, and there is no need for the testers to watch the test bench or the actual vehicle in real time. All processing is done by the automated scripts of the host computer and the server, freeing up manpower; during the waiting period, the testers can also focus on test case design and script maintenance; the application of this system can quickly create test cases and select test benches, and can execute test tasks with one click, greatly improving test efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments. It should be understood that the following drawings only illustrate certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying any creative work.

[0032] Figure 1 Schematic diagram of the overall structure of the test system for the vehicle OTA automated test method that combines the test bench and the cloud;

[0033] Figure 2 Test flow chart of the vehicle OTA automated testing method that combines the test bench and the cloud;

[0034] Figure 3 Server deployment diagram. DETAILED DESCRIPTION

[0035] The present invention will be further described below in conjunction with embodiment:

[0036] The present invention will be further described in detail below with reference to the accompanying drawings and examples. It will be understood that the specific embodiments described herein are intended only to illustrate the present invention and are not intended to limit the present invention. It should also be noted that, for ease of description, the accompanying drawings only illustrate portions relevant to the present invention, not all structures.

[0037] It should be noted that similar reference numerals and letters represent similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings. At the same time, in the description of the present invention, the terms "first", "second", etc. are used only to distinguish the description and should not be understood as indicating or implying relative importance.

[0038] The present invention provides a vehicle OTA automated testing method that combines a test bench with the cloud. First, a test case and a corresponding execution script are created. For cloud test cases, the script can be a python script, which is used to simulate browser click operations. Vehicles, tasks, etc. are automatically created in the OTA system under test without the need for tester operation. The test case includes multiple test steps, and each step will be executed by the server in sequence. After creating the test case, it is necessary to create a test task. When creating a task, select the test case just created, and the system will automatically execute according to the steps of the test case. At the same time, the system adopted by the testing method has a one-click execution of test tasks. The system will first execute the test cases in the cloud, such as creating vehicles, parts, upgrade packages and upgrade tasks; then, the OTA task will be sent to the vehicle and test bench; at the same time, the system will also send the test task to the host computer, and the host computer will continue to perform automated testing tasks for the vehicle and test bench.

[0039] like Figure 1-Figure 2 As shown, the vehicle OTA automated testing method combining a test bench and the cloud of the present invention includes the following steps:

[0040] 1. Testers create automated test tasks in the OTA automated test system. The OTA automated test system executes Python scripts to automatically create vehicles, parts, upgrade packages, and upgrade tasks in the OTA system under test.

[0041] 2. The OTA system under test issues an OTA upgrade task and sends the OTA task-related information to the vehicle and test bench via the MQTT protocol. When connected to the test bench or actual vehicle, the server executes the scp command to send the corresponding CAPL automation script to the host computer of the test bench and actual vehicle.

[0042] 3. The OTA automated test system also sends the automated test tasks and scripts of the host computer to the host computer.

[0043] 4. The host computer connects to the IVI of the vehicle computer via ADB. ADB controls the IVI vehicle computer and automates the vehicle computer interface, such as automatically clicking on the Android vehicle screen. The host computer has a built-in corresponding automation script, which connects to the vehicle computer via ADB. The script automatically recognizes the text on the vehicle computer screen and automatically clicks on the upgrade operation.

[0044] 5. The host computer also controls CANOE through CAPL automation scripts to send and receive CAN messages, simulate vehicle speed, gear position and other signals, and send relevant signals to simulate different OTA strategies, including vehicle speed, gear position, battery power, etc. for testing.

[0045] 6. CANOE control console and vehicle computer send and receive messages.

[0046] 7. While executing tasks, the host computer uploads execution logs to the OTA automated test system in real time. Testers can monitor execution status and view test reports in real time within the test system. The host computer's logs can be transmitted to the server in real time via WebSockets. The server can also establish a real-time, two-way connection with the browser via WebSockets, enabling real-time viewing of both the host computer's logs and the server's logs.

[0047] 8. Server deployment Figure 3 As shown in the figure, the OTA automated test system and the OTA system under test are deployed to a cloud server and have network connectivity. Testers can operate remotely by simply accessing the corresponding page through a browser. After the tester creates the automated test task, the server executes the corresponding automated Python script to obtain the OTA upgrade task status. The vehicle and test bench report the OTA upgrade task status to the OTA system under test. When the server monitors the OTA system under test, the upgrade status of the tested upgrade task is monitored. If the upgrade is successful, it means that the test task has also been successful.

[0048] The vehicle OTA automated testing method combining a test bench and the cloud of the present invention can execute automated testing tasks with one click, generate test reports, view operation logs in real time, execute cloud test cases with Python scripts, combine CAPL automated scripts of CANoe, and ADB automated operation vehicle interface.

[0049] Each test case has corresponding steps, each with corresponding keywords, such as "immediate upgrade normal test," "IG OFF scheduled 5-minute upgrade test," "normal power outage 10-minute restart vehicle-to-cloud communication test," "complete vehicle power outage 5-second restart vehicle-to-cloud communication test," "create vehicle," "create brand," "IG OFF scheduled 2-minute upgrade test," "silent upgrade normal test," "IG ON silent upgrade parking brake release failure test," "CA certificate replacement test," and "complete certificate deletion test." The background program recognizes these keywords and automatically runs the corresponding tasks. The system can automate tasks, executing the steps according to the order of the test cases in the created test task. Each step has a success or failure status, which is ultimately reflected in the test report.

[0050] The OTA automated testing system used includes a cloud service organization, a host computer, a test bench, and a real vehicle. The cloud service organization adopts a microservice architecture, using the Spring Boot framework in Java, including a user microservice module, a test case service module, a database module, a Redis cache database module, and a front-end service module.

[0051] Among them, the user microservice module is used to manage users and log in.

[0052] The test case service module is used to manage test cases and test tasks.

[0053] The database module uses a Mysql relational database to store relational data such as test cases.

[0054] The Redis cache database is used to store real-time changing data such as test task status.

[0055] The front-end service module is used to display the browser interface.

[0056] Note that the above are only preferred embodiments of the present invention and the technical principles employed. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments and may include many other equivalent embodiments without departing from the concept of the present invention. The scope of the present invention is determined by the scope of the appended claims.

Claims

1. A vehicle OTA automated testing method combining a test bench and the cloud, characterized in that: The following steps are involved: A. Testers create automated test tasks in the OTA automated test system; B. The OTA system under test issues an OTA upgrade task and sends the OTA task-related information to the vehicle and test bench via the MQTT protocol; C. The OTA automated test system sends the automated test tasks and scripts of the host computer to the host computer; D. The host computer is connected to the IVI of the vehicle computer through ADB. ADB controls the IVI vehicle computer and automatically operates the vehicle computer interface. E. The host computer controls CANOE through CAPL automation scripts to send and receive CAN messages, send related signals, and simulate different OTA strategies for testing; F. CANOE control console and vehicle computer sending and receiving messages; G. While executing the task, the host computer will upload the execution log to the OTA automated test system in real time; Testers can monitor the execution status in real time in the test system and view test reports; H. Server Deployment: The OTA automated test system and the OTA system under test are deployed to a cloud server. Testers can remotely operate the system by simply accessing the corresponding page through a browser. After the tester creates an automated test task, the server executes the corresponding automated Python script to obtain the OTA upgrade task status. The vehicle and test bench report the OTA upgrade task status to the OTA system under test.

2. The vehicle OTA automated testing method combining a test bench and a cloud according to claim 1, characterized in that: In step A, the OTA automated test system executes a Python script to automatically create vehicles, parts, upgrade packages, and upgrade tasks in the OTA system under test.

3. The vehicle OTA automated testing method combining a test bench and a cloud according to claim 1, characterized in that: Step B: When connecting to the test bench or the actual vehicle, the server will execute the scp command to send the corresponding CAPL automation script to the host computer of the test bench and the actual vehicle.

4. The vehicle OTA automated testing method combining a test bench and a cloud according to claim 1, characterized in that: Step D: The host computer has a built-in automation script that connects to the vehicle computer using adb. The script will automatically recognize the text on the vehicle computer screen and automatically click to upgrade.

5. The vehicle OTA automated testing method combining a test bench and a cloud according to claim 1, characterized in that: Step E: Simulate vehicle speed, gear position signal and battery power.

6. The vehicle OTA automated testing method combining a test bench and a cloud according to claim 1, characterized in that: In step G, the log of the host computer can be transmitted to the server in real time through websocket, and the server can also establish a real-time two-way connection with the browser through websocket to realize real-time viewing of the log of the host computer and the log of the server.

7. The vehicle OTA automated testing method combining a test bench and a cloud according to claim 1, characterized in that: In step H, the OTA automated test system and the OTA system under test are deployed to a cloud server and are connected to the network.

8. The vehicle OTA automated testing method combining a test bench and a cloud according to claim 1, characterized in that: The OTA automated test system used includes a cloud service organization, a host computer, a test bench, and a real vehicle; wherein the cloud service organization includes a user microservice module, a test case service module, a database module, a Redis cache database module, and a front-end service module; Among them, the user microservice module is used to manage users and log in; The test case service module is used to manage test cases and test tasks; The database module uses a Mysql relational database to store relational data such as test cases; The Redis cache database is used to store real-time changing data such as test task status; The front-end service module is used to display the browser interface.

Images