Automated over-the-air test system

Abstract

The invention provides an automatic over-the-air test system, comprising: a test management platform comprising a host and software module, a human-computer interaction interface, a database and a script execution module; the test equipment comprises a power supply module, a vehicle network interaction module and a vehicle protocol connection port; the client to-be-tested equipment comprises a main control machine table and a connecting port, and the client to-be-tested equipment is a vehicle simulation rack or an entity vehicle; wherein the test management platform is electrically connected to the client to-be-tested device, the test device is electrically connected to the test management platform and the client to-be-tested device, the vehicle network interaction module is electrically connected to the connection port, a script is stored in the database, the script is associated with an automatic over-the-air test process, and the test management platform is electrically connected to the client to-be-tested device. And the test management platform performs testing on the to-be-tested equipment of the client according to the content of the script.

Description

[0001] This application claims priority to a patent application filed on October 17, 2024, with application number 113139477, in Taiwan, China. Technical Field

[0002] This invention relates to a testing system, specifically a testing system applicable to the research and development phase of Over-the-Air (OTA) technology, and also a testing system that can be designed with specific verification processes to meet software upgrade specifications or regulatory requirements. Background Technology

[0003] In the past, after a vehicle left the factory, users had to go to dealerships or repair shops for maintenance or system updates, which was very time-consuming and cumbersome. Furthermore, for manufacturers, if a major project required a vehicle recall, it not only incurred significant time and costs, but also raised concerns about potential risks during the recall period. Therefore, OTA (Over-The-Air) technology is commonly used to significantly shorten repair time and effectively reduce costs. Simultaneously, with the trend towards connected cars, the industry is shifting from hardware-oriented development to software and application services, allowing OTA technology to update or upgrade the vehicle's active and passive safety systems and control functions.

[0004] On the other hand, OTA technology is a new type of firmware update method for car manufacturers. Vehicles do not need to go to the car factory for maintenance and updates. Instead, the vehicle's firmware is repaired and updated remotely. Therefore, it is impossible to confirm the vehicle's usage status during the update or whether the update will endanger the owner's safety. For safety reasons, vehicle OTA needs to be developed in accordance with certain standards, such as the EU UNECE-R-156.

[0005] Furthermore, with the rapid development of software-defined vehicle intelligence, there are more and more controllers that can be upgraded in vehicles, such as in-vehicle infotainment (IVI), on-board unit (TBOX), and advanced driver assistance system (ADAS). As a result, electric vehicles can have up to hundreds of electronic control units (ECUs). OTA technology, as an important way to upgrade vehicle software and firmware, is gradually becoming one of the key technologies in the automotive industry. However, the increased number of ECUs being upgraded also leads to a relative increase in development and integration complexity and testing volume. Summary of the Invention

[0006] [The problem that the invention aims to solve]

[0007] As described above, current OTA (Over-The-Air) technology cannot confirm the vehicle's operating status at the time of the update. Furthermore, with the increasing number of firmware updates required, it cannot be guaranteed that each update's firmware content will be compatible with the hardware of various vehicle models. Therefore, there is a need for an automated testing system for the highly complex OTA and OTA development specifications in electric vehicles to assist automakers or automotive electronic component suppliers in development and testing, and to reduce the manpower and time costs of software development through automated software testing.

[0008] [Technical means to solve the problem]

[0009] An automated over-the-air (OTA) download testing system includes: a test management platform, comprising a host and software module, a human-machine interface, a database, and a script execution module; a test device, comprising a power supply module, a vehicle network interaction module, and at least one vehicle protocol connection port; and a client device under test, comprising a main control unit and at least one connection port, wherein the client device under test is a vehicle simulation bench or a physical vehicle; wherein the test management platform is electrically connected to the client device under test, the test device is electrically connected to both the test management platform and the client device under test, the vehicle network interaction module is electrically connected to the connection port via the vehicle protocol connection port, wherein the database stores at least one script, the script is associated with an automated OTA download testing process, and the test management platform performs tests on the client device under test according to the content of the script.

[0010] Preferably, the vehicle network interaction module is a controller local area network vehicle network interaction module, a local interconnection network vehicle network interaction module, an Ethernet vehicle network interaction module, or an automotive network protocol vehicle network interaction module.

[0011] Preferably, the vehicle protocol connection port is an Android diagnostic bridge.

[0012] Preferably, the test management platform and the test equipment are integrated into a test cabinet.

[0013] Furthermore, the present invention also provides an automated over-the-air (OTA) testing method, comprising the following steps: a test management platform executes at least one script via a script execution module, wherein the script is associated with an automated OTA testing process; the test management platform performs testing on a client device under test based on the content of the script, wherein the client device under test is a vehicle simulation bench or a physical vehicle; a test device provides a vehicle network interaction module and at least one vehicle protocol connection port, wherein the test device is electrically connected to the test management platform and the client device under test, and the vehicle network interaction module is electrically connected to the client device under test via the vehicle protocol connection port; and the test management platform generates and stores a complete test report corresponding to the script.

[0014] Preferably, the test management platform inputs the vehicle condition information of the vehicle simulation bench or the physical vehicle through a human-computer interaction interface.

[0015] Preferably, when the test management platform performs tests on the vehicle simulation bench or the physical vehicle, the test management platform further tests whether the vehicle simulation bench or the physical vehicle can perform normal basic vehicle operations.

[0016] Preferably, the test equipment uses a Controller Area Network (CAN) vehicle network interaction module to read and write at least one electronic control component in the vehicle simulator or the physical vehicle through a unified diagnostic service to run automated over-the-air specification tests on the script.

[0017] [Invention Benefits]

[0018] The advantages and benefits of this invention are as follows: 1. Different scripts can be used to meet the testing requirements of various testing scenarios, and this flexible design reduces the manpower and time required for testing scenario switching. 2. Support for client devices under test is multi-modal and conforms to the main serial port interfaces of various automotive applications. 3. When the number of software and firmware updates increases, scripts can be directly added to the automated over-the-air (OTA) testing system for script testing, thereby reducing the manpower and time costs for manufacturers' development. Attached Figure Description

[0019] Those skilled in the art will gain a better understanding of the various aspects, specific features, and advantages of the present invention by referring to the accompanying drawings, which include:

[0020] Figure 1 A schematic diagram of the structure of an automated over-the-air download testing system according to an embodiment of the present invention.

[0021] Figure 2A schematic diagram of the structure of an automated over-the-air download testing system according to another embodiment of the present invention.

[0022] Figure 3 A flowchart of an embodiment of the automated over-the-air download testing method of the present invention.

[0023] Symbol explanation:

[0024] 10: Test Management Platform

[0025] 20: Testing equipment

[0026] 30: Client device under test

[0027] 40: Test Cabinet

[0028] 101: Host and Software Module

[0029] 103: Human-Computer Interaction Interface

[0030] 105: Database

[0031] 107: Script Execution Module

[0032] 201: Power Module

[0033] 203: Vehicle Network Interaction Module

[0034] 205: Vehicle Protocol Connection Port

[0035] 301: Main control unit

[0036] 303: Connection port

[0037] S10-S40: Steps Detailed Implementation

[0038] The following description, in conjunction with the accompanying drawings and component symbols, provides a more detailed account of the embodiments of the present invention, enabling those skilled in the art to implement them after studying this specification.

[0039] Figure 1 This is a schematic diagram illustrating the structure of an automated over-the-air download testing system according to an embodiment of the present invention. Please refer to... Figure 1An embodiment of the present invention provides an automated over-the-air (OTA) download testing system, including a test management platform 10, a test device 20, and a client device under test 30. The test management platform 10 includes a host and software module 101, a human-machine interface 103, a database 105, and a script execution module 107. The test device 20 includes a power supply module 201, a vehicle network interaction module 203, and at least one vehicle protocol connection port 205. The client device under test 30 includes a main control unit 301 and at least one connection port 303. The client device under test 30 is a vehicle simulation bench or a physical vehicle. A vehicle simulation bench refers to a device that integrates vehicle function simulation into a mobile device, allowing users to easily adjust data in the mobile device to simulate various brand vehicle models. The test management platform 10 is electrically connected to the client device under test 30, the test device 20 is electrically connected to both the test management platform 10 and the client device under test 30, the vehicle network interaction module 203 is electrically connected to the connection port 303 via the vehicle protocol connection port 205, and the database 105 stores at least one script, which is associated with an automated over-the-air (OTA) test process. More specifically, the script is an automated test process designed based on regulations or OTA upgrade specifications. The test process includes various update information applicable to various software, firmware, and electronic control components of the vehicle. The script execution module 107 of the test management platform 10 can perform tests on the main control unit 301 of the client device under test 30 according to the content of the script to simulate and confirm whether the OTA upgrade content can run normally on the vehicle.

[0040] In detail, users can use the host and software module 101, human-machine interface 103, and script execution module 107 of the test management platform 10 to run scripts in the database 105. That is, relevant test items and test processes conforming to OTA specifications are specifically converted into different scripts and imported into the database 105 of the test management platform 10. Users can then use the test management platform 10 to select scripts and create test tasks for OTA testing of the vehicle's software, firmware, and electronic control components (ECUs). When the test scenario changes, users can also change different scripts to meet the test requirements of different test scenarios. This flexible design can reduce the manpower and time required for test scenario changes.

[0041] Furthermore, in one embodiment of the present invention, the automated over-the-air (OTA) test system supports the client device under test (DUT) 30 in a multi-modal manner and conforms to various major automotive serial port interfaces, such as Power (PWR), Controller Area Network (CAN), Ethernet, Android Debug Bridge (ADB), Local Interconnect Network (LIN), and FlexRay. Due to its modularity, serial port interfaces can be added or removed as needed, avoiding the need for reinstallation or reconfiguration of equipment due to increased interface requirements. Therefore, in one embodiment of the present invention, the automotive network interaction module 203 can be a Controller Area Network (CAN), a Local Interconnect Network (LIN) automotive network interaction module, an Ethernet (ETH) automotive network interaction module, or an automotive network protocol automotive network interaction module. The number and port types of the vehicle protocol connection port 205 can be increased according to actual needs. For example, the vehicle protocol connection port 205 can be an Android debugging bridge, and the controller area network vehicle network interaction module can be electrically connected to the connection port 303 via the Android debugging bridge (ADB) to provide corresponding vehicle interaction functions when the client device under test 30 is being tested. Furthermore, in other embodiments of the present invention, multiple different types of vehicle protocol connection ports 205 can correspond to multiple connection ports 303 to provide corresponding vehicle interaction functions for different types of connection ports 303.

[0042] On the other hand, users can modify the script content in the database 105 through the human-computer interaction interface 103 of the test management platform 10. This allows for quick script modification and direct implementation of tests when switching test items. The database 105 can store multiple scripts to improve testing convenience. Furthermore, the human-computer interaction interface 103 of the test management platform 10 can clearly view the status of all test items, download test-related records, and perform debugging through these records. It also provides a product categorization function, allowing users to distinguish test vehicles for more precise execution of test tasks.

[0043] In addition, when the test management platform 10 executes a test project, the human-computer interaction interface 103 will have a real-time monitoring flowchart and voice assistance to explain the current test progress. Users can clearly understand the details of the test process. After the test is completed, the host and software module 101 will automatically export a complete report detailing all records. In addition to text records, there will also be screenshots. Users can directly refer to or use this report.

[0044] Figure 2This is a schematic diagram illustrating the structure of an automated over-the-air download testing system according to another embodiment of the present invention. Please refer to... Figure 1 and Figure 2 In another embodiment of the present invention, the test management platform 10 and the test equipment 20 can be integrated into a test cabinet 40 to make them a single unit. Furthermore, the test cabinet 40 is movable, which allows users to easily move it next to the client device under test 30 for convenient testing.

[0045] Figure 3 This is a flowchart illustrating an embodiment of the automated over-the-air (OTA) download testing method of the present invention. Please refer to... Figures 1 to 3 The present invention also provides an automated over-the-air (OTA) testing method, comprising steps S10 to S40. Step S10 involves a test management platform 10 executing at least one script via a script execution module 107, wherein the script is associated with an automated OTA testing process; more specifically, the script is an automated testing process designed based on regulations or OTA upgrade specifications. Step S20 involves the test management platform 10 performing tests on a client device under test 30 according to the content of the script, wherein the client device under test 30 is a vehicle simulation bench or a physical vehicle. Step S30 involves a test device 20 providing a vehicle network interaction module 203 and at least one vehicle protocol connection port 205, wherein the test device 20 is electrically connected to the test management platform 10 and the client device under test 30, and the vehicle network interaction module 203 is electrically connected to the client device under test 30 via the vehicle protocol connection port 205. Step S40 involves the test management platform 10 generating and storing a complete test report corresponding to the script. The automated OTA testing method will be illustrated below with examples.

[0046] In step S10, the user can select the OTA test process script to be executed through the human-machine interface 103 of the test management platform 10, and input the vehicle condition information of the vehicle simulation bench or the physical vehicle, such as vehicle brand, model, and equipment. Then, the selected OTA test process is executed by the script execution module 107. Furthermore, after the settings are completed, a host and software module 101 of the test management platform 10 will determine whether the vehicle condition information and vehicle settings meet the conditions of the OTA test process. If so, the upgrade will not be performed to ensure that the vehicle's electronic components are updated under the correct conditions, thus protecting the safety of the vehicle owner. Various OTA test process scripts can be stored in a database 105 within the test management platform 10.

[0047] In step S20, during the test, the user can click on the desired testing task on the human-computer interaction interface 103 to access the task's details page. This page displays the task name, applicable vehicle models, task creator, task execution progress, task creation time, and all testing items under that task.

[0048] Furthermore, in step S20, when the test management platform 10 performs upgrade testing on the vehicle simulation bench or the physical vehicle, the test management platform 10 can further test whether the vehicle simulation bench or the physical vehicle can perform normal basic vehicle operations and whether it complies with OTA upgrade test safety specifications. For example, whether there are safety issues such as door jamming or deadlock, whether gear shifting, acceleration, or emergency braking and deceleration can be performed normally. The test management platform 10 can use signal simulation scenarios to detect whether emergency operations can be performed during the upgrade; if not, the test fails. In addition, the test equipment 20 can use a controller area network vehicle network interaction module 203 to read and write at least one electronic control component in the vehicle simulation bench or the physical vehicle through the Unified Diagnostic Services (UDS) protocol to run the automated over-the-air download specification test on the script, and to facilitate the subsequent upgrade test process.

[0049] In addition, in step S20, the test device 20 can use the controller local area network vehicle network interaction module 203 to try to tamper with the upgrade package of the electronic control components through the UDS protocol, so as to confirm whether there is a protection mechanism during software OTA. Once the software upgrade package is tampered with, it will be unable to enter the OTA upgrade process.

[0050] Finally, once the entire OTA upgrade test process is completed, the test management platform 10 can generate and store a complete test report corresponding to the script, providing the testing unit with this complete test report to evaluate the OTA execution status of the tested device.

[0051] As can be seen from the above description of the present invention, the present invention provides an automated over-the-air (OTA) testing system and method. The advantages and effects of the present invention are as follows: 1. Different scripts can be used to meet the testing requirements of various testing scenarios. This flexible design can reduce the manpower and time required for testing scenario switching. 2. The support for client devices under test is multi-modal and conforms to the main serial port interfaces of various automotive applications. 3. When the number of software and firmware that need to be updated increases, scripts can be directly added to the automated OTA testing system and script testing can be performed, thereby reducing the manpower and time costs for manufacturers to develop.

Claims

1. An automated over-the-air download testing system, characterized in that, include: A test management platform, including a host and software module, a human-computer interaction interface, a database, and a script execution module; A test device, comprising a power supply module, a vehicle network interaction module, and at least one vehicle protocol connection port; and A client device under test includes a main control unit and at least one connection port. The client device under test is a vehicle simulation bench or a physical vehicle. The test management platform is electrically connected to the client device under test (DUT), the test device is electrically connected to both the test management platform and the client DUT, and the vehicle network interaction module is electrically connected to the connection port via the vehicle protocol connection port. The database stores at least one script, which is associated with an automated over-the-air (OTA) download test process. The test management platform performs tests on the client device under test based on the content of the script.

2. The automated over-the-air download testing system according to claim 1, characterized in that, The vehicle network interaction module is a controller local area network vehicle network interaction module, a local interconnection network vehicle network interaction module, an Ethernet network vehicle network interaction module, or an automotive network protocol vehicle network interaction module.

3. The automated over-the-air download testing system according to claim 2, characterized in that, The vehicle protocol connection port is an Android diagnostic bridge.

4. The automated over-the-air download testing system according to claim 1, characterized in that, The test management platform and the test equipment are integrated into a test cabinet.

5. An automated over-the-air (OTA) download testing method, characterized in that, Includes the following steps: A test management platform executes at least one script via a script execution module, wherein the script is associated with an automated over-the-air (OTA) test process; The test management platform performs tests on a client device under test according to the content of the script, wherein the client device under test is a vehicle simulation bench or a physical vehicle; A test device provides a vehicle network interaction module and at least one vehicle protocol connection port, wherein the test device is electrically connected to the test management platform and the client device under test, and the vehicle network interaction module is electrically connected to the client device under test via the vehicle protocol connection port; and The test management platform generates and stores a complete test report corresponding to the script.

6. The automated over-the-air download testing method according to claim 5, characterized in that, The test management platform allows users to input vehicle condition information from the vehicle simulation bench or the physical vehicle via a human-computer interaction interface.

7. The automated over-the-air download testing method according to claim 6, characterized in that, When the test management platform performs tests on the vehicle simulation bench or the physical vehicle, the test management platform further tests whether the vehicle simulation bench or the physical vehicle can perform normal basic vehicle operations.

8. The automated over-the-air download testing method according to claim 5, characterized in that, The test equipment uses a controller area network (CLAN) vehicle network interaction module to read and write at least one electronic control component in the vehicle simulator or the physical vehicle through a unified diagnostic service in order to run automated over-the-air specification tests on the script.

Images