OTA upgrade test system and method based on TSMaster software

Abstract

The invention belongs to the technical field of OTA testing, and particularly relates to an OTA upgrading testing system and method based on TSMaster software. The OTA upgrade test system based on the TSmaster software comprises a server control module which is used for being connected with a cloud server through an API (Application Program Interface) to realize creation and release of an OTA task; the cellular communication simulation module is used for controlling the cellular signal strength of the tested system and restoring typical network scenes of weak networks and no networks; and the bus residual simulation module is used for realizing upgrade preconditions and node simulation of the tested system through bus signal parameter configuration and node simulation, and simultaneously realizing serial flashing of the same network segment and parallel flashing of different network segments. According to the method, OTA upgrading full-link and scene full-coverage testing is realized, testing vulnerabilities are reduced, and the testing efficiency and the testing quality are greatly improved.

Description

Technical Field

[0001] This invention belongs to the field of OTA testing technology, and in particular relates to an OTA upgrade testing system and method based on TSMaster software. Background Technology

[0002] With the development of automotive intelligence and digitalization, software has become an indispensable part of modern automobiles, and software upgrades play a crucial role in improving vehicle performance and user experience. The demand for OTA upgrades from various automakers is increasingly strong, and the upgrade content is evolving in depth, from infotainment systems to powertrain systems, and even comprehensive upgrades to autonomous driving functions.

[0003] To address the frequent demands for automotive software updates and ensure the safety and stability of OTA (Over-The-Air) upgrades, various testing methods have been developed within the industry, including numerous manual testing approaches. However, these manual methods suffer from drawbacks such as high time consumption, high cost, and susceptibility to errors, making them unsuitable for the rapid software iteration needs of automakers. Automated testing methods, on the other hand, offer advantages such as low cost, high efficiency, and low error rates. Therefore, developing automated OTA testing systems and methods has become a critical issue that urgently needs to be addressed.

[0004] In related technologies, software tools for OTA upgrade testing are commonly used, such as VectorCANoe and dSPACEControlDesk. However, these software programs only support OTA flashing process testing and lack fully automated testing across the entire OTA task deployment, software package download, and human-computer interaction chain, resulting in low overall testing efficiency. Furthermore, they cannot cover different upgrade scenarios, leading to numerous test vulnerabilities. In addition, VectorCANoe and dSPACEControlDesk employ specialized programming languages ​​for automation, making development and maintenance difficult and costly. Summary of the Invention

[0005] To overcome the shortcomings of the existing technologies, this invention provides an OTA upgrade testing system and method based on TSMaster software. Through a cellular communication simulation module, it achieves full-link, scenario-wide OTA upgrade testing, reducing test vulnerabilities and significantly improving testing efficiency and quality. Through a bus residual simulation module, it enables parallel flashing and upgrading of multiple controllers across different network segments, greatly improving testing efficiency. Through an HMI touch simulation module, it achieves human-machine interface soft control, resulting in lower system development and maintenance costs, faster test response, higher test accuracy, and more comprehensive system functionality compared to traditional robotic arm methods.

[0006] To achieve the above objectives, one or more embodiments of the present invention provide the following technical solutions: The first aspect of this invention provides an OTA upgrade testing system based on TSMaster software.

[0007] The OTA upgrade testing system based on TSMaster software includes an OTA testing system and a system under test. The OTA testing system includes a server control module, a cellular communication simulation module, and a bus remnant simulation module, wherein: The server control module is used to connect to the cloud server via an API interface to create and publish OTA tasks. The cellular communication simulation module is used to control the cellular signal strength of the system under test and to recreate typical network scenarios such as weak network and no network. The bus residual simulation module is used to realize the preconditions for upgrading the system under test and the node simulation through bus signal parameter configuration and node simulation, and at the same time realize serial writing in the same network segment and parallel writing in different network segments.

[0008] As an optional technical solution, the OTA testing system further includes a testing equipment module, which comprises a programmable power supply, signal shielding equipment, bus data equipment, a test script executor, and a TSMaster testing device, wherein: The programmable power supply is used to connect to the power supply of the system under test, and to realize abnormal operating condition input such as power on / off and voltage fluctuation. The signal shielding device is used to receive control signals from the cellular communication simulation module, change the opening and closing angle, and thus change the cellular signal strength of the system under test. The bus data device is used to receive control signals from the bus residual simulation module to realize bus signal parameter configuration and node simulation; The test script executor is used to execute test scripts.

[0009] As an optional technical solution, the OTA testing system also includes an HMI touch simulation module, which is used to connect to the system under test via USB or WIFI and control the human-computer interaction, image acquisition, video saving, and underlying signal acquisition of the vehicle and mobile phone interfaces through ADB commands.

[0010] As an optional technical solution, the OTA testing system also includes a test script module, which is written based on a test case set to realize the automated testing steps of the test cases; The test cases are set with configurable system parameter variables to adapt to various component testing scenarios from different manufacturers; Configurable system parameter variables include test duration, frame interval, frame data, ID address, and service; The test script module sets the test case sequence number, which is used to set the selection of the service option file.

[0011] As an optional technical solution, the OTA testing system also includes a test execution module. The test execution module is used to connect the test equipment module, the device under test in the system under test, and the test script. The test script drives the test equipment module to complete the automated OTA upgrade test. The OTA testing system also includes a report output module, which is used to output test reports. The test reports include test results, the specific time of test failure, the problem triggering conditions, and a comparison between the expected test results and the actual test results. The formats include Word, PDF, and Excel.

[0012] As an optional technical solution, the OTA testing system also includes a fault injection module, which is used to inject fault signals into the system under test to realize the injection of test scenarios under abnormal operating conditions.

[0013] As an optional technical solution, the system under test includes an OTA upgrade server, a test bench, and a vehicle infotainment screen / mobile phone; the test bench is an automated test integration environment, and the OTA upgrade server is set on the test bench.

[0014] The second aspect of this invention provides an OTA upgrade testing method based on TSMaster software.

[0015] The OTA upgrade testing method based on TSMaster software includes the following steps: The server control module connects to the cloud server via an API interface to enable the creation and publishing of OTA tasks; The cellular communication simulation module enables control over the cellular signal strength of the system under test, recreating typical network scenarios such as weak or no network. The bus residual simulation module realizes the preconditions for upgrading the system under test and the node simulation through bus signal parameter configuration and node simulation, and at the same time realizes serial writing in the same network segment and parallel writing in different network segments. The fault injection module injects fault signals into the system under test, realizing the injection of test scenarios under abnormal operating conditions; Select the test case sequence number of the test script module to enable the selection of the service option file; The test execution module executes the selected configuration service option file; The report output module outputs a test report. A third aspect of the present invention provides a computer-readable storage medium having a program stored thereon, which, when executed by a processor, implements the steps in the OTA upgrade testing method based on TSMaster software as described in the first aspect of the present invention.

[0016] The fourth aspect of the present invention provides an electronic device, including a memory, a processor, and a program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps in the OTA upgrade testing method based on TSMaster software as described in the first aspect of the present invention.

[0017] The above one or more technical solutions have the following beneficial effects: This invention provides an OTA upgrade testing system and method based on TSMaster software. Based on the domestic software TSMaster, it develops and realizes automated OTA upgrade testing. Compared with commonly used industry software such as VectorCANoe and dSPACEControlDesk, this invention has more complete functions and is cheaper, making it a highly cost-effective automated OTA testing system in the industry.

[0018] This invention automates OTA upgrade testing for different network protocols (CAN, LIN, ETH), automotive components, and systems through configurable test parameters. It achieves full-link, scenario-wide OTA upgrade testing via modules such as cellular communication simulation, reducing test vulnerabilities and significantly improving testing efficiency and quality. The bus remnant simulation module enables parallel flashing and upgrades of multiple controllers across different network segments, greatly enhancing testing efficiency. Furthermore, the HMI touch simulation module provides soft control for human-machine interaction, resulting in lower system development and maintenance costs, faster test response, and higher test accuracy compared to traditional robotic arm methods.

[0019] Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0020] The accompanying drawings, which form part of this invention, are used to provide a further understanding of the invention. The illustrative embodiments of the invention and their descriptions are used to explain the invention and do not constitute an improper limitation of the invention.

[0021] Figure 1 This is a schematic diagram of the hardware structure of the test system in Example 1.

[0022] Figure 2 This is a schematic diagram of the test system software structure in Example 1.

[0023] The attached diagram lists the components represented by each number as follows: 1. Power supply; 2. Cabinet power strip; 3. Industrial computer; 4. Residual bus simulation board; 5. I / O board; 6. Fault injection board; 7. Interface under test; 8. Chassis; 9. Switch. Detailed Implementation

[0024] It should be noted that the following detailed descriptions are exemplary and intended to provide further illustration of the invention. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains.

[0025] It should be noted that the terminology used herein is for the purpose of describing particular implementations only and is not intended to limit the exemplary implementations of the present invention.

[0026] Where there is no conflict, the embodiments and features in the embodiments of the present invention can be combined with each other.

[0027] Example 1 This embodiment discloses an OTA upgrade testing system based on TSMaster software.

[0028] like Figure 2 As shown, the OTA upgrade testing system based on TSMaster software includes an OTA testing system and a system under test. The OTA testing system includes a server control module, a cellular communication simulation module, and a bus remnant simulation module, wherein: The server control module is used to connect to the cloud server via an API interface to create and publish OTA tasks. The cellular communication simulation module is used to control the cellular signal strength of the system under test and to recreate typical network scenarios such as weak network and no network. The bus residual simulation module is used to realize the preconditions for upgrading the system under test and the node simulation through bus signal parameter configuration and node simulation, and at the same time realize serial writing in the same network segment and parallel writing in different network segments.

[0029] The bus residual simulation module implements the preconditions and node simulation for upgrading the system under test, and simultaneously realizes serial flashing within the same network segment and parallel flashing across different network segments. The specific process is as follows: Connect the hardware to load the network database file (such as DBC), configure the correct bus channel, and use C / Python programming to program the pre-send function to simulate dynamic signal values, thereby achieving the simulation effect of bus residual signals.

[0030] Furthermore, the system provided in this embodiment includes a test equipment module, an HMI touch simulation module, a server control module, a bus remnant simulation module, a cellular communication simulation module, a test script module, a test execution module, and a report output module. Overall, the test equipment module includes a programmable power supply, a TSMaster test device, a signal shielding device, the device under test (DUT), a bus data device, and a test script executor required for testing. The HMI touch simulation module connects via USB and Wi-Fi to achieve a series of controls such as human-machine interaction between the vehicle and mobile phone interfaces, image acquisition, video saving, and low-level signal acquisition. The server control module controls the cloud server through an API interface to achieve OTA task creation and publishing. The bus remnant simulation module simulates upgrade preconditions through bus signal simulation. The cellular communication simulation module simulates typical OTA upgrade communication scenarios through signal strength control. The test script module writes test scripts based on the test case set. The test execution module connects the test equipment, the DUT, and the test scripts, driving the test equipment through the test scripts to complete automated OTA upgrade testing. The report output module analyzes and statistically processes the automated test results and generates a test report.

[0031] Furthermore: such as Figure 2 As shown, the OTA upgrade testing system based on TSMaster software integrates a test equipment module, an HMI touch simulation module, a server control module, a bus remnant simulation module, a cellular communication simulation module, a test script module, a test execution module, and a report output module.

[0032] The integrated test equipment module includes a programmable power supply, TSMaster test equipment, signal shielding equipment, test sample, bus data device, and test script executor.

[0033] The HMI touch simulation module connects to the object under test via USB or WIFI and uses ADB commands to achieve a series of controls such as human-computer interaction, image acquisition, video saving, and low-level signal acquisition for vehicle and mobile phone interfaces.

[0034] The server control module controls the cloud server through the API interface, enabling control over OTA task creation and publishing.

[0035] The bus residual simulation module, through bus signal parameter configuration and node simulation, achieves the simulation of upgrade preconditions, Master node, and Client node, enabling serial writing within the same network segment and parallel writing across different network segments.

[0036] The upgrade prerequisites specifically refer to the following: prerequisites are divided into vehicle self-detection prerequisites (such as vehicle speed, battery level, etc.) and user confirmation prerequisites (such as whether the user agrees to the upgrade, etc.).

[0037] How to achieve the upgrade prerequisites: This embodiment simulates the vehicle self-detection prerequisites through bus residual signal simulation, and writes ADB commands to enable users to confirm the prerequisites.

[0038] This embodiment utilizes node simulation to simulate the Master node and Client node. The technical effect achieved is that, through node simulation, the functionality, performance, and quality of each link in the OTA upgrade system can be tested more quickly, efficiently, and comprehensively.

[0039] The technical effect of achieving serial writing within the same network segment and parallel writing across different network segments is as follows: (1) Serial writing within the same network segment effectively controls the bus load, avoids conflicts and overload, and improves the reliability and success rate of writing; (2) Parallel writing across different network segments greatly improves writing efficiency and enhances OTA automated testing efficiency.

[0040] The cellular communication simulation module controls the cellular signal strength by controlling the opening and closing angle of the shielding device, thus recreating typical network scenarios such as weak networks and no network.

[0041] The test script module, based on test case sets, automates the testing process. Configurable system parameter variables adapt to various component testing scenarios from different manufacturers. Configuration parameters include test duration, frame interval, frame data, ID address, and service. A file allows selection of service options based on the test case sequence number.

[0042] The test script covers both forward (condition met) and reverse (condition not met) tests for the following: Benefits: The test scripts cover both the forward and reverse processes of OTA business, with comprehensive dimensions and fine granularity, effectively ensuring OTA test coverage and improving the quality of OTA testing.

[0043] 1. Task release testing, including OTA upgrade platform login, creating upgrade tasks, releasing upgrade tasks, and releasing and deactivating tasks.

[0044] 2. Package download test, including upgrade package download in different network scenarios and resume interrupted download.

[0045] 3. Pre-installation verification process test, including touch screen installation, upgrade package verification, and Master check of installation conditions.

[0046] 4. Installation process testing, including full upgrade, differential upgrade, serial upgrade, parallel upgrade, and silent upgrade.

[0047] 5. Post-installation verification process testing, including upgrade result detection and upgrade result reporting.

[0048] 6. Rollback test for installation failure, including successful rollback and rollback failure.

[0049] The test execution module connects the test equipment, the device under test (DUT), and the test scripts. It drives the test equipment through the test scripts to complete automated OTA upgrade testing. Inputting selectable service option files facilitates the management and maintenance of test scripts, and allows for flexible specification of the execution script scope during the test.

[0050] The report output module generates highly readable and semantically meaningful test report templates based on the test scripts. The test reports include test results, specific times of test failures, problem triggering conditions, and comparisons between expected and actual test results. Formats include Word, PDF, and Excel.

[0051] like Figure 1 As shown, the OTA upgrade testing system based on TSMaster software provided in this embodiment includes an industrial control computer 3, a residual bus simulation board 4, an I / O board 5, and a fault injection board 6 inside a chassis 8. The interface under test 7 and a power supply 1 are located outside the chassis 8. The power supply 1 supplies power to the devices inside the chassis 8 via a rack power strip 2 and a switch 9. The industrial control computer 7 inside the chassis 8 is connected to the residual bus simulation board 4 via USB, and the industrial control computer 7 is also connected to the fault injection board 6 via USB. The residual bus simulation board 4 and the I / O board 5 are connected via communication. The residual bus simulation board 4, I / O board 5, and fault injection board 6 are respectively connected to the interface under test 7 for communication.

[0052] In this diagram, the red line represents the power supply connection, and the black line represents the communication connection.

[0053] Example 2 This embodiment discloses an OTA upgrade testing method based on TSMaster software.

[0054] The OTA upgrade testing method based on TSMaster software includes the following steps: The server control module connects to the cloud server via an API interface to enable the creation and publishing of OTA tasks; The cellular communication simulation module enables control over the cellular signal strength of the system under test, recreating typical network scenarios such as weak or no network. The bus residual simulation module realizes the preconditions for upgrading the system under test and the node simulation through bus signal parameter configuration and node simulation, and at the same time realizes serial writing in the same network segment and parallel writing in different network segments. The fault injection module injects fault signals into the system under test, realizing the injection of test scenarios under abnormal operating conditions; Select the test case sequence number of the test script module to enable the selection of the service option file; The test execution module executes the selected configuration service option file; The report output module outputs a test report. Example 3 The purpose of this embodiment is to provide a computer-readable storage medium.

[0055] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the OTA upgrade testing method based on TSMaster software as described in Embodiment 1 of this disclosure.

[0056] Example 4 The purpose of this embodiment is to provide an electronic device.

[0057] An electronic device includes a memory, a processor, and a program stored in the memory and executable on the processor. When the processor executes the program, it implements the steps in the OTA upgrade testing method based on TSMaster software as described in Embodiment 1 of this disclosure.

[0058] The steps and methods involved in the apparatuses of Embodiments 2, 3, and 4 above correspond to those in Embodiment 1. For specific implementation details, please refer to the relevant description section of Embodiment 1. The term "computer-readable storage medium" should be understood as a single medium or multiple media including one or more instruction sets; it should also be understood as including any medium capable of storing, encoding, or carrying an instruction set for execution by a processor and enabling the processor to perform any of the methods in this invention.

[0059] Those skilled in the art will understand that the modules or steps of the present invention described above can be implemented using general-purpose computer devices. Optionally, they can be implemented using computer-executable program code, thereby allowing them to be stored in a storage device for execution by a computer device, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. The present invention is not limited to any particular combination of hardware and software.

[0060] While the specific embodiments of the present invention have been described above in conjunction with the accompanying drawings, this is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art without creative effort based on the technical solutions of the present invention are still within the scope of protection of the present invention.

Claims

1. An OTA upgrade testing system based on TSMaster software, characterized in that, It includes an OTA testing system and a system under test. The OTA testing system includes a server control module, a cellular communication simulation module, and a bus remnant simulation module, wherein: The server control module is used to connect to the cloud server via an API interface to create and publish OTA tasks. The cellular communication simulation module is used to control the cellular signal strength of the system under test and to recreate typical network scenarios such as weak network and no network. The bus residual simulation module is used to realize the preconditions for upgrading the system under test and the node simulation through bus signal parameter configuration and node simulation, and at the same time realize serial writing in the same network segment and parallel writing in different network segments.

2. The OTA upgrade testing system based on TSMaster software as described in claim 1, characterized in that, The OTA testing system also includes a testing equipment module, which comprises a programmable power supply, signal shielding equipment, bus data equipment, a test script executor, and a TSMaster testing device, wherein: The programmable power supply is used to connect to the power supply of the system under test, and to realize abnormal operating condition input such as power on / off and voltage fluctuation. The signal shielding device is used to receive control signals from the cellular communication simulation module, change the opening and closing angle, and thus change the cellular signal strength of the system under test. The bus data device is used to receive control signals from the bus residual simulation module to realize bus signal parameter configuration and node simulation; The test script executor is used to execute test scripts.

3. The OTA upgrade testing system based on TSMaster software as described in claim 1, characterized in that, The OTA testing system also includes an HMI touch simulation module, which is used to connect to the system under test via USB or WIFI and control the human-computer interaction, image acquisition, video saving, and underlying signal acquisition of the vehicle and mobile phone interfaces through ADB commands.

4. The OTA upgrade testing system based on TSMaster software as described in claim 1, characterized in that, The OTA testing system also includes a test script module, which is written based on a test case set to automate the testing steps of the test cases. The test cases are set with configurable system parameter variables to adapt to various component testing scenarios from different manufacturers; Configurable system parameter variables include test duration, frame interval, frame data, ID address, and service; The test script module sets the test case sequence number, which is used to set the selection of the service option file.

5. The OTA upgrade testing system based on TSMaster software as described in claim 1, characterized in that, The OTA testing system also includes a test execution module, which is used to connect the test equipment module, the device under test in the system under test, and the test script. The test script drives the test equipment module to complete the automated OTA upgrade test. The OTA testing system also includes a report output module, which is used to output test reports. The test reports include test results, the specific time of test failure, the problem triggering conditions, and a comparison between the expected test results and the actual test results. The formats include Word, PDF, and Excel.

6. The OTA upgrade testing system based on TSMaster software as described in claim 1, characterized in that, The OTA testing system also includes a fault injection module, which is used to inject fault signals into the system under test to realize the injection of test scenarios under abnormal operating conditions.

7. The OTA upgrade testing system based on TSMaster software as described in claim 1, characterized in that, The system under test includes an OTA upgrade server, a test bench, and a vehicle infotainment screen / mobile phone; the test bench is an automated test integration environment, and the OTA upgrade server is set on the test bench.

8. An OTA upgrade testing method based on TSMaster software, characterized in that, Includes the following steps: The server control module connects to the cloud server via an API interface to enable the creation and publishing of OTA tasks; The cellular communication simulation module enables control over the cellular signal strength of the system under test, recreating typical network scenarios such as weak or no network. The bus residual simulation module realizes the preconditions for upgrading the system under test and the node simulation through bus signal parameter configuration and node simulation, and at the same time realizes serial writing in the same network segment and parallel writing in different network segments. The fault injection module injects fault signals into the system under test, realizing the injection of test scenarios under abnormal operating conditions; Select the test case sequence number of the test script module to enable the selection of the service option file; The test execution module executes the selected configuration service option file; The report output module outputs a test report.

9. A computer-readable storage medium having a program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps in the OTA upgrade testing method based on TSMaster software as described in claim 8.

10. An electronic device comprising a memory, a processor, and a program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps in the OTA upgrade testing method based on TSMaster software as described in claim 8.

Images