A portable automobile OTA automatic test method, device and storage medium

Abstract

The application relates to the technical field of intelligent networked vehicles and discloses a portable automobile OTA automatic test method and device and a storage medium. The method is based on an industrial power supply, a small industrial computer, a relay and a bus message transceiving module to construct a test system, and the industrial power supply module uniformly supplies power. The small industrial computer module first controls the bus message transceiving module to establish communication with a test product, sends bus test cases and repeats the sending to a preset number of times, then sends fault test cases, collects two types of data to generate first test information, then controls the relay module to establish control connection with the test product, sends control test instructions, collects action execution data to generate second test information, and finally integrates the two types of information to generate a test report. The application realizes OTA upgrade bus communication, fault tolerance and full-dimension automatic test of hardware interaction, is suitable for portable hardware design, breaks through the limitation of a traditional test scene, can flexibly carry out bench and real vehicle tests, and improves test efficiency.

Description

Technical Field

[0002] This application relates to the technical field of intelligent connected vehicles, and in particular to a portable vehicle OTA automated testing method, device, and storage medium. Background Technology

[0004] With the rapid development of intelligent connected vehicle technology, over-the-air (OTA) remote upgrades have become a core means of vehicle software iteration, function optimization, and fault repair. Its operational reliability directly affects driving safety, vehicle performance, and user experience. Automotive OTA automated testing, as a key link in ensuring the quality of OTA upgrades, can effectively cover the entire process, including upgrade package download, ECU flashing, and interactive verification. It avoids the drawbacks of manual testing, such as low efficiency, large errors, and incomplete coverage, while meeting functional safety and information security standards. This is of great significance for promoting the industrialization of intelligent vehicles.

[0005] Currently, existing automotive OTA automated testing primarily uses vertical racks as the carrier of test logic and data processing terminals, enabling automated testing of the entire OTA process. These racks typically integrate core hardware such as industrial PCs and bus message transceiver modules. The industrial PC is responsible for running test cases, controlling test logic, and processing and analyzing test data. The bus message transceiver module enables communication with the vehicle's bus, completing message monitoring, simulation, and acquisition. Combined with relevant testing software, it can automate OTA testing, meeting basic testing needs in laboratory settings.

[0006] While current vertical racks used for OTA automated testing offer reliable operational stability, accurate data collection and analysis, and ensured test results accuracy, effectively enabling laboratory testing and verification, their large size and weight severely limit mobility, requiring significant manpower and resources for transportation and deployment. This limitation typically confines them to a laboratory setting, requiring a LabCar bench to create a closed testing environment. This makes them unsuitable for real-world vehicle testing scenarios and hinders the verification of OTA upgrade reliability under real-world road conditions. Therefore, a miniaturized, portable testing device is urgently needed to overcome the limitations of existing testing scenarios while ensuring test results meet standard requirements. Summary of the Invention

[0008] To facilitate the reduction of the size of vertical OTA automated testing equipment and ensure that test results meet standard requirements, this application provides a portable automotive OTA automated testing method, device, and storage medium.

[0009] Firstly, this application provides a portable automated OTA testing method for automobiles, employing the following technical solution:

[0010] A portable automotive OTA automated testing method is based on an industrial control power supply module, a small industrial control computer module, a relay module, and a bus message transceiver module. The industrial control power supply module is used to power the small industrial control computer module, the relay module, and the bus message transceiver module. The method includes the following steps:

[0011] The small industrial computer module control bus message transceiver module establishes a communication connection with the test product;

[0012] The bus message transceiver module sends bus test cases to the test product based on the communication connection. The test product responds to the received bus test cases by returning bus test data to the bus message transceiver module, and repeats the test a preset number of times.

[0013] The bus message transceiver module sends fault test cases to the test product based on the communication connection, and the test product responds to the received fault test cases by returning fault test data to the bus message transceiver module;

[0014] The small industrial computer module generates the first test information based on bus test data and fault test data;

[0015] The small industrial computer module controls the relay module to establish a control connection with the test product. The relay module sends control test commands to the test product based on the control connection. The test product responds to the received control test commands by executing the corresponding control actions, generating execution action data, and returning the execution action data to the bus message transceiver module.

[0016] The small industrial computer module generates second test information based on the executed action data and control test instructions;

[0017] The small industrial computer module generates a test report based on the first test information and the second test information.

[0018] By adopting the above technical solution, a modular testing system is constructed based on industrial control power supplies, small industrial control computers, relays, and bus message transceiver modules. This system not only meets the miniaturization design requirements of portable testing devices and overcomes the limitations of traditional vertical cabinets, which have poor mobility and can only be adapted to laboratory bench tests, but also allows for flexible real-vehicle testing to verify the reliability of OTA upgrades under real working conditions. Furthermore, by completing a preset number of bus routine tests, fault injection tests, and relay hardware control tests in stages, the system comprehensively covers the core testing dimensions of OTA upgrades, such as bus communication, fault tolerance, and hardware interaction. Combined with the automated collection, analysis, and report generation of test data throughout the entire process by the small industrial control computer, the system effectively ensures the accuracy and comprehensiveness of test results, improves the efficiency of OTA automated testing, avoids the drawbacks of manual testing, and ensures that the standardized modular power supply and control logic meets the relevant functional safety and information security standards during the testing process.

[0019] Optionally, the step of the small industrial computer module generating the first test information based on the bus test data and fault test data further includes the following steps:

[0020] Obtain the corresponding group of bus test cases and bus test data in the current batch, and match the group of bus test cases with the bus test data;

[0021] If the match is successful, the test is considered successful, and the total number of successful tests in the current batch is the success count; otherwise, the test is considered a failure.

[0022] Calculate the success rate of the current batch = number of successful tests / number of tests, and generate test message information based on the success rate;

[0023] If the success rate is lower than the preset success reference value, a message test alarm will be generated and written into the message test information.

[0024] Store the message test information in the first test information.

[0025] By adopting the above technical solution, and through precise matching and verification of grouped bus test cases and test data, the effectiveness of a single bus test can be effectively determined. Combined with the preset number of tests, the test success rate is calculated and quantitative message test information is generated, providing an intuitive quantitative reference for the test results of the OTA upgrade bus communication dimension. At the same time, by setting a success reference value, when the pass rate is lower than the threshold, a message test alarm is automatically generated and relevant information is written, which can realize timely and accurate early warning of bus test anomalies and quickly identify potential problems in the bus communication link.

[0026] Optionally, the step of the small industrial computer module generating the first test information based on the bus test data and fault test data further includes the following steps:

[0027] The ratio of the calculated success rate to the success reference value is the first test ratio. The number of tests is adjusted negatively based on the first test ratio using a preset first parameter, where the first parameter is less than the preset adjustment parameter.

[0028] By adopting the above technical solution, the number of tests can be appropriately reduced when the success rate is high, effectively avoiding redundant testing and improving the execution efficiency of the bus testing process. When the success rate is low, the number of tests can be slightly increased to further verify the stability of bus communication through supplementary testing, ensuring the sufficiency and reliability of test data. At the same time, the limit setting of the first parameter can effectively constrain the adjustment range of the number of tests, avoiding test process disorder or unnecessary increase in test costs caused by a sudden increase or decrease in the number of tests, making the dynamic adjustment of the number of tests more stable and in line with actual test needs.

[0029] Optionally, the step of the small industrial computer module generating the first test information based on the bus test data and fault test data further includes the following steps:

[0030] Obtain the corresponding group of bus test cases and bus test data in the current batch, and match the group of bus test cases with the bus test data;

[0031] If the match is successful, the test is considered successful, and the time taken to pass the test is the success time; otherwise, the success time is 0.

[0032] Calculate the fluctuation and average values ​​of the elapsed time in the current batch, and generate message test information based on the average value;

[0033] If the fluctuation value is greater than the preset fluctuation reference value, a message test alarm will be generated and written into the message test information.

[0034] Store the message test information in the first test information.

[0035] By adopting the above technical solution, a new dimension of throughput time analysis is added to the bus test verification, breaking through the single-mindedness of judging the bus communication status solely by the test success rate. By calculating the average and fluctuation values ​​of throughput time, the average value quantifies the overall response efficiency of bus communication, while the fluctuation value accurately measures the operational stability of bus communication, making the evaluation dimensions of bus testing more comprehensive and the test results more referential. At the same time, when the fluctuation value exceeds the preset reference value, a message test alarm is automatically generated, which can promptly identify potential problems with abnormal fluctuations in bus communication time and accurately locate issues related to bus communication stability. In addition, the message test information including the time dimension is stored in the first test information, supplementing the subsequent overall test analysis and test report generation with detailed bus communication performance data.

[0036] Optionally, the step of the small industrial computer module generating the first test information based on the bus test data and fault test data further includes the following steps:

[0037] The ratio of the fluctuation value to the fluctuation reference value is calculated as the second test ratio. The number of tests is adjusted according to the second test ratio with a preset second parameter that is positively correlated with the second parameter. The second parameter is greater than the preset adjustment parameter.

[0038] By adopting the above technical solution, targeted and intensive testing is adapted to address the stability issues of bus communication. The greater the fluctuation in bus communication time, the more significant the increase in the number of tests. Supplementing sufficient test samples can fully collect bus communication status data, accurately identify potential hidden dangers in bus communication stability, and avoid misjudgment of bus communication status due to the randomness of a small amount of test data. When the fluctuation value is small, the number of tests will not be excessively increased, effectively balancing the sufficiency of testing and execution efficiency.

[0039] Optionally, the method further includes the following steps:

[0040] Multiple fault test cases are called from a pre-set fault test case library at once to perform fault simulation tests in sequence, and each fault test case is paired with the corresponding fault test data to form a group;

[0041] The corresponding values ​​of each set of fault test cases and fault test data are calculated based on the preset fault feedback library.

[0042] If the corresponding value of the content is less than the preset reference value, the corresponding value of the content is set to 0, and a fault test alarm is generated; then the next fault simulation test continues.

[0043] After the fault simulation test is completed, fault test data is generated based on the corresponding values ​​of all contents; if there is a fault test alarm, the fault test alarm is written into the fault test data.

[0044] By adopting the above technical solution, and sequentially calling multiple fault test cases from the fault test case library to conduct fault simulation tests, it is possible to comprehensively cover all possible fault scenarios during the OTA upgrade process, significantly improve the scenario coverage of fault testing, and fully verify the vehicle's tolerance to different faults during OTA upgrades. Based on the calculated corresponding values ​​of the preset fault feedback library, it provides a standardized and quantitative reference for judging fault test results, eliminating the drawbacks of subjective judgment and improving the accuracy and objectivity of fault test judgment. By setting reference corresponding values, setting them to 0 for cases below the threshold and generating fault test alarms in real time, it is possible to quickly and accurately identify abnormal response problems of OTA upgrades in fault scenarios and achieve timely early warning of potential faults.

[0045] Optionally, the step of the small industrial computer module generating the second test information based on the executed action data and control test instructions further includes the following steps:

[0046] The control test command corresponds to multiple actions to be executed and their corresponding execution order;

[0047] Identify multiple executed actions and their corresponding execution order from the action data;

[0048] The system performs a first match between the action to be executed and the action already executed. If the first match is successful, the system performs a second match between the order of execution and the order of execution. Otherwise, an execution action error alarm is generated and written into the second test information. The small industrial control computer module then resends the control test command.

[0049] If the second matching is successful, the execution action data and control test instructions are written into the second test information and the second test information is output. Otherwise, an execution sequence error alarm is generated, the execution sequence error alarm is written into the second test information, and the small industrial control computer module resends the control test instructions.

[0050] By adopting the above technical solution and employing a layered, two-stage matching and verification logic for actions and sequences, the integrity of the executed actions is verified first, followed by the standardization of the execution sequence. This allows for the precise differentiation and location of two types of problems in the hardware control interaction process: errors in the executed actions and errors in the execution sequence. This makes fault alarms more targeted and significantly improves the accuracy of hardware control test result judgment. For cases of matching failure, corresponding error alarms are generated and control test commands are resent. This allows for the timely detection of potential execution problems in the hardware control process. At the same time, verifying the execution effect after retrying by resending commands further enhances the rigor and reliability of the hardware control test process. After successful matching, the executed action data and control test commands are completely written into the second test information, which supplements the second test information with detailed and accurate hardware control execution data, providing reliable support for subsequent overall test analysis and report generation.

[0051] Optionally, the step of the small industrial computer module generating the second test information based on the executed action data and control test instructions further includes the following steps:

[0052] Before the small industrial computer module resends the control test command, it enters the independent industrial control test mode and randomly adjusts the execution order of the control test command until the number of retests is accumulated.

[0053] If the number of retests exceeds the preset maximum number of tests, stop resending control test commands and use the preset control error template as the second test information.

[0054] By adopting the above technical solution, an independent industrial control test mode is added before resending control test commands. Retry tests are conducted by randomly adjusting the execution order, rather than simply repeating the original commands. This fully verifies the adaptability and stability of hardware control execution under different action sequences, accurately identifies potential execution problems caused by the action sequence, and makes retry testing more targeted, significantly improving the comprehensiveness and rigor of hardware control testing. Simultaneously, by accumulating the number of retests and setting a maximum test threshold, problems such as test process lag and low test efficiency caused by unlimited command resending are effectively avoided, reasonably controlling test duration and cost, and making the execution process of hardware control testing more controllable. When the number of retests exceeds the threshold, a preset control error template is used as the second test information, ensuring the integrity of the second test information generation and the closed-loop nature of the test process, preventing the overall test process from being interrupted by continuous retries.

[0055] Secondly, this application provides a portable automotive OTA automated testing device, which adopts the following technical solution:

[0056] A portable automotive OTA automated testing device includes a processor that executes the steps of the portable automotive OTA automated testing method as described in any one of the preceding claims.

[0057] Thirdly, this application provides a storage medium, which adopts the following technical solution:

[0058] A storage medium storing a program that, when executed by a processor, implements the steps of the portable automotive OTA automated testing method described above.

[0059] In summary, this application includes at least one of the following beneficial technical effects: The portable automotive OTA automated testing method of this application relies on a modular hardware system built from an industrial control power supply, a small industrial computer, relays, and a bus message transceiver module. This system not only meets the requirements of portable design and overcomes the problems of poor mobility and limited testing scenarios inherent in traditional vertical cabinets, allowing for flexible laboratory bench testing and real-vehicle testing, effectively verifying the reliability of OTA upgrades under real-world conditions, but also comprehensively covers the core testing dimensions of OTA upgrades, such as bus communication, fault tolerance, and hardware interaction, through phased bus routine testing, fault injection testing, and relay hardware control testing. Furthermore, it utilizes quantitative verification, multi-dimensional analysis of success rate and response time, differentiated dynamic adjustment of test counts, and standardized fault scenarios. The design, including scene matching and judgment, makes test result judgment more accurate and data more complete. Various hierarchical alarm mechanisms can also identify potential problems in each stage of testing in a timely manner. The layered secondary matching verification, retry test with random adjustment order, and maximum test number threshold limit in the hardware control link have also improved the anomaly handling mechanism. This not only improves the comprehensiveness and rigor of hardware control testing, but also avoids redundant testing and test process bottlenecks, ensuring the closed-loop nature and execution efficiency of the test process. In addition, the entire process realizes the automated collection, analysis and report generation of test data, avoiding the drawbacks of low efficiency and large error of manual testing. The standardized test control logic also meets the relevant standards and requirements of functional safety and information security, which significantly improves the efficiency, comprehensiveness and reliability of automotive OTA automated testing. Attached Figure Description

[0061] Figure 1 This is a system architecture and hardware connection diagram of a portable automotive OTA automated testing device.

[0062] Figure 2 This is a schematic diagram of the overall structure of the chassis.

[0063] Figure 3 This is a wiring diagram of the chassis. Detailed Implementation

[0065] The embodiments of this application are described in detail below, and examples of the embodiments are shown in the accompanying drawings.

[0066] In the description of this specification, the references to "certain embodiments," "one embodiment," "some embodiments," "illustrative embodiment," "example," "specific example," or "some examples" refer to specific features, structures, materials, or characteristics described in connection with the described embodiment or example, which are included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0067] This application discloses a portable automotive OTA automated testing method, referring to... Figure 1 , Figure 2 and Figure 3 This system utilizes an integrated portable chassis for hardware support and process execution. The chassis features an aluminum metal shell, providing excellent anti-interference capabilities and portability. An integrated handle on the side allows for flexible adaptation to laboratory labcar bench testing and real-vehicle testing scenarios, effectively overcoming the limitations of traditional testing equipment's large size and poor mobility. The chassis's interior is divided into independent cavities by modular partitions, integrating an industrial control power supply module, a small industrial computer module, a relay module, and a bus message transceiver module. The modules are rationally laid out and work in tandem, providing a stable and reliable hardware foundation for the entire testing process.

[0068] The industrial control power module is powered by an external 220V power supply and provides stable power support to all devices in the chassis via a built-in 220V to 12V adapter, which is the basic guarantee for the normal operation of each module. The small industrial control computer module serves as the core control unit, coordinating and scheduling the entire process test logic. Its built-in wireless network card enhances signal transmission and reception capabilities through the chassis antenna, enabling it to access the vehicle cloud platform of the original equipment manufacturer (OEM) and perform cloud operations. The reserved USB interface can be directly connected to the vehicle's USB channel to realize functions such as ADB command sending, vehicle interface operation, and log collection. The network port is used for stable data interaction and program debugging. The bus message transceiver module is integrated in the chassis, providing multiple CAN / CANFD channels. It connects to the vehicle's OBD port through a standardized DB25 interface to accurately complete the transmission and reception of bus messages and data acquisition. The relay module also establishes a connection with key control nodes on the vehicle (such as key switches, brake switches, start-stop switches, etc.) through a DB25 interface, and is responsible for the automated hardware interaction control of the preconditions for OTA upgrades.

[0069] Based on an industrial control power supply module, a small industrial control computer module, a relay module, and a bus message transceiver module, the industrial control power supply module is used to supply power to the small industrial control computer module, the relay module, and the bus message transceiver module; the method includes the following steps:

[0070] The small industrial computer module controls the bus message transceiver module to establish a communication connection with the test product: The small industrial computer module sends a communication connection command to the bus message transceiver module. After receiving the command, the bus message transceiver module establishes a CAN / CANFD bus communication connection with the test product (vehicle under test / automotive electronic controller) through standardized communication ports such as the vehicle-side OBD interface. At the same time, it completes the connectivity and stability verification of the communication link to ensure the stable transmission of subsequent test cases and the effective reception of test data.

[0071] The bus message transceiver module sends bus test cases to the test product based on the communication connection. The test product responds and returns bus test data, repeating this process for a preset number of times. After the communication connection is verified to be correct, the bus message transceiver module sends OTA upgrade bus communication routine test cases to the test product according to the preset instructions of the mini industrial computer module. These test cases cover common application scenarios such as bus data transmission, command interaction, and status feedback during the OTA upgrade process. After receiving the bus test cases, the test product responds accordingly according to its own OTA operation logic, generates bus test data containing communication status and data transmission results, and sends it back to the bus message transceiver module through the established bus communication link. The bus message transceiver module uploads the received bus test data to the mini industrial computer module for storage in real time. The above sending-response-return-storage process is executed cyclically until the preset number of tests by the mini industrial computer module is reached, completing the data acquisition work for the routine bus test.

[0072] The bus message transceiver module sends fault test cases to the test product via the communication connection. The test product responds and returns fault test data. After the bus routine test is completed, the small industrial computer module sends a fault test execution command to the bus message transceiver module. The bus message transceiver module sends fault test cases to the test product according to the command. These test cases cover fault scenarios that may occur during OTA upgrades, such as bus communication interruption, data transmission anomalies, and command parsing errors. After receiving the fault test cases, the test product triggers its own fault response mechanism to generate fault test data containing fault response status and fault handling results. This data is then transmitted back to the bus message transceiver module via the bus communication link. The bus message transceiver module uploads the fault test data to the small industrial computer module for storage in real time, completing the data acquisition work for fault injection testing.

[0073] The small industrial computer module generates the first test information based on the bus test data and fault test data: The small industrial computer module retrieves all the stored bus test data and fault test data, organizes, verifies and extracts the core indicators of the two types of data according to the preset data analysis logic, analyzes the bus communication stability, data transmission accuracy and fault tolerance of the test product during the OTA upgrade process, and generates the first test information covering the two dimensions of bus communication and fault tolerance. After completion, the first test information is stored.

[0074] The small industrial PC module controls the relay module to establish a control connection with the test product. The relay module sends control test commands, and the test product executes the actions and returns the execution action data. After the first test information is generated, the small industrial PC module sends a control connection command to the relay module. After receiving the command, the relay module establishes a connection with the hardware control port related to OTA upgrades of the test product. The connection range covers key hardware components that affect OTA upgrades, such as key switches, brake switches, and start / stop switches. After the control connection is established, the relay module sends control test commands to the test product according to the preset commands of the small industrial PC module. After receiving the command, the test product executes the corresponding hardware control actions, generates execution action data containing the action execution status and execution results, and transmits the data back to the small industrial PC module for storage through the bus message transceiver module.

[0075] The small industrial computer module generates second test information based on the execution action data and control test instructions: The small industrial computer module retrieves the stored execution action data and corresponding control test instructions, performs data and instruction matching and verification, analyzes the accuracy of the test product's execution of hardware control instructions and the standardization of action execution, generates second test information covering the hardware interaction control dimension, and stores the second test information after completion.

[0076] The small industrial computer module generates a test report based on the first and second test information: The small industrial computer module fully integrates the stored first and second test information, extracts the core results, abnormal data, key indicators and other contents of each test dimension, and generates a complete automotive OTA automation test report according to the preset standardized report template. The report clearly presents the test status of the test product in the core dimensions of bus communication, fault tolerance and hardware interaction during the OTA upgrade process, providing detailed and complete basis for OTA upgrade quality verification and optimization.

[0077] By adopting the above technical solution, this application constructs a modular and miniaturized testing system based on an industrial control power supply module, a small industrial control computer module, a relay module, and a bus message transceiver module. This perfectly meets the design requirements of portable testing devices, completely overcoming the limitations of traditional vertical cabinets—large size, poor mobility, and the inability to be fixed in a laboratory for bench testing. It can be flexibly deployed in laboratory labcar bench testing and real-vehicle testing scenarios, effectively verifying the operational reliability of vehicle OTA upgrades under real road and operating conditions, significantly expanding the application scope of automotive OTA testing. Simultaneously, this method achieves comprehensive coverage of the three core testing dimensions of bus communication, fault tolerance, and hardware interaction during OTA upgrades by sequentially completing a preset number of bus routine tests, fault injection tests, and relay hardware control tests in stages, ensuring no omissions in test scenarios or dimensions. The small industrial control computer module, as the core control unit, coordinates the automated acquisition, real-time storage, and professional analysis of test data throughout the entire process. The entire testing process requires no manual intervention, effectively avoiding the technical drawbacks of low efficiency, large human error, and incomplete test scenario coverage in manual testing, significantly improving the execution efficiency of automated automotive OTA testing. In addition, the entire testing system adopts standardized modular power supply logic and module scheduling control logic. The workflow of each module follows the relevant industry standards for automotive functional safety and information security, ensuring the standardization and safety of the testing process and fully guaranteeing the accuracy, comprehensiveness and reliability of the test results.

[0078] In the step of generating the first test information based on bus test data and fault test data by the aforementioned small industrial control computer module, this application embodiment also provides a preferred implementation method. This method further improves the accuracy and reference value of the bus communication dimension data in the first test information through precise matching and verification, quantitative statistics, and anomaly warnings of bus test cases and test data. Specific supplementary steps are as follows:

[0079] The small industrial computer module retrieves all bus test cases in the current batch from the local storage unit, as well as the corresponding bus test data returned by the test product for each test case. According to the sending time sequence of the bus test cases, each bus test case is matched one-to-one with the bus test data returned by the test product in the same round, and grouped together to form multiple sets of uniquely matched "test case-test data" pairs. This ensures that each set of data is the instruction and response data in the same test round, avoiding verification errors caused by data misalignment from the source.

[0080] The small industrial control computer module performs matching and verification operations on each group of bus test cases and bus test data according to the preset automotive OTA bus communication verification rules. It verifies whether the core contents such as the communication connection status, data transmission results, and command response results fed back in the bus test data are consistent with the preset command requirements and expected response standards of the bus test cases. If the verification result is consistent, the bus test is determined to have passed. The small industrial control computer module accumulates the number of times the test has passed in the current batch in real time through its built-in counting module to obtain the number of times the test has passed in the batch. If the verification result is inconsistent, the bus test is directly determined to have failed, and the number of times the test has passed is not accumulated. At the same time, the test round, test case information, and basic data of the failed test are recorded simultaneously to provide the original basis for subsequent troubleshooting.

[0081] The small industrial computer module calculates the success rate of the bus test for the current batch precisely according to the preset quantitative calculation formula "success rate = number of passes / number of tests". The number of tests is the total number of bus test loops preset above. After the calculation is completed, the small industrial computer module standardizes and organizes the core quantitative indicators such as the success rate, the total number of tests for the current batch, and the actual number of passes, and generates message test information that can intuitively reflect the pass status of bus communication test.

[0082] The small industrial control computer module compares the calculated actual success rate with a preset success reference value in real time. This success reference value can be flexibly set and adjusted according to the industry standards for automotive OTA testing, the technical specifications of the product under test, and actual testing needs. If the actual success rate is lower than the success reference value, it indicates that there is a significant anomaly in the current batch of bus communication tests. The small industrial control computer module automatically triggers the built-in alarm mechanism, generating a message test alarm containing key information such as the anomaly type, actual success rate value, preset reference threshold, and failed test rounds. This message test alarm is completely written into the aforementioned generated message test information, achieving synchronous recording of anomaly information and quantitative data. If the actual success rate is not lower than the success reference value, only the core quantitative indicators are included in the message test information, and the alarm mechanism is not triggered.

[0083] The small industrial computer module integrates complete message test information, including quantitative indicators and message test alarms, and stores it in the first test information according to the preset storage classification rules. This serves as the core data support for the bus communication dimension of the first test information, and together with the relevant analysis data of the fault tolerance dimension, it constitutes the complete first test information.

[0084] By adopting the above-mentioned preferred technical solution, the small industrial control computer module performs one-to-one precise matching and verification of grouped bus test cases and test data. Starting from a single round of testing, it can effectively determine the execution validity of each bus test, avoiding misjudgments of test results caused by data misalignment and inconsistent responses from the source, and significantly improving the accuracy of bus communication test verification. At the same time, by combining the preset number of tests, the number of passes is statistically analyzed and the success rate is calculated, transforming the bus communication test results into intuitive quantitative values. This provides clear and comparable quantitative reference for the test results of the bus communication dimension of OTA upgrades, making it easier for testers to quickly grasp the overall qualification status of bus communication. Furthermore, by setting a flexibly adjustable success reference value as an anomaly judgment threshold, a message test alarm containing key anomaly information is automatically generated and written when the actual success rate is lower than the threshold. This enables timely and accurate early warning of bus test anomalies, allowing testers to quickly locate potential problems and specific failure cycles in the bus communication process, significantly improving the efficiency of subsequent problem investigation. The complete message test information, as the core component of the first test information, also provides detailed and accurate bus communication dimension data support for subsequent overall test analysis and test report generation, further ensuring the integrity, reliability, and reference value of the first test information.

[0085] After completing the bus test success rate calculation, message test alarm determination, and message test information generation, this application embodiment also provides another preferred implementation method. By dynamically and controllably adjusting the number of tests, a balance optimization between bus test efficiency and test data sufficiency is achieved, further adapting to the test requirements under different bus communication states. This method serves as a supplementary step for the small industrial control computer module to generate the first test information based on bus test data and fault test data. The specific operation is as follows:

[0086] Calculate the first test ratio: The small industrial control computer module retrieves the actual success rate of the current batch of bus tests calculated in the previous steps, as well as the pre-configured success reference value. Using its built-in calculation module, it calculates the first test ratio according to the formula: First Test Ratio = Actual Success Rate / Success Reference Value. The value of the first test ratio directly reflects the degree to which the current bus test success rate meets the preset pass standard. The closer the ratio is to 1 or even greater than 1, the more stable the bus communication status and the higher the test pass rate; the smaller the ratio, the more unstable the bus communication status and the lower the test pass rate. The aforementioned success reference value can be pre-configured according to the industry standards for automotive OTA bus testing, the technical specifications of the product under test, and the actual testing scenario requirements, or it can be flexibly adjusted during the testing process.

[0087] The number of tests is dynamically adjusted according to the rules: The small industrial computer module is pre-configured with a first parameter (the test number adjustment coefficient) and a set adjustment parameter (the upper limit of the threshold of the adjustment coefficient). The value of the first parameter is always less than the set adjustment parameter (for example, the set adjustment parameter is 0.3 and the first parameter is configured to be 0.2). Both are constants greater than 0 and can be configured independently before testing according to the test accuracy requirements and test duration plan.

[0088] The module dynamically adjusts the preset number of subsequent bus tests according to the rule that the first test ratio is negatively correlated with the number of tests:

[0089] When the first test ratio is large (i.e., the actual success rate is high and the bus communication status is stable), the number of tests should be reduced appropriately to avoid meaningless redundant tests and improve test efficiency.

[0090] When the first test ratio is small (i.e., the actual success rate is low and the bus communication status fluctuates), the number of tests is slightly increased to supplement the test samples and further verify the stability of the bus communication.

[0091] The specific adjustment formula can be expressed as follows:

[0092] Adjusted number of tests = original preset number of tests × (1 - first parameter × (first test ratio - 1));

[0093] For example: if the original preset number of tests is 200, the success reference value is 90%, and the actual success rate is 95%, then the first test ratio is approximately 1.056, and the adjusted number of tests is approximately 200 × (1 - 0.2 × (1.056 - 1)) ≈ 198, slightly reducing the number of tests;

[0094] If the actual success rate is 70%, then the first test ratio is approximately 0.778, and the number of tests after adjustment is approximately 200 × (1 + 0.2 × (1 - 0.778)) ≈ 209 times, slightly increasing the number of tests.

[0095] The adjusted number of tests will serve as the basis for subsequent bus tests, and the adjustment process, parameter values, and results will be recorded synchronously in the message test information to achieve traceability of test strategy adjustments.

[0096] Through this mechanism, this application achieves precise adaptation between the number of tests and the bus communication status: compressing test duration when communication is stable and strengthening verification when communication is abnormal, effectively balancing test efficiency and data reliability. Simultaneously, ensuring the first parameter is less than the limit of the set adjustment parameter fundamentally constrains the adjustment range of the number of tests, avoiding process disruptions or cost overruns caused by sudden increases or decreases in the number of tests, ensuring a smooth and controllable testing process that aligns with actual testing needs.

[0097] This application also provides a preferred embodiment, which adds the analysis dimension of bus test pass time during the generation of first test information. This breaks through the limitation of judging bus communication status solely based on success rate, further improving the evaluation system of bus communication testing and making the bus communication dimension data of the first test information more comprehensive and more referential. This method serves as a supplementary step for the small industrial control computer module to generate first test information based on bus test data and fault test data. The specific operation is as follows:

[0098] Grouped Retrieval and Matching Verification: The small industrial control computer module retrieves the "bus test case - bus test data" pairs that have been matched one-to-one within the current batch from the local storage unit. According to the preset automotive OTA bus communication verification rules, it performs a matching verification operation on each group of data to check whether the response integrity, data transmission accuracy, and instruction execution results of the bus test data are consistent with the preset requirements of the bus test cases. This matching verification rule is consistent with the bus test validity determination rule to ensure the consistency of the single test status determination.

[0099] Single-pass time calculation and assignment: The small industrial computer module uses a built-in high-precision timing module to calculate the pass time for a single bus test that passes the matching verification. The statistical range of this pass time is: from the time node when the bus message transceiver module sends the bus test case to the test product, to the time node when the bus message transceiver module receives the valid bus test data returned by the test product and completes the data integrity verification. The time difference between the two nodes is the actual pass time of the test. The small industrial computer module accurately records this value. If a set of "bus test case - bus test data" fails the matching verification, the pass time of the test is directly assigned to 0. At the same time, the round of the test and the reason for failure are recorded. This part of the 0 value data will be regarded as invalid data and will not participate in the subsequent time dimension statistical analysis.

[0100] By calculating time fluctuation values ​​and average values, message test information is generated: The small industrial control computer module first filters all pass time data for the current batch, removing invalid data with a value of 0, and retaining only the valid pass time data that matches the passed data. Then, statistical calculations are performed on the valid pass time data. First, the average pass time of the current batch is calculated according to the formula: average = sum of all valid pass times / number of valid tests. This average value directly and quantitatively reflects the overall response efficiency of bus communication during the OTA upgrade process of the tested product. Second, according to the accuracy requirements of automotive OTA testing, the fluctuation value of the valid pass time data is calculated. This fluctuation value can use commonly used statistical indicators such as standard deviation and variance to accurately reflect the dispersion of bus communication time in each valid test. The larger the fluctuation value, the more unstable the bus communication response time; conversely, the smaller the fluctuation value, the more stable the communication time. After the calculation is completed, the small industrial control computer module standardizes and organizes the core time dimension quantitative indicators such as the average pass time, fluctuation value, number of valid tests, and details of valid pass time to generate message test information.

[0101] Fluctuation value comparison and alarm information writing: The small industrial control computer module compares the calculated actual fluctuation value with the preset fluctuation reference value in real time. This fluctuation reference value is pre-configured according to the industry response standards of intelligent connected vehicle OTA bus communication, the technical specifications of the product under test, and the actual test scenario requirements, and can be flexibly adjusted according to test requirements. If the actual fluctuation value is greater than the preset fluctuation reference value, it indicates that there is a significant abnormal fluctuation in the bus communication time of the test product, and the bus communication stability does not meet the standard. The small industrial control computer module automatically triggers the built-in alarm mechanism, generates a message test alarm containing key information such as the abnormality type, actual fluctuation value, preset fluctuation reference threshold, and effective pass time dispersion details, and writes the alarm information completely into the aforementioned generated message test information to achieve synchronous recording of time dimension abnormal information and quantitative indicators. If the actual fluctuation value is not greater than the fluctuation reference value, it indicates that the bus communication time fluctuation is within the acceptable range. Only the core quantitative indicators of the time dimension are included in the message test information, and the alarm mechanism is not triggered.

[0102] The message test information is stored in the first test information: The small industrial control computer module integrates the complete message test information, which includes quantitative indicators such as the average value of the time, the fluctuation value, and the message test alarm. According to the preset storage classification rules, it is stored in the first test information. Together with the bus test success rate dimension data and the fault tolerance dimension data, it constitutes the complete first test information, and completes the collection of bus communication time dimension data into the first test information.

[0103] By adopting the aforementioned preferred technical solution, this application adds a core analytical dimension of pass time to the bus test success rate verification, completely overcoming the limitation of judging bus communication status solely based on test success rate. It constructs a dual bus communication evaluation system combining success rate and time performance. The average pass time accurately and quantitatively reflects the overall response efficiency of bus communication during OTA upgrades of the tested product, providing an intuitive time-based reference for bus communication performance evaluation. Meanwhile, the fluctuation value accurately measures the stability of bus communication time consumption, allowing testers to deeply judge the operational status of bus communication from the perspective of time consumption dispersion. This makes the evaluation dimensions of bus testing more comprehensive and the test results more referential. Simultaneously, by setting a preset fluctuation reference value as an anomaly judgment threshold, when the actual fluctuation value exceeds the threshold, a test alarm containing key details is automatically generated and written. This enables timely and accurate identification of potential problems with abnormal bus communication time consumption fluctuations, helping testers quickly locate specific issues related to bus communication stability and improving the efficiency of subsequent problem investigation and optimization. In addition, the message test information, which includes time-dimensional quantitative indicators and abnormal alarm information, is stored in the first test information. This supplements the first test information with detailed bus communication performance data, making the content of the first test information more complete and the data dimensions richer. It also provides multi-dimensional and accurate data support for subsequent overall test analysis, test report generation, and OTA upgrade solution optimization, further ensuring the comprehensiveness and reference value of the test results.

[0104] After completing the calculation of bus test pass time fluctuation value and the judgment of abnormal fluctuation alarm, this application embodiment further provides a preferred implementation method. This method achieves targeted and differentiated dynamic adjustment of the number of tests to address bus communication stability issues. By intensively adapting the number of tests to supplement sufficient test samples, it accurately identifies potential stability problems. This method serves as a supplementary step for the small industrial control computer module to generate the first test information based on bus test data and fault test data. The specific operation is as follows:

[0105] The second test ratio is calculated as follows: The small industrial control computer module retrieves the actual fluctuation value of the current batch bus test pass time calculated in the previous steps from the local storage unit, as well as the fluctuation reference value configured in advance according to the intelligent connected vehicle OTA bus communication industry standard and the technical specifications of the product under test. The built-in calculation module then performs a precise calculation using the formula: Second Test Ratio = Actual Fluctuation Value / Fluctuation Reference Value. The value of the second test ratio directly reflects the degree of deviation of the current bus communication time fluctuation from the preset pass standard. A ratio greater than 1 indicates that the actual fluctuation exceeds the pass threshold, indicating a problem with bus communication stability; the larger the ratio, the more severe the fluctuation anomaly. A ratio less than 1 indicates that the actual fluctuation is within the pass range; the smaller the ratio, the more stable the bus communication time. The aforementioned fluctuation reference value can be configured independently before testing according to the test scenario (bench / real vehicle) and test accuracy requirements, and can also be flexibly adjusted during testing.

[0106] The test count is dynamically adjusted according to a positive correlation rule: The small industrial computer module retrieves a pre-configured second parameter and a set adjustment parameter. The second parameter is an adjustment coefficient for the number of tests to address bus communication stability issues, and the set adjustment parameter is the lower threshold of the adjustment coefficient. The value of the second parameter is always greater than the set adjustment parameter, and both are constants greater than 0. This can be configured in advance according to the testers' needs for investigating potential stability issues and planning the test duration. The small industrial computer module dynamically adjusts the preset number of subsequent bus tests according to the positive correlation between the second test ratio and the number of tests. A larger second test ratio indicates more severe fluctuations in bus communication time and poorer stability, requiring a larger increase in the original preset number of tests; conversely, a smaller second test ratio indicates less fluctuations in bus communication time and better stability, requiring a smaller increase in the original preset number of tests. This achieves a precise match between the number of tests and the bus communication stability issue.

[0107] In this step, the calculation basis for the number of tests after adjustment is the original preset number of tests. The specific adjustment formula can be configured as follows: number of tests after adjustment = number of tests after preset × (1 + second test ratio × second parameter). The calculation and adjustment of all parameters are automatically completed by the small industrial control computer module. The number of tests after adjustment will serve as the basis for subsequent bus tests. The adjustment process, parameter values, and adjustment results will be synchronously and completely recorded in the message test information to achieve traceability of test parameter adjustment.

[0108] The adjustment results are aggregated into the first test information: The small industrial control computer module integrates the adjustment basis, calculation process, and adjusted values ​​of the number of tests with the aforementioned average pass time, fluctuation value, and alarm information, updates the message test information, and stores the updated message test information into the first test information according to the preset storage rules, thus completing the final aggregation of this dimension of data into the first test information.

[0109] Specific implementation examples:

[0110] In this embodiment, for the OTA bus communication test of a certain intelligent connected vehicle, the following parameters are pre-configured: the adjustment parameter is set to 0.2, the second parameter is 0.5 (to meet the requirement that the second parameter is greater than the set adjustment parameter), the bus test pass time fluctuation reference value is 40ms (using standard deviation as the fluctuation value statistical index), and the original preset number of tests is 200.

[0111] Scenario 1: If the actual fluctuation in the bus test pass time for the current batch is 60ms, the calculated second test ratio is 60 / 40 = 1.5. According to the adjustment formula, the number of tests after adjustment is 200 × (1 + 1.5 × 0.5) = 200 × 1.75 = 350 times. In this case, the actual fluctuation exceeds the acceptable threshold, indicating poor bus communication stability. By significantly increasing the number of tests and adding 150 test samples, sufficient bus communication status data can be collected to accurately identify potential problems with abnormal fluctuations and avoid misjudgments of the bus communication status due to the randomness of a small amount of test data.

[0112] Scenario 2: If the actual fluctuation in the bus test pass time for the current batch is 30ms, the calculated second test ratio is 30 / 40 = 0.75. According to the adjustment formula, the number of tests after adjustment is 200 × (1 + 0.75 × 0.5) = 200 × 1.375 = 275 times. In this case, the actual fluctuation is within the acceptable range, and the bus communication stability is good. Only a slight increase in the number of tests is needed to moderately verify stability while avoiding efficiency losses caused by excessive testing, effectively balancing test sufficiency and execution efficiency.

[0113] By adopting the above preferred technical solutions, the present application quantifies and evaluates the abnormality degree of the fluctuation of the bus communication time consumption by means of the second test ratio, and dynamically adjusts the number of tests in a positive correlation manner with a second parameter greater than the set adjustment parameter, completing a targeted and substantial adaptation of the number of tests for the bus communication stability problem: when the fluctuation of the bus communication time consumption is greater, the second test ratio is higher, and the increase amplitude of the number of tests is more obvious. It can fully and comprehensively collect the status data of the bus communication by supplementing a sufficient number of test samples, accurately identify potential hidden dangers in the bus communication stability, and completely avoid misjudgment of the test results caused by the contingency of a small amount of test data, ensuring the accuracy of the determination of the bus communication stability; when the fluctuation of the bus communication time consumption is small, the second test ratio is low, and the number of tests is only slightly increased or even hardly increased, which will not cause excessive testing, effectively taking into account the execution efficiency of the bus test link while completing the stability verification. At the same time, the second parameter is greater than the limit requirement of the set adjustment parameter, ensuring that the adjustment strength for the stability problem can meet the requirements of hidden danger investigation, forming a differentiated parameter adjustment logic compared with the前述 small-amplitude negative correlation adjustment for the success rate, enabling the dynamic adjustment of the number of tests to adapt different adjustment strategies according to different problem types in the bus test, better meeting the requirements of problem investigation and efficiency optimization in actual testing, and further enhancing the scientificity and pertinence of the bus test link. In addition, all the data in the whole process of the adjustment of the number of tests are synchronously recorded in the message test information and aggregated into the first test information, providing a detailed reference basis for the subsequent review of the test results and the optimization of the test parameters, further ensuring the integrity and reference value of the first test information.

[0114] The embodiment of the present application further optimizes and improves the foregoing fault injection test link. By presetting a fault case library and a fault feedback library, it realizes the standardized and automated execution of the fault simulation test and the quantitative and objective determination of the fault test results. At the same time, through an abnormal alarm mechanism, it realizes the timely identification of fault hidden dangers. This part is an optional supplementary step of this test method, which is connected after the bus message transceiver module obtains the fault test data and before the small industrial control computer module generates the first test information. The specific operation steps are as follows:

[0115] Fault Test Case Retrieval and Data Grouping: The mini-industrial PC module has a pre-built fault test case library. This library contains corresponding fault test cases based on various fault scenarios that may occur during the entire OTA upgrade process of intelligent connected vehicles. It covers typical fault types during OTA upgrades, such as bus communication interruption, data transmission packet loss, command parsing errors, and abnormal network latency. It also supports adding, deleting, or modifying fault test cases according to testing needs. During the fault injection testing phase, the mini-industrial PC module controls the bus message transceiver module to retrieve multiple fault test cases from the fault test case library at once and send them to the test product sequentially according to a preset test order to conduct fault simulation testing. After each fault test case is sent, once the bus message transceiver module receives the corresponding fault test data returned by the test product, the mini-industrial PC module immediately pairs the fault test case with the corresponding fault test data one-to-one, forming a unique "fault test case - fault test data" pair. It records the test round, sending, and receiving times for each data pair to ensure that the correspondence between the fault test cases and the feedback data is accurate, providing accurate raw data for subsequent result determination.

[0116] The content correspondence value is calculated based on the fault feedback library: The small industrial computer module has a pre-built fault feedback library, which stores standard fault feedback data corresponding to all fault test cases in the fault test case library. It also pre-sets quantitative judgment rules for content matching and execution logic for the query correspondence method, serving as a standardized basis for judging fault test results. For each pair of "fault test case - fault test data," the small industrial computer module calculates the content correspondence value using the query correspondence method: First, it accurately queries the corresponding standard fault feedback data in the fault feedback library based on the current fault test case; then, according to the pre-set quantitative judgment rules in the fault feedback library, it matches the actual returned fault test data with the standard fault feedback data dimension by dimension, considering factors such as data response type, fault handling result, status feedback content, and instruction feedback logic. The built-in calculation module calculates the matching degree between the two, and the quantified value of this matching degree is the content correspondence value. The value range of the content correspondence value can be preset to 0-1 or 0-100. A higher value indicates a higher matching degree between the actual fault feedback and the standard feedback, and the test product's response and handling of this type of fault are more in line with expectations.

[0117] Content correspondence value comparison, setting to 0, and fault alarm generation: The small industrial computer module is pre-configured with reference correspondence values ​​based on industry standards for automotive OTA fault tolerance testing and the technical specifications of the product under test. This value is the pass threshold for content correspondence values ​​and can be flexibly adjusted according to the test scenario and accuracy requirements. The small industrial computer module compares the actual content correspondence value calculated for each set of data with the preset reference correspondence value in real time. If the actual content correspondence value is less than the reference correspondence value, it indicates that the test product's response or handling of this type of fault does not meet expectations and there is a problem with insufficient fault tolerance. At this time, the small industrial computer module directly sets the content correspondence value of this set of data to 0 and automatically triggers the alarm mechanism to generate a fault test alarm. The alarm information includes key information such as the fault test case type, actual content correspondence value, preset reference correspondence value, test round, and differences between the actual fault feedback data and the standard feedback data, which facilitates subsequent troubleshooting. After the alarm is generated, the test process is not interrupted, and the small industrial computer module continues to control the bus message transceiver module to execute the next fault simulation test.

[0118] Fault test data integration and alarm information writing: The fault simulation test process ends after all fault test cases retrieved in the fault test case library have completed simulation testing and all "fault test case - fault test data" pairs have completed content correspondence value calculation and comparison; the small industrial control computer module summarizes the content correspondence values ​​of all groups, standardizes and organizes core quantitative indicators such as the distribution of content correspondence values, average values, and corresponding value results of each fault type, and generates fault test data; if one or more fault test alarms are generated during this fault simulation test, the small industrial control computer module writes all alarm information completely and orderly into the fault test data, while marking the fault type and test round corresponding to the alarm, realizing the integrated integration of fault test quantitative data and abnormal alarm information.

[0119] After completing the above steps, the small industrial computer module will integrate the fault test data containing alarm information with the aforementioned message test information to jointly generate the first test information, providing complete and accurate data support for the fault tolerance dimension of the first test information.

[0120] By adopting the above-mentioned preferred technical solution, this application achieves comprehensive coverage of various typical fault scenarios during OTA upgrades by retrieving multiple fault test cases from a pre-set fault test case library at once and conducting tests sequentially. This significantly improves the scenario coverage and testing efficiency of fault testing, and can fully and comprehensively verify the OTA upgrade tolerance of the test product under different fault scenarios, ensuring that the test results can truly reflect the actual fault response level of the product. At the same time, based on the pre-set fault feedback library and the corresponding value calculated by the query correspondence method, a standardized and quantitative reference basis is established for the judgment of fault test results. The matching degree of fault feedback is transformed into an intuitive numerical indicator, completely eliminating the drawbacks of subjective human judgment and significantly improving the accuracy and objectivity of fault test result judgment. Furthermore, by setting a reference value as a pass / fail threshold, the corresponding value of any content below the threshold is set to 0, and a fault test alarm containing key difference information is generated immediately. This enables rapid and accurate identification of abnormal responses and improper handling of the tested product in fault scenarios, achieving timely early warning of potential faults. Moreover, the test process is not interrupted after the alarm is triggered, balancing anomaly identification and test efficiency. After the test, all corresponding values ​​and alarm information are integrated into fault test data, supplementing the initial test information with detailed and complete fault tolerance dimension data. This also provides precise guidance for subsequent test report generation and optimization of the product's OTA fault tolerance capabilities, further ensuring the comprehensiveness and reliability of the entire OTA automated test.

[0121] This application optimizes the steps for generating second test information in a small industrial computer module. It employs a hierarchical, secondary matching and verification logic based on action-sequence layers to accurately locate execution problems and generate alarms during hardware control testing. This further improves the accuracy of the second test information's feedback to the hardware interaction process. This step is an optional supplementary step for generating the second test information, following the transmission of execution action data from the bus message transceiver module to the small industrial computer module. The specific operation steps are as follows:

[0122] Parsing the control test command and extracting the actions to be executed and their execution sequence: The small industrial computer module retrieves the control test command previously issued to the relay module. This command is a standardized command adapted to the hardware control requirements of automotive OTA upgrades. It contains multiple hardware actions to be executed related to the preconditions / execution conditions of OTA upgrades, such as key switch activation, brake pedal triggering, and vehicle start-stop switch activation. The command also pre-sets the standardized execution sequence of each action (including the logic of action sequence and timing interval requirements). The small industrial computer module performs structured parsing of the control test command using preset command parsing rules, extracts a complete list of actions to be executed and the corresponding execution sequence benchmark, and uses this as a standardized reference for subsequent matching and verification, synchronously storing it in the local cache unit.

[0123] The process involves analyzing execution action data and identifying executed actions and their sequence: The small industrial PC module cleanses and extracts features from the execution action data transmitted back from the bus message transceiver module, removing invalid interference information and retaining only valid data showing the actual hardware actions performed by the test product after receiving control test commands. This data includes action type, execution trigger time, execution completion status, and action execution feedback results. Subsequently, the industrial PC module uses preset action recognition rules to filter out the actual executed actions from the valid data, forming verification objects corresponding to the list of actions to be executed. Simultaneously, based on the trigger timestamps and the timing feedback relationships of the execution status of each executed action, the actual execution sequence of the test product is determined, ensuring that the identification results are consistent with the actual hardware execution, providing an accurate basis for subsequent sequence matching.

[0124] First-time matching: Completeness verification of actions to be executed and actions already executed: The small industrial control computer module performs a full and accurate matching of the extracted list of actions to be executed with the identified actions already executed. According to the comparison rules of action name, action type and action execution requirements, it verifies whether the actions already executed are completely consistent with the actions to be executed, and whether there are any problems such as missing actions, redundant actions, incorrect action types, or deviations in execution requirements.

[0125] If a match is successful on the first attempt, it means that the executed actions are completely consistent with the actions to be executed in terms of quantity, type, and execution requirements, indicating that the integrity of the hardware action execution meets the standard. The small industrial control computer module then enters the second matching stage to conduct a standardization check of the execution sequence.

[0126] If a matching fails, indicating that the executed actions are missing, redundant, or incorrect, the small industrial computer module immediately triggers an alarm mechanism, generating an execution action error alarm. The alarm information includes key troubleshooting information such as the list of actions to be executed, the list of actual executed actions, the specific type of action deviation (missing / redundant / incorrect), and the action execution status. This alarm is then completely written into the second test information. After the alarm is written, the small industrial computer module resends the original control test command to the relay module, triggering a new round of hardware control test procedures to reacquire the execution action data and perform matching verification.

[0127] Secondary matching: Verification of the order to be executed and the order already executed: Based on the successful matching in the first step, the small industrial control computer module compares the baseline order to be executed with the actual executed order step by step and in a precise manner according to the preset order verification rules (adapting to the timing logic and action association requirements of automotive OTA hardware control). This verifies whether the actual execution order is completely consistent with the preset order and whether there are any problems such as reversed order, disordered steps, timing interval deviation exceeding the threshold, or conflicting action execution logic.

[0128] If the second matching is successful, that is, the execution order is completely consistent with the execution order in terms of timing and logic, it indicates that the execution of hardware control actions and the execution order are in line with expectations. The small industrial control computer module will write the control test instructions, complete execution action data, and double matching verification results of actions and order into the second test information in a standardized format, and then output the second test information to complete the information generation of this hardware control test.

[0129] If the second matching fails, indicating that the execution order is reversed, disordered, or has timing deviations, the small industrial computer module triggers an alarm mechanism to generate an execution order error alarm. The alarm information includes key information such as the baseline of the execution order, the actual execution order, the specific steps of the order disorder, the timing deviation value, and the action logic conflict point. The alarm is completely written into the second test information. After the alarm is written, the small industrial computer module resends the original control test command to the relay module to re-execute the hardware control test process.

[0130] In the above process, the execution action error alarm and the execution sequence error alarm are independent alarm types, corresponding to different dimensions of execution problems in hardware control testing. All alarm information is accompanied by traceable original data and deviation analysis. At the same time, the new round of testing process after the instruction is resent will repeat the above steps of identifying, matching and verifying the action and sequence until the matching is successful or the subsequent retry threshold mechanism is triggered.

[0131] By adopting the above preferred technical solutions, the present application splits the verification of hardware control tests into two hierarchical links of action integrity and sequence standardization, achieving a secondary progressive precise verification. It can clearly distinguish and accurately locate execution action errors and execution sequence errors in the hardware control interaction process, avoiding the problems of fuzzy fault types and high troubleshooting difficulty in the traditional single verification mode, making the fault alarm more targeted, and greatly improving the accuracy of the determination of hardware control test results. For the two types of matching failures, error alarms of corresponding types are generated and the control test instructions are immediately resent. This can not only timely detect the execution hidden dangers in the hardware control link, but also verify the execution effect after retry through the resending of instructions, effectively avoiding misjudgment caused by the contingency of single test, and further improving the rigor and reliability of the hardware control test link. After both double matches are successful, the control test instructions and execution action data are completely written into the second test information, which can supplement detailed and accurate hardware control execution data for the second test information, enabling the second test information to truly and comprehensively reflect the actual situation of hardware interaction during the OTA upgrade of the test product, and providing reliable and accurate data support for subsequent overall test analysis, test report generation, and optimization of the hardware control link. At the same time, the entire matching verification, alarm, and resending process is automatically completed by the small industrial control computer module, meeting the full-process automation requirements of portable OTA automation tests, and effectively improving the execution efficiency of the hardware control test link.

[0132] The embodiment of the present application further optimizes the "control test instruction resending" link in the hardware control test. By adding an independent industrial control test mode and a retry times threshold mechanism, it not only improves the pertinence and comprehensiveness of the retry test, but also avoids the test process from falling into an infinite loop, ensuring the test efficiency and process closed-loop property. This part, as a supplementary step for generating the second test information, is connected after "generating an execution action error alarm / execution sequence error alarm and writing it into the second test information" and before "resending the control test instructions". The specific operation steps are as follows:

[0133] Entering the independent industrial control test mode and disconnecting unnecessary linkages: When a single or double matching fails, the small industrial control computer module does not directly resend the control test command, but instead triggers the independent industrial control test mode. The core design purpose of this mode is to focus solely on the direct response of the executed action, eliminate interference from other electronic module linkages on the test results, and specifically locate the problem of direct control failure between "control command and executed action". Specifically, the small industrial control computer module sends a linkage disconnection command to the test product through bus communication, temporarily severing the signal interaction link between the action to be executed and unnecessary related electronic modules such as the body control module (BCM), powertrain control system (PCM), and advanced driver assistance system (ADAS), retaining only the direct control channel between the actuators corresponding to the control test command (such as key switch actuators, brake pedal control units, start-stop control modules, etc.) and the relay module; at the same time, the small industrial control computer module verifies the disconnection state, and only after confirming that the linkage link has been completely severed does it proceed to the subsequent command adjustment stage, ensuring the independence and consistency of the test environment.

[0134] Randomly adjusting the execution order to generate adjusted control test instructions: In the independent industrial control test mode, the small industrial computer module, based on the original list of actions to be executed (with the types and quantities of actions remaining unchanged), randomly adjusts the execution order of each action using a built-in random sorting algorithm. For example, if the original execution order is "key switch on → brake pedal triggered → vehicle start-stop activated," the adjusted order can generate various combinations such as "brake pedal triggered → key switch on → vehicle start-stop activated" and "vehicle start-stop activated → key switch on → brake pedal triggered." A unique random order is generated each time the instruction is resent, avoiding repeated testing of the same sequence scenario. After adjustment, the small industrial computer module integrates the new execution order with the original list of actions to be executed to generate adjusted control test instructions, ensuring that the instruction format still conforms to the hardware control protocol requirements of the tested product.

[0135] Retest Count Accumulation and Command Retransmission: The small industrial computer module has a built-in counter. Each time it enters the independent industrial control test mode, generates adjusted control test commands, and completes retransmission, it is considered a "retest." The counter accumulates the number of retests in real time and simultaneously records information such as the adjusted sequence of commands, test time, and independent test mode activation status for each retransmission, storing it in a local log database for easy review of subsequent tests. After the command is retransmitted, the test process returns to the complete steps of "parsing and executing action data → first matching → second matching," and the matching and verification of hardware control testing are carried out again.

[0136] Maximum number of tests determined and second test information processed: The small industrial computer module is pre-configured with a maximum number of tests (which can be flexibly set according to test accuracy requirements and product hardware control response characteristics, such as 3 times, 5 times, etc., with 3 times being the default recommended value). After each retest, the cumulative number of retests is compared with the preset maximum number of tests in real time.

[0137] If the cumulative number of retests is less than or equal to the maximum number of tests: continue to retain the independent test mode for industrial control, and repeat the process of "randomly adjusting the order of execution → resending the instruction → matching and verification → accumulating the number of tests" until the matching is successful (outputting complete second test information) or the cumulative number of tests exceeds the threshold.

[0138] If the cumulative number of retests exceeds the maximum number of tests, it indicates that the test product, under an independent testing environment, still fails the matching verification after being triggered by control commands in different sequences, indicating a persistent control execution anomaly or sequence mismatch problem. In this case, the small industrial control computer module immediately stops resending control test commands and automatically retrieves a preset control error template (this template is in a standardized format and includes key information such as test failure type, cumulative number of retests, maximum test count threshold, industrial control independent test mode activation record, details of the sequence adjustment for each resent command, all generated execution action error alarms / execution sequence error alarms, and linkage disconnection status verification results). This control error template is output and stored as complete second test information to ensure the integrity of the second test information.

[0139] Specific implementation examples:

[0140] For the OTA upgrade hardware control test of a certain vehicle under test, the preset maximum number of tests is 3. The original control test command to be executed is "Action A (Air conditioning off) → Action B (Window lock) → Action C (OTA upgrade start)":

[0141] First matching failed (incorrect execution order): Enter the independent test mode of industrial control, disconnect the linkage between the air conditioning control module and the vehicle gateway, randomly adjust the order to "Action B → Action A → Action C", and fail to match again after resending the command. The cumulative number of retests = 1.

[0142] Second resend: Maintain independent testing mode, randomly adjust the order to "Action C → Action B → Action A", if the matching still fails after resending the command, the cumulative number of retests = 2;

[0143] Third resend: Maintain independent testing mode, randomly adjust the order to "Action A → Action C → Action B", match fails after resending command, cumulative retest count = 3 (reaching the maximum number of tests);

[0144] Trigger threshold processing: Stop retransmitting commands, retrieve the control error template, fill in the order adjustment record of 3 retransmissions, the alarm of 2 execution order errors, the linkage disconnection log of independent test mode, etc., and output the template as the second test information.

[0145] By adopting the aforementioned preferred technical solutions, the independent testing mode for industrial control eliminates external interference by disconnecting unnecessary electronic module linkages. This allows for precise focus on the direct response relationship between "control command → execution action," specifically addressing control malfunction issues. Combined with a design that randomly adjusts the execution order, retry testing is no longer simply repeating the original command, but covers various action sequence scenarios. This fully verifies the hardware control's adaptability and stability under complex sequence combinations, accurately locating potential problems caused by sequential logic conflicts. This makes retry testing more targeted, significantly improving the comprehensiveness and rigor of hardware control testing. Simultaneously, by setting a maximum test count threshold and accumulating retest counts, problems such as test process lag and uncontrolled test duration caused by unlimited command retransmission are effectively avoided. This rationally controls test time and manpower costs, making the execution process of hardware control testing more controllable. In addition, when the number of retries exceeds the threshold, a control error template containing complete fault information is used as the second test information. This ensures the integrity of the second test information generation and the closed-loop nature of the test process, avoiding interruption of the overall OTA automated testing process due to continuous retries. It also provides comprehensive and traceable fault data support for subsequent test report integration and product problem troubleshooting.

[0146] This application also discloses a portable automotive OTA automated testing device, including a processor, which executes the steps of the portable automotive OTA automated testing method as described in any of the above embodiments.

[0147] This application also discloses a storage medium storing a program, which, when executed by a processor, implements the steps of the portable automotive OTA automated testing method described in any of the above embodiments.

[0148] Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of this application.

Claims

1. A portable automated OTA testing method for automobiles, characterized in that, Based on an industrial control power supply module, a small industrial control computer module, a relay module, and a bus message transceiver module, the industrial control power supply module is used to supply power to the small industrial control computer module, the relay module, and the bus message transceiver module; the method includes the following steps: The small industrial computer module control bus message transceiver module establishes a communication connection with the test product; The bus message transceiver module sends bus test cases to the test product based on the communication connection. The test product responds to the received bus test cases by returning bus test data to the bus message transceiver module, and repeats the test for a preset number of times. The bus message transceiver module sends fault test cases to the test product based on the communication connection, and the test product responds to the received fault test cases by returning fault test data to the bus message transceiver module; The small industrial computer module generates the first test information based on bus test data and fault test data; The small industrial computer module controls the relay module to establish a control connection with the test product. The relay module sends control test commands to the test product based on the control connection. The test product responds to the received control test commands by executing the corresponding control actions, generating execution action data, and returning the execution action data to the bus message transceiver module. The small industrial computer module generates second test information based on the executed action data and control test instructions; The small industrial computer module generates a test report based on the first test information and the second test information.

2. The portable automotive OTA automated testing method according to claim 1, characterized in that, The step of generating the first test information based on the bus test data and fault test data by the small industrial control computer module also includes the following steps: Obtain the corresponding group of bus test cases and bus test data in the current batch, and match the group of bus test cases with the bus test data; If the match is successful, the test is considered successful, and the total number of successful tests in the current batch is the success count; otherwise, the test is considered a failure. Calculate the success rate of the current batch = number of passes / number of tests, and generate test message information based on the success rate; If the success rate is lower than the preset success reference value, a message test alarm will be generated and written into the message test information. Store the message test information in the first test information.

3. The portable automotive OTA automated testing method according to claim 2, characterized in that, The step of generating the first test information based on the bus test data and fault test data by the small industrial control computer module also includes the following steps: The ratio of the calculated success rate to the success reference value is the first test ratio. The number of tests is adjusted negatively based on the first test ratio using a preset first parameter, where the first parameter is less than the preset adjustment parameter.

4. The portable automotive OTA automated testing method according to claim 1, characterized in that, The step of generating the first test information based on the bus test data and fault test data by the small industrial control computer module also includes the following steps: Obtain the corresponding group of bus test cases and bus test data in the current batch, and match the group of bus test cases with the bus test data; If the match is successful, the test is considered successful, and the time taken to pass the test is the success time; otherwise, the success time is 0. Calculate the fluctuation and average values ​​of the elapsed time in the current batch, and generate message test information based on the average value; If the fluctuation value is greater than the preset fluctuation reference value, a message test alarm will be generated and written into the message test information. Store the message test information in the first test information.

5. The portable automotive OTA automated testing method according to claim 4, characterized in that, The step of generating the first test information based on the bus test data and fault test data by the small industrial control computer module also includes the following steps: The ratio of the fluctuation value to the fluctuation reference value is calculated as the second test ratio. The number of tests is adjusted according to the second test ratio with a preset second parameter that is positively correlated with the second parameter. The second parameter is greater than the preset adjustment parameter.

6. The portable automotive OTA automated testing method according to claim 1, characterized in that, The method also includes the following steps: Multiple fault test cases are called from a pre-set fault test case library at once to perform fault simulation tests in sequence, and each fault test case is paired with the corresponding fault test data to form a group; The corresponding values ​​of each set of fault test cases and fault test data are calculated based on the preset fault feedback library. If the corresponding value of the content is less than the preset reference value, the corresponding value of the content is set to 0, and a fault test alarm is generated; then the next fault simulation test continues. After the fault simulation test is completed, fault test data is generated based on the corresponding values ​​of all contents. If a fault test alarm exists, the fault test alarm will be written into the fault test data.

7. The portable automotive OTA automated testing method according to claim 1, characterized in that, The step of the small industrial control computer module generating second test information based on the executed action data and control test instructions also includes the following steps: The control test command corresponds to multiple actions to be executed and their corresponding execution order; Identify multiple executed actions and their corresponding execution order from the action data; The system performs a first match between the action to be executed and the action already executed. If the first match is successful, the system performs a second match between the order of execution and the order of execution. Otherwise, an execution action error alarm is generated and written into the second test information. The small industrial control computer module then resends the control test command. If the second matching is successful, the execution action data and control test instructions are written into the second test information and the second test information is output. Otherwise, an execution sequence error alarm is generated, the execution sequence error alarm is written into the second test information, and the small industrial control computer module resends the control test instructions.

8. The portable automotive OTA automated testing method according to claim 7, characterized in that, The step of the small industrial control computer module generating second test information based on the executed action data and control test instructions also includes the following steps: Before the small industrial computer module resends the control test command, it enters the independent industrial control test mode and randomly adjusts the execution order of the control test command until the number of retests is accumulated. If the number of retests exceeds the preset maximum number of tests, stop resending control test commands and use the preset control error template as the second test information.

9. A portable automotive OTA automated testing device, characterized in that, Includes a processor, wherein the steps of the portable automotive OTA automated testing method as described in any one of claims 1-8 are performed.

10. A storage medium, characterized in that, The storage medium stores a program that, when executed by a processor, implements the steps of the portable automotive OTA automated testing method according to any one of claims 1-8.

Images