A test simulation verification platform for reusing on-board diagnostic algorithms

Abstract

The application relates to a test simulation verification platform for reusing on-board diagnosis algorithms, which comprises the following modules: a diagnosis program generation module, which automatically generates an on-board diagnosis program according to diagnosis knowledge; a diagnosis program simulation module, which loads the on-board diagnosis program, receives telemetry data and performs fault diagnosis; a data playback module, which plays back historical data records required for test verification; and a test verification module, which compares real and detected fault labels and analyzes diagnosis accuracy. The application provides a test simulation verification platform for reusing on-board diagnosis algorithms, realizes automatic updating and deployment to verification, and improves the test verification efficiency of on-board diagnosis programs.

Description

Technical Field

[0001] This invention relates to a testing and verification platform, and more particularly to a testing and verification platform for a diagnostic algorithm. Background Technology

[0002] Reusable launch vehicles achieve multiple uses across missions through recycling, repair, and upgrades, and their onboard hardware and software systems are adjusted with each reuse. To ensure the safe and reliable operation of the launch vehicle, the onboard diagnostic algorithms responsible for detecting and diagnosing faults are also adjusted along with changes to the hardware and software systems. An onboard diagnostic algorithm must undergo thorough testing and verification to ensure that it can quickly, accurately, and reliably diagnose faults in the launch vehicle before it can be deployed and used.

[0003] However, the current testing and verification of on-board diagnostic algorithms for reusable launch vehicles is costly and time-consuming, hindering the efficient reuse of these vehicles. First, the code for the on-board diagnostic algorithms needs to be re-coded by developers based on the diagnostic knowledge of the new version. Second, the implementation and operation of the on-board diagnostic algorithms require joint debugging with a series of programs such as data playback and data interfaces. Furthermore, the diagnostic results need to be compared and analyzed with actual fault conditions. These development tasks, involving manual adjustments and adaptations, consume significant resources and are time-consuming. Therefore, efficiently completing the entire process of updating, deploying, and verifying on-board diagnostic algorithms, and forming an automated testing, simulation, and verification platform for on-board diagnostic algorithms for reusable launch vehicles, is a crucial step in the rapid reuse of reusable launch vehicles. Summary of the Invention

[0004] This invention provides a test simulation verification platform for onboard diagnostic algorithms for reusable launch vehicles. Based on diagnostic knowledge and playback data, it realizes automatic updating, deployment, and verification of diagnostic programs, which can be applied to the rapid reuse of the aforementioned reusable launch vehicles.

[0005] To achieve the above objectives, the present invention proposes the following technical solution:

[0006] A test simulation verification platform for reusing on-board diagnostic algorithms of launch vehicles, comprising:

[0007] The diagnostic program generation module is configured to receive structured diagnostic knowledge, fill the diagnostic knowledge into a preset program template, and generate and compile an executable diagnostic program file and a corresponding interface definition file.

[0008] The diagnostic program simulation module is configured to load the diagnostic program file and the interface definition file, run the diagnostic program in a real-time and resource-constrained environment on the simulated device, receive external input data streams, adapt the data streams to the input format of the diagnostic program according to the interface definition file, run the diagnostic program and output fault diagnosis results.

[0009] The data playback module is configured to load a historical time-series data playback file containing multiple repeated flight missions, and output the historical time-series data frame by frame to form the data stream; the historical time-series data includes flight phase, flight mission code, telemetry parameters, remote control commands, and real fault labels;

[0010] The test and verification module is configured to receive the fault diagnosis results and the actual fault labels, classify and compare the fault diagnosis results and the actual fault labels according to the flight mission code and flight stage, and obtain the performance indicators of the diagnostic program in different missions and different stages. The performance indicators include false alarm rate, missed alarm rate, and alarm interval comparison.

[0011] Specifically, the diagnostic program generation module includes:

[0012] The knowledge parsing unit is configured to parse the structured tables of input, extract the diagnostic logic, thresholds and rules, and transform them into test point discrimination statements and test point-fault mapping matrices;

[0013] The code synthesis unit is configured to fill the measurement point discrimination statement and the measurement point-fault mapping matrix into the corresponding positions of the preset C language program framework template to generate complete C language source code;

[0014] The compilation output unit is configured to compile the C language source code into the diagnostic program file in dynamic link library (DLL) format, and simultaneously generate the interface definition file describing the input and output interfaces of the dynamic link library.

[0015] Specifically, the diagnostic program simulation module includes:

[0016] The data interface adaptation unit is configured to convert the telemetry data format in the data stream into the input structure data format required by the diagnostic program file, according to the interface definition file.

[0017] The real-time constraint simulation unit is configured to call the diagnostic program file at a fixed period that is consistent with the actual launch vehicle flight control cycle and to simulate interruption response delay.

[0018] The resource monitoring unit is configured to monitor the CPU usage time and memory usage peak during the operation of the diagnostic program, and compare them with the preset on-device resource thresholds to verify the resource compliance of the diagnostic program.

[0019] Furthermore, a test and verification method for reusing on-board diagnostic algorithms of a launch vehicle includes:

[0020] Diagnostic program generation steps: Based on structured diagnostic knowledge, the diagnostic program file and interface definition file that can run on the simulator environment are automatically generated and compiled.

[0021] Data playback steps: Load the playback file containing historical time-series data of multiple repeated flight missions, and perform playback to generate a data stream;

[0022] Diagnostic procedure simulation steps: Under the real-time and resource-constrained environment of the simulated device, load and run the diagnostic procedure file, adapt the data stream as its input, and obtain the real-time fault diagnosis result.

[0023] Test and verification steps: Compare the real-time fault diagnosis results with the actual fault labels in the playback data, and classify and statistically analyze the performance indicators of the diagnostic program according to flight mission and flight phase.

[0024] The beneficial effects of this application are:

[0025] The present invention provides a test simulation verification platform for on-board diagnostic algorithms of reusable launch vehicles, which can automatically execute the test and verification of on-board diagnostic algorithms. The knowledge parsing unit and the code synthesis unit work together to solve the automatic coding after the diagnostic knowledge is updated. The diagnostic program simulation module provides a fast interface adaptation and running environment, which meets the efficiency requirements of rapid reuse of reusable launch vehicles. Attached Figure Description

[0026] Figure 1 A system architecture diagram of a test simulation verification platform for reusing on-board diagnostic algorithms of a launch vehicle, provided in an embodiment of the present invention;

[0027] Figure 2 This is a schematic diagram of a diagnostic program generation module provided in an embodiment of the present invention. Detailed Implementation

[0028] The principles and features of the present invention are described below with reference to the accompanying drawings. The examples given are only for explaining the present invention and are not intended to limit the scope of the present invention.

[0029] To better understand the above-mentioned objectives, features, and advantages of this application, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the described embodiments are only some, not all, of the embodiments disclosed herein. The specific embodiments described herein are for explanation and disclosure only, and not for limiting this application. All other embodiments obtained by those skilled in the art based on the described embodiments of this application are within the scope of protection of this application.

[0030] This embodiment forms a test simulation verification platform for reusing on-board diagnostic algorithms of launch vehicles, and its structure is as follows: Figure 1,include:

[0031] (1) Diagnostic program generation module, which automatically generates diagnostic algorithms based on diagnostic knowledge;

[0032] (2) Diagnostic program simulation module, loads diagnostic algorithm on the loader, receives telemetry data to perform fault diagnosis;

[0033] (3) Data playback module, which replays historical data records required for testing and verification;

[0034] (4) Test and verification module: compare the real and detected fault labels to analyze the accuracy of diagnosis.

[0035] One embodiment of the present invention is applied to the testing and verification of an on-board diagnostic algorithm based on multi-signal flow graph inference for a reusable vehicle. The execution steps of the on-board diagnostic algorithm in this embodiment include:

[0036] (1) Receive telemetry data;

[0037] (2) Update the measurement point discrimination results based on the telemetry data and the measurement point discrimination formula;

[0038] (3) Update the fault diagnosis results based on the measurement point discrimination results and the measurement point-fault mapping matrix;

[0039] (4) Output the fault diagnosis results.

[0040] In this embodiment, diagnostic knowledge is provided in the form of a text table. The system extracts the knowledge, transforms it, and fills it into the corresponding position in the code template. After compilation, the diagnostic algorithm is generated on the generator, and the diagnostic algorithm on the implementer is automatically updated. Figure 2 As shown, the correspondence between the knowledge, code, and execution steps of the diagnostic program generation module in this embodiment includes:

[0041] (1) Based on the telemetry parameter table in the diagnostic knowledge table, form the telemetry parameter buffer code definition and telemetry interface definition to support telemetry data reception;

[0042] (2) Based on the measurement point information table in the FMECA in the diagnostic knowledge table, form the measurement point discrimination expression and the measurement point result cache code definition to support the updating of measurement point discrimination results;

[0043] (3) Based on the fault and measurement point relationship sub-table in FMECA in the diagnostic knowledge table, form a two-dimensional array form of measurement point-fault mapping matrix code definition to support fault diagnosis result update;

[0044] (4) Based on the fault summary table in FMECA in the diagnostic knowledge table, a fault result cache area and fault interface definition are formed to support the output of fault diagnosis results.

[0045] The telemetry interface definition and fault interface definition are exported as an interface definition file, which is used in the data interface adaptation unit of the diagnostic program simulation module in this embodiment. The code template after filling in the code definitions forms a complete C language source code, which is compiled and output as a DLL file for use in the diagnostic program simulation module.

[0046] In this embodiment, the data interface adaptation unit of the diagnostic program simulation module dynamically generates a structure object through the structure data format in the interface definition file, and constructs a mapping relationship between parameters and structure members to realize the access of telemetry data and the retrieval of fault diagnosis results. In this embodiment, the real-time constraint simulation unit dynamically calls the diagnostic function to sleep according to the preset flight control cycle of the actual launch vehicle and the on-board timestamp information provided in the playback data, simulating interrupt response delay. In this embodiment, the resource monitoring unit monitors the CPU usage time and memory usage peak during the operation of the diagnostic program, and compares them with the preset on-board resource threshold to verify the resource compliance of the diagnostic program.

[0047] In this embodiment, the data playback module is configured to load a historical time-series data playback file containing multiple repeated flight missions, and outputs the historical time-series data frame by frame in a data stream format. The historical time-series data includes flight phases, flight mission codes, telemetry parameters, remote control commands, and actual fault labels. Telemetry data is input to the diagnostic program simulation module in key-value pair format, remote control commands are input to the diagnostic program simulation module in character format, flight phases and flight mission codes are input to the test verification module to identify different test phases, and actual fault labels are input to the test verification module for comparison with fault labels detected by the diagnostic program, thereby determining the accuracy of the fault diagnosis.

[0048] In this embodiment, the test and verification module receives the fault diagnosis results and the real fault labels, and classifies, compares and statistically analyzes the fault diagnosis results and the real fault labels according to the flight mission code and flight stage to obtain the performance indicators of the diagnostic program in different missions and different stages. The performance indicators include false alarm rate, missed alarm rate and alarm interval comparison.

[0049] The performance metrics provided by the comprehensive testing and verification module are compared with the CPU usage time and peak memory usage provided by the diagnostic program simulation module. This embodiment automatically performs tests and verifications on the speed, accuracy, and reliability of the on-device diagnostic algorithm.

[0050] Although embodiments of this application have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of this application. All such modifications and variations fall within the scope defined by the appended claims. The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this invention, and these modifications or substitutions should all be covered within the scope of protection of this invention. Therefore, the scope of protection of this invention should be determined by the scope of the claims.

[0051] The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A test simulation verification platform for reusing on-board diagnostic algorithms of launch vehicles, characterized in that, include: The diagnostic program generation module is configured to receive structured diagnostic knowledge, fill the diagnostic knowledge into a preset program template, and generate and compile an executable diagnostic program file and a corresponding interface definition file. The diagnostic program simulation module is configured to load the diagnostic program file and the interface definition file, run the diagnostic program in a real-time and resource-constrained environment on the simulated device, receive external input data streams, adapt the data streams to the input format of the diagnostic program according to the interface definition file, run the diagnostic program and output fault diagnosis results. The data playback module is configured to load a historical time-series data playback file containing multiple repeated flight missions, and output the historical time-series data frame by frame to form the data stream; the historical time-series data includes flight phase, flight mission code, telemetry parameters, remote control commands, and real fault labels; The test and verification module is configured to receive the fault diagnosis results and the actual fault labels, classify and compare the fault diagnosis results and the actual fault labels according to the flight mission code and flight stage, and obtain the performance indicators of the diagnostic program in different missions and different stages. The performance indicators include false alarm rate, missed alarm rate, and alarm interval comparison.

2. The system according to claim 1, characterized in that, The diagnostic program generation module specifically includes: The knowledge parsing unit is configured to parse the structured tables of input, extract the diagnostic logic, thresholds and rules, and transform them into test point discrimination statements and test point-fault mapping matrices; The code synthesis unit is configured to fill the measurement point discrimination statement and the measurement point-fault mapping matrix into the corresponding positions of the preset C language program framework template to generate complete C language source code; The compilation output unit is configured to compile the C language source code into the diagnostic program file in dynamic link library (DLL) format, and simultaneously generate the interface definition file describing the input and output interfaces of the dynamic link library.

3. The system according to claim 1, characterized in that, The diagnostic procedure simulation module specifically includes: The data interface adaptation unit is configured to convert the telemetry data format in the data stream into the input structure data format required by the diagnostic program file, according to the interface definition file. The real-time constraint simulation unit is configured to call the diagnostic program file at a fixed period that is consistent with the actual launch vehicle flight control cycle and to simulate interruption response delay. The resource monitoring unit is configured to monitor the CPU usage time and memory usage peak during the operation of the diagnostic program, and compare them with the preset on-device resource thresholds to verify the resource compliance of the diagnostic program.

4. A test and verification method for reusing on-board diagnostic programs of a carrier, characterized in that, The method, applied to the system of any one of claims 1-3, comprises: Diagnostic program generation steps: Based on structured diagnostic knowledge, the diagnostic program file and interface definition file that can run on the simulator environment are automatically generated and compiled. Data playback steps: Load the playback file containing historical time-series data of multiple repeated flight missions, and perform playback to generate a data stream; Diagnostic procedure simulation steps: Under the real-time and resource-constrained environment of the simulated device, load and run the diagnostic procedure file, adapt the data stream as its input, and obtain the real-time fault diagnosis result. Test and verification steps: Compare the real-time fault diagnosis results with the actual fault labels in the playback data, and classify and statistically analyze the performance indicators of the diagnostic program according to flight mission and flight phase.

Images