A simulation test data management method

Abstract

The present invention relates to the field of data processing technology, and in particular to a simulation test data management method, comprising the following steps: acquiring test project data, constructing a data platform to store the acquired test project data; generating a data processing queue according to the time sequence of receiving the test project data by the data platform, and performing data format recognition on the leading test project data of the data processing queue; editing and setting data parsing logic, receiving the leading test project data of the data processing queue, and reading the test project data according to the designed data parsing logic. The present invention can stably process the test project data, and in the process of processing the test project data, by identifying and converting the format of the test project data, ensure that when the test project data processed according to the time sequence exists in an unrecognizable format, the overall processing process of the test project data is effectively guaranteed by format conversion and switching the test project data.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a simulation test data management method. Background Art

[0002] Digital simulation and hardware-in-the-loop (HIL) simulation are key components of model-based systems engineering and are widely used in the R&D of aviation, aerospace, vehicles, and electrical equipment. As key steps in the product development and verification process, HIL simulation and physical prototype verification complement each other, enabling iterative iterations that improve testing efficiency and accelerate product development.

[0003] The involvement of simulation in experiments means that the availability of the test environment is improved, and the output of test data is greatly increased, which objectively increases the workload of test data management and analysis.

[0004] However, the simulation and testing process of the product is generally carried out according to the test specifications. The matching degree between the simulation test process and the test specifications, as well as the judgment of the simulation test results, require a lot of analysis of the simulation test data. This also means that the data results obtained will be massive. If the database system is not optimized, it will be difficult to achieve smooth data transmission and display. Summary of the Invention

[0005] Technical problems solved

[0006] In view of the above shortcomings of the prior art, the present invention provides a simulation test data management method, which solves the technical problems raised in the above background technology.

[0007] Technical Solution

[0008] To achieve the above objectives, the present invention is implemented through the following technical solutions:

[0009] A simulation test data management method includes the following steps:

[0010] Step 1: Obtain test project data and build a data platform to store the obtained test project data;

[0011] Step 2: Generate a data processing queue based on the timing of the test project data received by the data platform, and identify the data format of the leading test project data in the data processing queue;

[0012] Step 3: Edit and set the data parsing logic, receive the test project data in the front of the data processing queue, read the test project data according to the designed data parsing logic, obtain the test project data to the value of each variable, and establish a data variable table based on the variable data;

[0013] Step 4: Build a database, receive the data variable table established in step 3 in real time, store the data variable table in the database, edit and set the data simulation test steps, and select the variable table in the database according to the time sequence of the variable table stored in the database to apply the data simulation test steps for processing;

[0014] Step 5: Edit and set the result evaluation logic of the variable table application data simulation test step processing, and evaluate the result of the variable table application data simulation test step processing through the evaluation logic;

[0015] Step 6: Obtain the evaluation data of the variable table application data simulation test step processing results, send it to the database constructed in step 4 according to the variable table corresponding to the evaluation data, and match the evaluation data to the variable table stored in the database through the variable table corresponding to the evaluation data.

[0016] Furthermore, the sources of obtaining the test project data in step 1 include manual input by the user and file import. When obtaining the test project data in step 1, the test project data is received and stored by the data platform and enters the processing queue. The user end sends the test project data to the data platform, and the data platform receives and stores the test project data. After confirmation by the user end, the test project data stored by the data platform enters the processing queue.

[0017] Furthermore, in step 2, when performing data format identification on the test item data, it is determined whether the test item data is in Word or Excel format. If the determination result is yes, the process proceeds to step 3. If the determination result is no, the process jumps to the next set of test item data in the data processing queue for data format identification. If it is determined that the test item data is in Word or Excel format, the process proceeds to step 3.

[0018] Among them, when the judgment result is no, the number of jumps is customized according to the user end, and the number of jumps is not less than one and not more than seven times. At the same time, the data format of the test item data with a judgment result of no is converted to Word or Excel format, and sent to step 3 after the jump when the judgment result is no is completed.

[0019] Furthermore, in step 4, when the data variable table is stored, the test item data corresponding to the data variable table is deleted from the data platform.

[0020] Furthermore, step 4 is further provided with sub-steps, including the following steps:

[0021] Step 41: Obtain data simulation test steps, and process the selected variable table through the data simulation test steps;

[0022] Step 42: Real-time monitoring of the data simulation test step during the processing of the data in the variable table, and analyzing whether the data simulation test step is completely executed;

[0023] Step 43: If the analysis result of step 42 is negative, the error location of the data simulation test step is captured, the data content in the variable table used for the error location is obtained, and feedback is given to the user end;

[0024] Wherein, after the analysis result of step 42 is yes or step 43 is completed, step 4 applies the data simulation test steps again to process the next set of variable tables according to the database storage variable table sequence.

[0025] Furthermore, when feeding back to the user terminal the error location of the data simulation test step and the data content in the variable table applied at the error location, step 43 synchronously sends to the user terminal all data simulation test step contents applied in the current processing variable table.

[0026] Furthermore, the data simulation test steps edited and set in step 4 are not unique. When step 4 is executed, feature recognition is performed on the data in the variable table simultaneously, and the edited and set data simulation test steps are mutually configured according to the feature recognition results. When step 4 applies the data simulation test steps to the variable table for processing, feature recognition is performed on the variable table data in real time, and the corresponding configured data simulation test steps are applied for processing.

[0027] Furthermore, when evaluating the result of the variable table application data simulation test step processing, step 5 synchronously identifies whether the variable table corresponding to the data simulation test step processing has been processed by its sub-step 43 in step 4. When the identification result is yes, the result of the variable table currently evaluated application data simulation test step processing is marked.

[0028] Furthermore, when evaluating the result of the variable table application data simulation test step processing, step 5 synchronously identifies whether the variable table corresponding to the data simulation test step processing has been processed by its sub-step 43 in step 4. When the identification result is yes, the result of the variable table currently evaluated application data simulation test step processing is marked.

[0029] Furthermore, after step 6 is executed, the user terminal searches the database constructed in step 4 according to the variable table for the test item data to be viewed, and obtains the result of the processing through the data simulation test step.

[0030] Beneficial effects

[0031] Compared with the known public technology, the technical solution provided by the present invention has the following beneficial effects:

[0032] 1. The present invention provides a simulation test data management method. By executing the steps in the method, the test project data can be stably processed. In the process of processing the test project data, by identifying and converting the format of the test project data, it is ensured that when the test project data processed according to the time sequence has an unrecognizable format, the overall processing process of the test project data is effectively guaranteed by format conversion and switching of the test project data.

[0033] 2. During the execution of its steps, the method of the present invention ensures that all test project data can be processed through the editing and setting of the data simulation test steps, and can also monitor the steps in the data simulation test process in real time to ensure that when the test project data is processed through the data simulation test steps, errors that occur can be obtained in real time through the execution of the steps of the method, so that the test project data with errors will occupy the data simulation test step processing process for a long time.

[0034] 3. The present invention can also store the processing results of the test project data through the data simulation test steps, ensuring that the historical data of the test project processed by the method can be selected and called when the user needs it, making the functionality of the method more complete.

[0035] 4. The method of the present invention solves the problem of automatic evaluation of test data in semi-physical simulation tests and physical prototype tests. Through standardized operations, it reduces human errors in the analysis and evaluation of test data results, and accelerates the efficiency of test data result evaluation to a certain extent. The test result data can be read from the database through database operations, which speeds up the analysis and evaluation efficiency of the test data. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] To more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive effort.

[0037] Figure 1 It is a flowchart of a simulation test data management method;

[0038] Figure 2 Schematic diagram of the process of the lower sub-steps of step 4 in the present invention;

[0039] Figure 3 It is a flow chart of evaluating the results of processing the variable table using the data simulation test steps in the present invention. DETAILED DESCRIPTION

[0040] To make the purpose, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

[0041] The present invention will be further described below with reference to the embodiments.

[0042] Example 1

[0043] A simulation test data management method of this embodiment is as follows: Figure 1 As shown, the following steps are included:

[0044] Step 1: Obtain test project data and build a data platform to store the obtained test project data;

[0045] Step 2: Generate a data processing queue based on the timing of the test project data received by the data platform, and identify the data format of the leading test project data in the data processing queue;

[0046] Step 3: Edit and set the data parsing logic, receive the test project data in the front of the data processing queue, read the test project data according to the designed data parsing logic, obtain the test project data to the value of each variable, and establish a data variable table based on the variable data;

[0047] Step 4: Build a database, receive the data variable table established in step 3 in real time, store the data variable table in the database, edit and set the data simulation test steps, and select the variable table in the database according to the time sequence of the variable table stored in the database to apply the data simulation test steps for processing;

[0048] Step 5: Edit and set the result evaluation logic of the variable table application data simulation test step processing, and evaluate the result of the variable table application data simulation test step processing through the evaluation logic;

[0049] Step 6: Obtain the evaluation data of the variable table application data simulation test step processing results, send it to the database constructed in step 4 according to the variable table corresponding to the evaluation data, and match the evaluation data to the variable table stored in the database through the variable table corresponding to the evaluation data.

[0050] Example 2

[0051] In terms of specific implementation, based on Example 1, this example refers to Figure 1 The following further describes a simulation test data management method in Example 1:

[0052] In step 1, the sources of obtaining the test project data include manual input by the user and file import. When obtaining the test project data in step 1, the test project data is received and stored by the data platform and enters the processing queue. The user end sends the test project data to the data platform, and the data platform receives and stores the test project data. After confirmation by the user end, the test project data stored by the data platform enters the processing queue.

[0053] like Figure 1 As shown, the sources of obtaining the test project data in step 1 include manual input by the user and file import. When obtaining the test project data in step 1, the test project data is received and stored by the data platform and enters the processing queue. The user end sends the test project data to the data platform, and the data platform receives and stores the test project data. After confirmation by the user end, the test project data stored by the data platform enters the processing queue.

[0054] like Figure 1 As shown, in step 4, when the data variable table is stored, the test item data corresponding to the data variable table is deleted from the data platform.

[0055] Example 3

[0056] In terms of specific implementation, based on Example 1, this example refers to Figure 2 The following further describes a simulation test data management method in Example 1:

[0057] The step 4 is provided with sub-steps, including the following steps:

[0058] Step 41: Obtain data simulation test steps, and process the selected variable table through the data simulation test steps;

[0059] Step 42: Real-time monitoring of the data simulation test step during the processing of the data in the variable table, and analyzing whether the data simulation test step is completely executed;

[0060] Step 43: If the analysis result of step 42 is negative, the error location of the data simulation test step is captured, the data content in the variable table used for the error location is obtained, and feedback is given to the user end;

[0061] Wherein, after the analysis result of step 42 is yes or step 43 is completed, step 4 applies the data simulation test steps again to process the next set of variable tables according to the database storage variable table sequence.

[0062] like Figure 2 As shown, in step 43, when feeding back to the user terminal the error location of the data simulation test step and the data content in the variable table applied at the error location, all data simulation test step contents applied in the current processing variable table are synchronously sent to the user terminal.

[0063] like Figure 1 As shown, the data simulation test steps edited and set in step 4 are not unique. Step 4 synchronously performs feature recognition on the data in the variable table when executed, and mutually configures the edited and set data simulation test steps according to the feature recognition results. When step 4 applies the data simulation test steps to the variable table for processing, feature recognition is performed on the variable table data in real time, and the corresponding configured data simulation test steps are applied for processing.

[0064] like Figure 1 As shown, when evaluating the result of the variable table application data simulation test step processing, step 5 synchronously identifies whether the variable table corresponding to the data simulation test step processing has been processed by its sub-step 43 in step 4. When the identification result is yes, the result of the variable table currently evaluated application data simulation test step processing is marked.

[0065] like Figure 1 As shown, in step 6, when the evaluation data is sent to the database for storage, the evaluation data corresponding variable table application data simulation test step processing result is synchronously identified whether it is marked. When it is identified that the evaluation data corresponding variable table application data simulation test step processing result is marked, the storage operation is synchronously fed back to the user end when the evaluation data is sent to the database for storage.

[0066] like Figure 1 As shown, after step 6 is executed, the user terminal searches the database constructed in step 4 according to the variable table for the test item data to be viewed and processes the result through the data simulation test step.

[0067] Among them, see Figure 3 As shown in Figure 5, the specific process of result data evaluation in step 5 is as follows:

[0068] ①. The user selects the test task Task_i from the task list on the front-end page. The task details page displays the basic information of the task, the structured test steps, the rewritten evaluation data and evaluation methods, etc. The task details page also displays the number of times the current task has been executed and a list of each execution;

[0069] ②. The user selects a single execution, TaskRun_ij, or multiple executions, TaskRun_ij through TaskRun_ik, from the test execution list. The details page for each selected task execution displays the execution data. Certain task evaluation parameters must be defined on this page, such as the time period of the data to be analyzed by the evaluation operator, the benchmark data, and the number of executions.

[0070] ③. Based on the parameters determined in ②, execute the database read method to select and read data within a specific time range from the time series database;

[0071] ④. Click the Evaluate button on the page to execute the evaluation method. The data read in ⑤ will be automatically calculated according to the operator defined in the evaluation method. The result will be returned as PASS, FAIL, or INVALIDATE.

[0072] ⑤. Determine whether the selected execution has been evaluated; if there are still unevaluated executions, continue to evaluate the next one.

[0073] The evaluated results are written into the test report. The evaluation process is complete.

[0074] For Example 1, the main step execution logic can be summarized as follows:

[0075] Data Import: Select the local data file in the file upload interface of the software page and upload the data files generated by this execution (including model files, result data, parameter files, etc.) to the server backend. This step imports all simulation data and experimental data for subsequent joint analysis.

[0076] Data Parsing: Select the result data file and, according to predefined parsing rules, read the values ​​of each variable in the data file. Whether it's simulation data or collected test data, the characteristic of hardware-in-the-loop simulation test results is that they are all time series. Furthermore, multiple variables are synchronized with a set of timestamp sequences at regular intervals. The parsing results extract these variable sequences, along with their synchronized timestamp sequences, from the data file to form a variable table and temporarily store them in memory. If the variables are large and numerous, they can also be converted to a data file in any common format, such as Word, Excel, txt, or CSV. This serves as a transit point for the next step of transferring them to a database. The variable table on the data parsing page displays the dimensions of each variable and allows you to set variable aliases, variable annotations, and other operations.

[0077] Data Writing to a Database: The parsed variable data is structured. This data, along with information about executed tasks, personnel, and changes, must be stored in a database. While data is typically written to a relational database, this method proposes a new solution: writing data from the variable table to a time series database (TSDB) and other test task data to a relational database. The following describes these two database writing methods.

[0078] a) Data is written into a relational database.

[0079] b) Data is written to a time series database. Due to the time series nature of the result data, it can be stored in a time series database (including but not limited to InfluxDB). Time series databases lack inter-table joins and use only timestamp information as the primary key for each table. Therefore, they are highly efficient when writing large amounts of data to a time series database. During queries, all data within a time range can be read in segments. This is particularly true in simulation testing scenarios. This is particularly useful for analyzing and visualizing data within a specific time range of interest during simulation experiments. During the write operation, all time series data generated by each task execution is written to a table (Measurement, using the InfluxDB naming convention as an example). The timestamp sequence for each execution serves as the primary key, the time column. All variable sequences are written to the field column. The field key is the variable name or alias, and the field value is the corresponding value synchronized with the time column. Other data information, such as file names, personnel information, and version information, is stored as tags in key-value format. Each table (Measurement) in the time series database is named after the task execution. Other data of this simulation test data management software is managed by a relational database, which is associated with the corresponding data table of the time series database through the name of the task execution.

[0080] Data Analysis: The purpose of storing data in a database is to persist it and facilitate easy access for analysis. Users retrieve data from the database related to tasks of interest and perform data analysis. Common data analysis algorithms can be implemented using mathematical function libraries in common programming languages. These include aggregation analysis and visualization. Due to the unpredictability of data, different analysis methods are required for different data types, which can be implemented using custom data analysis scripts.

[0081] Data Evaluation: Because the evaluation criteria for test task results are implemented in the task class, users can select the appropriate time period of interest for the result data, all or part of it, based on the evaluation criteria. They can then read the data from the database and apply operations to it using the operators implemented in the task class. The operator results can also be displayed directly in the visualization. The calculation results of the task class's evaluation operators directly indicate whether the data generated by this execution is valid and has passed. The evaluation results can also be displayed intuitively on the visualization. After the evaluation is complete, users can save the evaluation results and related visualization screenshots to the database.

[0082] In summary, by executing the steps of the method in the above embodiment, the test project data can be stably processed. In the process of processing the test project data, by identifying and converting the format of the test project data, it is ensured that when the test project data processed according to the time series has an unrecognizable format, the overall processing process of the test project data is effectively guaranteed by format conversion and switching of the test project data; and in the process of executing its steps, by editing and setting the data simulation test steps, it is ensured that all the test project data can be processed, and it is also possible to monitor the steps in the data simulation test process in real time to ensure that when the test project data is processed through the data simulation test steps, errors that occur can be corrected by the method. The steps are executed to obtain data in real time, so that the test project data with errors on the surface will occupy the data simulation test step processing process for a long time; in addition, the processing results of the test project data through the data simulation test step can be stored, ensuring that the historical data of the test project processed by the method can be selected and called when the user needs it, making the functionality of the method more complete. At the same time, the method solves the problem of automatic evaluation of test data in semi-physical simulation tests and physical prototype tests. Through standardized operations, it reduces human errors in the analysis and evaluation of test data results, and accelerates the efficiency of test data result evaluation to a certain extent. The test result data can be read from the database through database operations, which speeds up the analysis and evaluation efficiency of the test data.

[0083] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements will not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A simulation test data management method, characterized in that: The following steps are involved: Step 1: Obtain test project data and build a data platform to store the obtained test project data; Step 2: Generate a data processing queue based on the timing of the test project data received by the data platform, and identify the data format of the leading test project data in the data processing queue; Step 3: Edit and set the data parsing logic, receive the test project data in the front of the data processing queue, read the test project data according to the designed data parsing logic, obtain the test project data to the value of each variable, and establish a data variable table based on the variable data; Step 4: Build a database, receive the data variable table established in step 3 in real time, store the data variable table in the database, edit and set the data simulation test steps, and select the variable table in the database according to the time sequence of the variable table stored in the database to apply the data simulation test steps for processing; Step 5: Edit and set the result evaluation logic of the variable table application data simulation test step processing, and evaluate the result of the variable table application data simulation test step processing through the evaluation logic; Step 6: Obtain evaluation data of the processing results of the variable table application data simulation test step, send it to the database constructed in step 4 according to the variable table corresponding to the evaluation data, and match the evaluation data to the variable table stored in the database through the variable table corresponding to the evaluation data; The step 4 is provided with sub-steps, including the following steps: Step 41: Obtain data simulation test steps, and process the selected variable table through the data simulation test steps; Step 42: Real-time monitoring of the data simulation test step during the processing of the data in the variable table, and analyzing whether the data simulation test step is completely executed; Step 43: If the analysis result of step 42 is negative, the error location of the data simulation test step is captured, the data content in the variable table used for the error location is obtained, and feedback is given to the user end; Wherein, if the analysis result of step 42 is yes or step 43 is completed, step 4 applies the data simulation test step again to process the next set of variable tables according to the database storage variable table sequence; In step 43, when feeding back to the user terminal the error location in the data simulation test step and the data content in the variable table applied to the error location, all data simulation test step contents applied to the current processing variable table are synchronously sent to the user terminal; The data simulation test steps edited and set in step 4 are not unique. When step 4 is executed, feature recognition is performed on the data in the variable table synchronously, and the edited and set data simulation test steps are mutually configured according to the feature recognition results. When step 4 applies the data simulation test steps to the variable table for processing, feature recognition is performed on the variable table data in real time, and the corresponding configured data simulation test steps are applied for processing.

2. A simulation test data management method according to claim 1, characterized in that: In step 1, the sources of obtaining the test project data include manual input by the user and file import. When obtaining the test project data in step 1, the test project data is received and stored by the data platform and enters the processing queue. The user end sends the test project data to the data platform, and the data platform receives and stores the test project data. After confirmation by the user end, the test project data stored by the data platform enters the processing queue.

3. A simulation test data management method according to claim 1, characterized in that: In step 2, when performing data format identification on the test item data, it is determined whether the test item data is in Word or Excel format. If the determination result is yes, the process proceeds to step 3. If the determination result is no, the process jumps to the next set of test item data in the data processing queue for data format identification. If the test item data is identified as in Word or Excel format, the process proceeds to step 3. Among them, when the judgment result is no, the number of jumps is customized according to the user end, and the number of jumps is not less than one and not more than seven times. At the same time, the data format of the test item data with a judgment result of no is converted to Word or Excel format, and sent to step 3 after the jump when the judgment result is no is completed.

4. A simulation test data management method according to claim 1, characterized in that: In step 4, when the data variable table is stored, the test item data corresponding to the data variable table is deleted from the data platform.

5. A simulation test data management method according to claim 1, characterized in that: When evaluating the result of the variable table application data simulation test step processing, step 5 synchronously identifies whether the variable table corresponding to the data simulation test step processing has been processed by its sub-step 43 in step 4. When the identification result is yes, the result of the variable table currently evaluated application data simulation test step processing is marked.

6. A simulation test data management method according to claim 1, characterized in that: In step 6, when the evaluation data is sent to the database for storage, the evaluation data corresponding variable table application data simulation test step processing result is synchronously identified whether it is marked. When it is identified that the evaluation data corresponding variable table application data simulation test step processing result is marked, the storage operation is synchronously fed back to the user end when the evaluation data is sent to the database for storage.

7. A simulation test data management method according to claim 1, characterized in that: After step 6 is completed, the user terminal searches the database constructed in step 4 according to the variable table for the test item data to be viewed and obtains the result of the data simulation test step.

Images