Method and device for time sequence storage of test flight data
By adopting the test flight original data tree-like storage method based on the timing data mode, the complex problem of traditional test flight data storage methods is solved, and data management is simplified and storage resources are saved.
Patent Information
- Application Number
- CN202411805133.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-10
- Publication Date
- 2025-03-14
AI Technical Summary
The data storage method generated by the traditional test flight data acquisition system does not conform to the characteristics of the test flight data, resulting in complex data management, special processing logic needs to be designed during analysis, and there is a problem that the configuration file version matches the original data.
The test flight original data tree structure storage method based on the time series data mode is adopted. The test flight original data is stored through the tree structure of the root node-model-rack-rack-sequence-data collection equipment sequence number-time series, and the configuration files are stored in the corresponding time series according to the data collection equipment classification.
Simplified the management of test flight original data, solved the problem of matching configuration file version with original data, saved data storage resources, and improved data query efficiency.
Smart Images
Figure CN119620954A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of flight test data storage, and in particular to a method and device for time series storage of flight test data. Background Art
[0002] The data generated by the traditional flight test data acquisition system (hereinafter referred to as the raw flight test data) is stored in binary files according to the data format specified by the data acquisition equipment manufacturer. The data storage hierarchy does not follow the characteristics of the flight test data itself, and the raw flight test data is stored separately from its corresponding configuration files. Multiple files are required for storage, and additional association relationships are established for management. This makes the management of the raw flight test data more complicated. When parsing the data, it is necessary to design processing logic based on the storage method of the raw flight test data to realize the parsing of the raw flight test data.
[0003] Therefore, there is an urgent need for a flight test data storage method that further improves the existing technology. Summary of the invention
[0004] This Summary is provided to introduce some concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
[0005] In view of the problems in the prior art, after analyzing the hierarchical structure of the flight test data itself, the present invention proposes a tree structure storage method for the original flight test data based on the time series data mode, which retains the attributes of the flight test data, uses the time series data format to jointly store the original flight test data and the configuration file, simplifies the management of the original flight test data, and solves the problem of matching the version of the flight test data configuration file with the original data.
[0006] To achieve the above purpose, the present invention adopts the following technical scheme: a tree structure storage method for raw flight test data based on a time series data mode, wherein the raw flight test data is in a tree structure of root node-aircraft model-aircraft frame-flight number-data acquisition device serial number-time series, and the configuration files are stored in the corresponding time series according to the data acquisition device classification. It mainly includes the processes of extracting attribute information of flight test configuration files, generating tree structure of raw flight test data, receiving and processing raw flight test data, and generating time series data files.
[0007] Specifically, in one embodiment of the present invention, a method for time series storage of flight test data is disclosed, comprising:
[0008] Extract the attribute information of the flight test configuration file;
[0009] generating a tree structure of the flight test raw data in combination with the attribute information, the tree structure being used as a storage tree structure of the flight test configuration file and the flight test raw data and including a time series data file as a leaf node;
[0010] receiving the original data of the flight test;
[0011] Classifying the original flight test data according to the network topology information of the flight test configuration file to establish a matching relationship with each level in the tree structure; and
[0012] The classified raw flight test data and the corresponding flight test configuration file are written into the time series data file.
[0013] In one embodiment of the present invention, the raw flight data may be sent by the flight test data acquisition system via an airborne network and received by an airborne real-time data processing system, and the attribute information may include attribute information of the flight test data acquisition system and a data interface control document written into the flight test data acquisition system as well as attribute information used for data processing.
[0014] In the above-mentioned embodiment of the present invention, the network topology information may be associated with the acquisition device in the flight test data acquisition system.
[0015] In one embodiment of the present invention, generating a tree structure of the flight test raw data in combination with the attribute information may further include establishing a hierarchical structure of the attribute information and generating the tree structure corresponding to the hierarchical structure.
[0016] In one embodiment of the present invention, the tree structure may be root node-machine model-rack machine-number of flights-data acquisition equipment serial number-the time series data file.
[0017] In one embodiment of the present invention, after classifying the raw flight test data, the method may further include:
[0018] Remove the Ethernet protocol header file of the original data of the flight test;
[0019] Preserve application layer data files; and
[0020] Read the timestamp information in the application layer data file.
[0021] In the above embodiment of the present invention, the method may further include using the timestamp information to generate an index identifier for the time series data file.
[0022] In one embodiment of the present invention, the time series data file may be a plurality of time series data files and stored in a binary file format.
[0023] In one embodiment of the present invention, the original flight test data in the same time series data file is stored using the same message data.
[0024] In one embodiment of the present invention, the method may be executed at a flight test data acquisition system and an onboard real-time data processing system.
[0025] In another embodiment of the present invention, a device for time series storage of flight test data is disclosed, the device comprising:
[0026] An attribute information extraction module, configured to extract attribute information of a flight test configuration file;
[0027] A tree structure generating module, which is configured to generate a tree structure of the flight test raw data in combination with the attribute information, the tree structure being used as a storage tree structure of the flight test configuration file and the flight test raw data and including a time series data file as a leaf node;
[0028] The flight test raw data receiving and processing module is configured to:
[0029] receiving the original data of the flight test;
[0030] Classifying the original flight test data according to the network topology information of the flight test configuration file to establish a matching relationship with each level in the tree structure; and
[0031] A time series data file generating module is configured to write the classified original flight test data and the corresponding flight test configuration file into the time series data file.
[0032] In one embodiment of the present invention, the attribute information extraction module and the tree structure generation module are included in a flight test data acquisition system, and the flight test raw data receiving and processing module and the timing data file generation module are included in an onboard real-time data processing system.
[0033] In one embodiment of the present invention, the tree structure generating module may be further configured to establish a hierarchical structure of the attribute information and generate the tree structure corresponding to the hierarchical structure.
[0034] In one embodiment of the present invention, after the flight test raw data is classified, the flight test raw data receiving and processing module may be further configured to:
[0035] Remove the Ethernet protocol header file of the original data of the flight test;
[0036] Preserve application layer data files; and
[0037] Read the timestamp information in the application layer data file.
[0038] In the above embodiment of the present invention, the time series data file generation module may be further configured to use the timestamp information to generate an index identifier for the time series data file.
[0039] In yet another embodiment of the present invention, a computer storage medium is also disclosed, which stores instructions for sequential storage of flight test data, including:
[0040] Instructions for extracting attribute information of a test flight configuration file;
[0041] An instruction for generating a tree structure of raw flight test data in combination with the attribute information, wherein the tree structure is used as a storage tree structure of the flight test configuration file and the raw flight test data and includes a time series data file as a leaf node;
[0042] An instruction for receiving the raw data of the flight test;
[0043] Instructions for classifying the raw flight test data according to the network topology information of the flight test configuration file to establish a matching relationship with each level in the tree structure; and
[0044] Instructions for writing the classified raw flight test data and the corresponding flight test configuration file into the timing data file.
[0045] After studying the description of the specific exemplary embodiments of the present invention below in conjunction with the accompanying drawings, other aspects, features and embodiments of the present invention will be apparent to those of ordinary skill in the art. Although features of the present invention may be discussed below with respect to certain embodiments and accompanying drawings, all embodiments of the present invention may include one or more of the advantageous features discussed herein. In other words, although one or more embodiments may be discussed to have certain advantageous features, one or more of such features may also be used according to the various embodiments of the present invention discussed herein. In a similar manner, although exemplary embodiments may be discussed below as device, system or method embodiments, it should be appreciated that such exemplary embodiments may be implemented in various devices, systems, and methods. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In order to understand in detail the manner in which the above-stated features of the present disclosure are used, a more particular description of the content briefly summarized above may be made with reference to various aspects, some of which are illustrated in the accompanying drawings. It should be noted, however, that the accompanying drawings illustrate only certain typical aspects of the present disclosure and are not to be considered limiting of its scope, as the description may admit to other equally effective aspects.
[0047] Figure 1 It is a schematic block diagram of a device for time-series storage of flight test data according to an embodiment of the present disclosure.
[0048] Figure 2 The present invention is a flowchart of a method for time-series storage of flight test data according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0049] The various embodiments will be described in more detail below with reference to the accompanying drawings that form part of the present invention and illustrate various specific exemplary embodiments. However, the various embodiments can be implemented in many different forms and should not be interpreted as limiting the various embodiments set forth herein; on the contrary, these embodiments are provided to make the present disclosure thorough and complete, and to fully convey the scope of these embodiments to those of ordinary skill in the art. The various embodiments may be implemented in accordance with methods, systems, or devices. Therefore, these embodiments may be implemented in hardware, in full software, or in a combination of software and hardware. Therefore, the following specific embodiments are not limiting.
[0050] The steps in each flow chart may be performed by hardware (e.g., processor, engine, memory, circuit), software (e.g., operating system, application, driver, machine / processor executable instructions), or a combination thereof. As will be appreciated by those skilled in the art, the methods involved in each embodiment may include more or fewer steps than shown.
[0051] In view of the traditional original storage of flight test data, which stores binary files in the data format formulated by the data acquisition equipment manufacturer, the version management problems caused by the separate storage of configuration files, and the situation that the original flight test data is mainly used as backup data, the present invention analyzes the tree structure attributes of the original data and the configuration files, and proposes a tree structure storage method and device for the original flight test data based on the time series data mode, which retains the flight test data attributes, adopts the time series data format to jointly store the original flight test data and the configuration files, simplifies data management, improves the data compression ratio, reduces data storage resources, and improves data query efficiency.
[0052] Various aspects of the present invention will be described in detail below.
[0053] Figure 1 It is a schematic block diagram of a device 100 for time-series storage of flight test data according to an embodiment of the present disclosure.
[0054] like Figure 1 As shown, in one embodiment of the present invention, the device 100 may include an attribute information extraction module 102, a tree structure generation module 104, a flight test raw data receiving and processing module 106, and a time series data file generation module 108. In this embodiment, Figure 1As shown, the attribute information extraction module 102 and the tree structure generation module 104 can be included in the flight test data acquisition system, and the flight test raw data receiving and processing module 106 and the time series data file generation module 108 can be included in the airborne real-time data processing system to implement a new flight test data processing architecture to improve flight test data management and query applications. As can be understood by those skilled in the art, any other suitable flight test data processing architecture can also be adopted, without being limited to the above-mentioned specific architecture.
[0055] In one embodiment of the present invention, the attribute information extraction module 102 may be configured to extract attribute information of the flight test configuration file. In this embodiment, the attribute information may include attribute information of the flight test data acquisition system and the data interface control document (ICD) written into the flight test data acquisition system, as well as attribute information used for data processing.
[0056] In one embodiment of the present invention, the tree structure generation module 104 may be configured to generate a tree structure of the flight test raw data in combination with the attribute information of the flight test configuration file. The tree structure may be used as a tree structure for storing the flight test configuration file and the flight test raw data, and the tree structure may include a time series data file as a leaf node. In this embodiment, the tree structure may be a root node-aircraft model-frame-flight-data acquisition equipment serial number-time series data file. As can be understood by those skilled in the art, the above-mentioned tree structure is merely exemplary and not restrictive, and any other suitable tree structure may also be used to store the flight test configuration file and the flight test raw data in other embodiments of the present invention.
[0057] In one embodiment of the present invention, the tree structure generating module 104 may be further configured to establish a hierarchical structure of the extracted attribute information and generate the tree structure corresponding to the hierarchical structure.
[0058] In one embodiment of the present invention, the flight test raw data receiving and processing module 106 may be configured to receive the flight test raw data, and classify the flight test raw data according to the network topology information of the flight test configuration file to establish a matching relationship with each level in the generated tree structure. In this embodiment, the network topology information may be associated with the acquisition device(s) in the flight test data acquisition system.
[0059] In one embodiment of the present invention, after the flight test raw data is classified, the flight test raw data receiving and processing module 106 can be further configured to: remove the Ethernet protocol header file of the flight test raw data; retain the application layer data file; and read the timestamp information in the application layer data file. In this embodiment, the timestamp information can then be used by the time series data file generation module 108 to generate an index identifier for the time series data file.
[0060] In one embodiment of the present invention, the time series data file generation module 108 can be configured to write the classified flight test raw data and the corresponding flight test configuration file into the time series data file in the tree structure. Thus, multiple time series can be constructed by classification, and the configuration file is stored as a time series file together with the flight test raw data according to the same tree structure level as the flight test raw data. In this embodiment, the time series data file can be multiple time series data files and stored in binary file mode, and the flight test raw data in the same time series data file are stored using the same message data. Thus, it can be ensured that the flight test raw data and configuration file of each flight are uniformly stored, and an internal association relationship is established through the time series storage method, so that the configuration file and the flight test raw data can be stored together, and the query call can be unified, so as to facilitate subsequent data management, data query, data analysis and other applications, and eliminate the version consistency problem caused by the separation management method.
[0061] In one embodiment of the present invention, the time series data file generation module 108 may be further configured to generate index identifiers for one or more time series data files using the timestamp information read from the application layer data file.
[0062] Figure 2 2 is a flow chart of a method 200 for time-series storage of flight test data according to an embodiment of the present disclosure. In an embodiment of the present invention, the method 200 may be performed at a flight test data acquisition system and an onboard real-time data processing system. As can be understood by those skilled in the art, the method 200 may also be performed at any other suitable place or in any other suitable manner.
[0063] like Figure 2 As shown, method 200 starts at step 202, extracting attribute information of the flight test configuration file. In one embodiment of the present invention, the attribute information may include attribute information of the flight test data acquisition system and the data interface control document written into the flight test data acquisition system, as well as attribute information used for data processing.
[0064] Next, method 200 proceeds to step 204, generating a tree structure of the raw flight test data in combination with the attribute information, the tree structure being used as a storage tree structure for the flight test configuration file and the raw flight test data and including a time series data file as a leaf node. In one embodiment of the present invention, generating a tree structure of the raw flight test data in combination with the attribute information may further include establishing a hierarchical structure of the attribute information and generating the tree structure corresponding to the hierarchical structure. In one embodiment of the present invention, the tree structure may be a root node-aircraft model-frame-flight number-data acquisition device serial number-time series data file.
[0065] Then, the method 200 proceeds to step 206 to receive the raw flight test data. In one embodiment of the present invention, the raw flight test data may be sent by the flight test data acquisition system via an airborne network and received by an airborne real-time data processing system.
[0066] Next, method 200 proceeds to step 208, classifying the raw flight test data according to the network topology information of the flight test configuration file to establish a matching relationship with each level in the tree structure. In one embodiment of the present invention, the network topology information may be associated with a collection device in a flight test data collection system. In another embodiment of the present invention, after classifying the raw flight test data, the method may further include: removing the Ethernet protocol header file of the raw flight test data; retaining the application layer data file; and reading the timestamp information in the application layer data file.
[0067] Finally, method 200 proceeds to step 210, where the classified raw flight test data and the corresponding flight test configuration file are written into the time series data file. In one embodiment of the present invention, the method may further include using the timestamp information to generate an index identifier for the time series data file, and the time series data file may be multiple time series data files and stored in a binary file format, and the raw flight test data in the same time series data file may be stored using the same message data.
[0068] After step 210 , method 200 ends.
[0069] In summary, the method and device for storing raw flight test data in a tree structure based on a time series data mode proposed in the present invention can achieve significant results in saving flight test data storage resources and simplifying data management, as follows:
[0070] 1) Save 2-5 times of data storage resources. Traditional flight test raw data is stored in binary files without compression, while the present invention adopts a time series storage method and a high compression ratio algorithm to compress the raw data and save data storage resources;
[0071] 2) Simplify flight test data management. Compared with the existing method of storing original flight test data and configuration files separately, the present invention adopts a unified time series storage method to ensure data consistency. There is no need to establish additional associations to manage original flight test data and configuration files, which simplifies the management mode of original flight test data and configuration files.
[0072] Embodiments of the present invention have been described above with reference to block diagrams and / or the operating instructions of methods, systems, and computer program products according to embodiments of the present invention. Each function / action noted in the frame may occur in an order different from that shown in any flow chart. For example, depending on the function / action involved, two frames shown in succession may actually be performed substantially simultaneously, or these frames may sometimes be performed in an opposite order.
[0073] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.
Claims
1. A method for time series storage of flight test data, comprising: Extract the attribute information of the flight test configuration file; generating a tree structure of the flight test raw data in combination with the attribute information, wherein the tree structure is used as a storage tree structure of the flight test configuration file and the flight test raw data and includes a time series data file as a leaf node; Receiving the raw flight test data; Classifying the original flight test data according to the network topology information of the flight test configuration file to establish a matching relationship with each level in the tree structure; as well as The classified raw flight test data and the corresponding flight test configuration file are written into the time series data file.
2. The method of claim 1, wherein: The method is performed at a flight test data acquisition system and an airborne real-time data processing system, the flight test raw data is sent by the flight test data acquisition system via an airborne network and received by the airborne real-time data processing system, and The attribute information includes the attribute information of the flight test data acquisition system and the data interface control document written into the flight test data acquisition system and the attribute information used for data processing.
3. The method as claimed in claim 1, wherein the network topology information is associated with the acquisition equipment in the flight test data acquisition system, and the tree structure is root node-aircraft model-frame-flight number-data acquisition equipment serial number-the timing data file.
4. The method of claim 1, wherein generating a tree structure of the flight test raw data in combination with the attribute information further comprises establishing a hierarchical structure of the attribute information and generating the tree structure corresponding to the hierarchical structure.
5. The method according to claim 1, wherein after classifying the raw flight test data, the method further comprises: Cutting off the Ethernet protocol header file of the raw flight test data; Keep application layer data files; as well as Read the timestamp information in the application layer data file.
6. The method of claim 5, wherein the method further comprises using the timestamp information to generate an index identifier for the time series data file.
7. A device for time series storage of flight test data, the device comprising: An attribute information extraction module, configured to extract attribute information of a flight test configuration file; a tree structure generating module, configured to generate a tree structure of the flight test raw data in combination with the attribute information, the tree structure being used as a storage tree structure of the flight test configuration file and the flight test raw data and including a time series data file as a leaf node; The flight test raw data receiving and processing module is configured to: Receiving the raw flight test data; Classifying the original flight test data according to the network topology information of the flight test configuration file to establish a matching relationship with each level in the tree structure; as well as A time series data file generating module is configured to write the classified flight test raw data and the corresponding flight test configuration file into the time series data file.
8. The device as claimed in claim 7, wherein the attribute information extraction module and the tree structure generation module are included in a flight test data acquisition system, and the flight test raw data receiving and processing module and the timing data file generation module are included in an airborne real-time data processing system. 9 . The apparatus of claim 7 , wherein the tree structure generating module is further configured to establish a hierarchical structure of the attribute information and generate the tree structure corresponding to the hierarchical structure.
10. The device according to claim 7, wherein after classifying the raw flight test data, the raw flight test data receiving and processing module is further configured to: Cutting off the Ethernet protocol header file of the raw flight test data; Preserve application layer data files; and Read the timestamp information in the application layer data file.
11. The apparatus as claimed in claim 10, wherein the time series data file generation module is further configured to use the timestamp information to generate an index identifier for the time series data file.
12. A computer-readable storage medium having computer-executable instructions stored thereon, wherein when the computer-executable instructions are executed by a processor, the processor is caused to perform the method according to any one of claims 1 to 6.