A metadata-based simulation system data transmission method and system

Abstract

The application provides a metadata-based simulation system data transmission method and system, which provides a compressible and tailorable data transmission system for simulation model data interaction between different simulation nodes in a simulation system. The system comprises a data analysis module, a data tailoring module and a data assembly module. The data analysis module analyzes the structure of the transmission data according to pre-defined structure metadata information of the transmission data, and decomposes the data into a plurality of data items; the data tailoring module sequentially traverses the data item list generated by the analysis, judges whether the data item needs to be tailored according to the value change of the data item, and finally generates a tailored data item list, which is the data item list for transmission; and the data assembly module assembles the tailored data item with the received data item after receiving the data item list for transmission, to form a complete transmission data structure.

Description

Technical Field

[0001] This invention relates to a data transmission method and system for a simulation system based on metadata. Background Technology

[0002] Current simulation systems consist of multiple simulation models. During system operation, these models frequently interact, generating a large amount of network data transmission. When the interaction between simulation models is frequent and the data transmission volume is large, network latency occurs, leading to inconsistencies in the simulation system's timing and affecting its correctness.

[0003] Currently, data transmission between simulation models mostly uses the TCP protocol, which lacks corresponding optimization for the transmitted data itself, resulting in a large amount of redundant data being repeatedly transmitted over the network. Summary of the Invention

[0004] Purpose of the Invention: During the operation of a simulation system, simulation models need to interact with each other, thus generating a large amount of network transmission data. The primary objective of this invention is to provide a metadata-based descriptive method to provide a structured description of the data transmitted between simulation models, standardize various structured data, and achieve descriptive data structures.

[0005] Because the interaction data between simulation models is information-rich and frequent, the same data is sometimes transmitted repeatedly, resulting in a large amount of redundant network data. Therefore, the second objective of this invention is to provide an optimization method for simulation data transmission. Based on the metadata description information of the simulation data, data is trimmed at the data sender and reassembled at the data receiver. By trimming duplicate data, the amount of redundant data transmitted over the network is reduced, thereby improving network efficiency.

[0006] To achieve the above objectives, the present invention adopts the following technical solution: a data transmission method for a simulation system based on metadata, comprising the following steps:

[0007] Step 1, Simulation Data Registration: Register the simulation data according to the simulation data description method. The registration information includes: the number of data items contained in the simulation data, the basic information and attribute information of each data item;

[0008] Step 2, Simulation Data Parsing: Establish a data necklace tablespace, and parse and decompose the simulation data according to the metadata information of each simulation data, decomposing it into two or more data items;

[0009] Step 3, Simulation Data Pruning: Based on the established linked list space, the simulation data is parsed and pruned to generate a data pruning number list. Initially, the data pruning number list is empty. Based on the attribute information and value space of each data item stored in the linked list space, the value of the data item is judged. If the pruning condition is met, the data item number is recorded, the data item is pruned, and the corresponding linked list space number is added to the data pruning number list for storage. If the pruning condition is not met, the data item value is recorded, and the process continues to traverse the next data item until all data item lists have been traversed.

[0010] Step 4, Simulation Data Assembly: Assemble the data items according to the received data item list and data clipping number list to form a complete transmission data structure.

[0011] In step 1, when registering simulation data, a data registration specification is provided. The data registration specification defines the method and content of the simulation data description sent or received by each simulation model. The data registration specification provides a simulation data description language (SDDL). The simulation data description language (SDDL) provides descriptions of the basic information, attribute information and structural information elements of the simulation data, including basic information tags and attribute information tags.

[0012] In step 1, the basic information tag is used to describe the basic information of the integrated simulation data, including the simulation data name and the number of data items. The simulation data name described by the basic information tag is unique.

[0013] The attribute information label is used to describe the attribute information of each simulation data item, including the data item name and the data item attribute description. The attribute information label includes variable attribute information and storage space information.

[0014] The variable attribute information is used to describe whether the value of a data item is a fixed value. If the value is 0, it means that the value space of the data item remains unchanged; if the value is 1, it means that the value space of the data item changes.

[0015] The storage space information is used to describe the size of the memory space occupied by the data item, in bytes.

[0016] In step 2, during the parsing and decomposition of the simulation data, a linked list space is first allocated for storing the simulation data. The linked list space stores the metadata information of each data item in the simulation data and the value of the current simulation data.

[0017] The metadata information includes a description of the data structure of the simulation data, including the number of data items in the simulation data, the storage space occupied by each data item, whether each data item is a variable value, and the value of the data item, etc.

[0018] The steps for generating linked list space include:

[0019] Step 2-1: Read the number of data items in the simulation data structure and establish a linked list structure storage space based on the number of data items;

[0020] Step 2-2: Based on the number of data items, traverse the metadata description information file (XML structure) of the simulation data, and read the basic information of each data item in a loop. The basic information includes the data item name, the data item storage space size, and the variable attribute value of the data item. Store the basic information in the corresponding linked list space.

[0021] In step 3, a comparison method based on attribute feature values ​​is used to prune data items with variable attribute information values ​​of 0, and the pruned data item number is recorded and added to the data item pruning list; for data items with variable attribute information values ​​of 1, the value space is compared, and if the current value is the same as the previous value, pruning is performed, the data item number is recorded, and added to the data item pruning list; under the initial condition, the value of each data item is empty.

[0022] In step 3, after the entire list of data items has been traversed, a cropped data necklace table and a list of cropped data item numbers are generated. The value of each data item in the cropped data necklace table and the list of cropped data item numbers are then sent to the recipient.

[0023] Step 4 includes the following steps:

[0024] Step 4-1: Based on the simulation data necklace tablespace information obtained from the parsing, traverse the list of received data items and update the value of each received data item to the corresponding data item in the data necklace tablespace.

[0025] Step 4-2: Traverse the data clipping number list, add the data item corresponding to each number in the list to the received simulation data list in order, and restore the received clipped simulation data to the original simulation data length.

[0026] The present invention also provides a simulation system data transmission system based on metadata, including a simulation data registration module, a data parsing module, a data trimming module and a data assembly module;

[0027] The simulation data registration module registers the simulation data according to the simulation data description method. The registration information includes: the number of data items contained in the simulation data, the basic information and attribute information of each data item;

[0028] The data parsing module establishes a data necklace tablespace, and parses and decomposes the simulation data into two or more data items based on the metadata information of each simulation data.

[0029] The data pruning module, based on the established linked list space, parses and prunes the simulation data, generating a data pruning number list. Initially, the data pruning number list is empty. Based on the attribute information and value space of each data item stored in the linked list space, the module judges the value of the data item. If the pruning condition is met, the data item number is recorded, the data item is pruned, and the corresponding linked list space number is added to the data pruning number list for storage. If the pruning condition is not met, the data item value is recorded, and the module continues traversing the next data item until all data item lists have been traversed.

[0030] The data assembly module assembles the data items according to the received data item list and data clipping number list to form a complete transmission data structure.

[0031] Beneficial Effects: The method and system of this invention reduce the transmission frequency of redundant data during simulation system operation by establishing a structured description of the simulation data. Through predefined simulation data metadata, the structured information of each simulation data point is dynamically parsed during system operation, and each data item is processed individually, enabling the trimming of the entire simulation data. Simultaneously, the trimmed data item values ​​and information are sent to the receiver. The receiver, in turn, iterates through the simulation data metadata to reassemble the received simulation data, restoring the trimmed data items to their corresponding positions, thereby ensuring the integrity and correctness of the simulation data. Attached Figure Description

[0032] The present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments, and the advantages of the present invention in the above and / or other aspects will become clearer.

[0033] Figure 1 This is a schematic diagram of the data trimming process of the present invention.

[0034] Figure 2 This is a diagram showing the list of data to be sent after cropping.

[0035] Figure 3 This is a diagram illustrating the data items to be cut.

[0036] Figure 4 This is the system architecture diagram of the present invention. Detailed Implementation

[0037] This invention provides a metadata-based data transmission method for a simulation system, comprising the following steps:

[0038] Step 1, Simulation Data Registration: Register the simulation data according to the simulation data description method. The registration information includes: the number of data items contained in the simulation data, the basic information and attribute information of each data item;

[0039] Step 2, Simulation Data Parsing: Establish a data necklace tablespace, and parse and decompose the simulation data according to the metadata information of each simulation data, decomposing it into two or more data items;

[0040] Step 3, Simulation Data Pruning: Based on the established linked list space, the simulation data is parsed and pruned to generate a data pruning number list. Initially, the data pruning number list is empty. Based on the attribute information and value space of each data item stored in the linked list space, the value of the data item is judged. If the pruning condition is met, the data item number is recorded, the data item is pruned, and the corresponding linked list space number is added to the data pruning number list for storage. If the pruning condition is not met, the data item value is recorded, and the process continues to traverse the next data item until all data item lists have been traversed.

[0041] Step 4, Simulation Data Assembly: Assemble the data items according to the received data item list and data clipping number list to form a complete transmission data structure.

[0042] In step 1, when registering simulation data, a data registration specification is provided. The data registration specification defines the method and content of the simulation data description sent or received by each simulation model. The data registration specification provides a simulation data description language (SDDL). The simulation data description language (SDDL) provides descriptions of the basic information, attribute information and structural information elements of the simulation data, including basic information tags and attribute information tags.

[0043] In step 1, the basic information tag is used to describe the basic information of the integrated simulation data, including the simulation data name and the number of data items. The simulation data name described by the basic information tag is unique.

[0044] The attribute information label is used to describe the attribute information of each simulation data item, including the data item name and the data item attribute description. The attribute information label includes variable attribute information and storage space information.

[0045] The variable attribute information is used to describe whether the value of a data item is a fixed value. If the value is 0, it means that the value space of the data item remains unchanged; if the value is 1, it means that the value space of the data item changes.

[0046] The storage space information is used to describe the size of the memory space occupied by the data item, in bytes.

[0047] In step 2, during the parsing and decomposition of the simulation data, a linked list space is first allocated for storing the simulation data. The linked list space stores the metadata information of each data item in the simulation data and the value of the current simulation data.

[0048] The metadata information includes a description of the data structure of the simulation data, including the number of data items in the simulation data, the storage space occupied by each data item, whether each data item is a variable value, and the value of the data item, etc.

[0049] The steps for generating linked list space include:

[0050] Step 2-1: Read the number of data items in the simulation data structure and establish a linked list structure storage space based on the number of data items;

[0051] Step 2-2: Based on the number of data items, traverse the metadata description information file (XML structure) of the simulation data, and read the basic information of each data item in a loop. The basic information includes the data item name, the data item storage space size, and the variable attribute value of the data item. Store the basic information in the corresponding linked list space.

[0052] In step 3, a comparison method based on attribute feature values ​​is used to prune data items with variable attribute information values ​​of 0, and the pruned data item number is recorded and added to the data item pruning list; for data items with variable attribute information values ​​of 1, the value space is compared, and if the current value is the same as the previous value, pruning is performed, the data item number is recorded, and added to the data item pruning list; under the initial condition, the value of each data item is empty.

[0053] In step 3, after the entire list of data items has been traversed, a cropped data necklace table and a list of cropped data item numbers are generated. The value of each data item in the cropped data necklace table and the list of cropped data item numbers are then sent to the recipient.

[0054] Step 4 includes the following steps:

[0055] Step 4-1: Based on the simulation data necklace tablespace information obtained from the parsing, traverse the list of received data items and update the value of each received data item to the corresponding data item in the data necklace tablespace.

[0056] Step 4-2: Traverse the data clipping number list, add the data item corresponding to each number in the list to the received simulation data list in order, and restore the received clipped simulation data to the original simulation data length.

[0057] like Figure 4As shown, the present invention also provides a simulation system data transmission system based on metadata, including a simulation data registration module, a data parsing module, a data trimming module and a data assembly module;

[0058] The simulation data registration module registers the simulation data according to the simulation data description method. The registration information includes: the number of data items contained in the simulation data, the basic information and attribute information of each data item;

[0059] The data parsing module establishes a data necklace tablespace, and parses and decomposes the simulation data into two or more data items based on the metadata information of each simulation data.

[0060] The data pruning module, based on the established linked list space, parses and prunes the simulation data, generating a data pruning number list. Initially, the data pruning number list is empty. Based on the attribute information and value space of each data item stored in the linked list space, the module judges the value of the data item. If the pruning condition is met, the data item number is recorded, the data item is pruned, and the corresponding linked list space number is added to the data pruning number list for storage. If the pruning condition is not met, the data item value is recorded, and the module continues traversing the next data item until all data item lists have been traversed.

[0061] The data assembly module assembles the data items according to the received data item list and data clipping number list to form a complete transmission data structure.

[0062] When deploying a simulation system, the metadata-based simulation system data transmission system provided by this invention can be deployed on any computer where the simulation model is located.

[0063] The simulation data description file will include the following new elements: basic information tags for simulation data items, data item type information tags, and data item spatial information tags. The basic information tags define the basic attributes of each data item, including the data item number and data item name. The data item type information tags are nested within the basic information element tags, forming a one-to-one relationship. Similarly, the simulation data item spatial information tags are nested within the basic information element tags, also forming a one-to-one relationship.

[0064] After the simulation data is described, a description file is generated for each model to generate interaction data. This file contains structured information about all interaction data of the simulation model. The data parsing module, data trimming module, and data assembly module use the interaction data description file.

[0065] The data parsing module decomposes the simulation data into several independent data items based on the structured description information of each simulation data item, generates a data necklace table, and saves the linked list information; the data necklace table records the position information and key-value information of each data item in the simulation data.

[0066] The data trimming module iterates through the generated data item list, obtains the key value of the currently transmitted data item based on the data item name, and compares it with the key value of the previously transmitted data item. If there is no change, the data item is trimmed, and the data item number is recorded. If the key value of the data item changes, the key value and number of the data item are added to the transmitted data item list. This process is repeated until all data items have been traversed. After the traversal is completed, the generated transmitted data item list is sent.

[0067] Upon receiving the simulation data, the data assembly module iterates through the received list of transmitted data items, obtaining the key values ​​and corresponding data item numbers for all data items in the list. It then iterates through the metadata information corresponding to the simulation data, comparing the obtained simulation data item numbers with the numbers in the list of transmitted data items. If the data item number appears in the list, the latest key value corresponding to that data item is updated and assigned. After the transmission data item list is traversed, the module re-traverses the simulation data item list for any data items that have not been updated, directly obtaining and assigning the corresponding key values. Finally, based on the order of the data items in the metadata information corresponding to the simulation data, the newly assigned data items and the unupdated data items are assembled and spliced ​​together to form complete data, which is then submitted to the application.

[0068] Example

[0069] like Figure 1 As shown, this invention provides a data transmission method and system for a simulation system based on metadata, comprising the following steps:

[0070] Step 1: This invention provides a data registration specification. This specification defines the method and content of describing simulation data sent or received by each simulation model. This specification provides a Simulation Data Description Language (SDDL). SDDL is a hierarchical, tree-like, and extensible text tagging language proposed to support simulation data description during simulation model integration. It provides descriptions of basic information, attribute information, and structural information elements of simulation data. It mainly includes two types of tags, including:

[0071] (1) Basic Information Tags

[0072] This label describes basic information about the integrated simulation data, including the simulation data name and the number of data items. The simulation data name described in the basic information label must be unique.

[0073] (2) Attribute information tags

[0074] This label describes the attribute information of each simulation data item, including the data item name and attribute description. Attribute information labels include: variable attribute information and storage space information.

[0075] Variable attribute information is used to describe whether the value of the data item is fixed. If the value is 0, it means that the value space of the data item remains unchanged; if the value is 1, it means that the value space of the data item changes.

[0076] Storage space information describes the size of the memory space occupied by the data item, in bytes.

[0077] Its specific form is as follows:

[0078] Attribute name = "Attribute value"

[0079] For example: <target longitude variable=1 space=4 / > describes a data item named "target longitude", whose value space is variable and occupies 4 bytes of memory space.

[0080] Taking a radar simulation model as an example, this model simulates the process of detecting aerial targets and transmitting the detected aerial target information. The target data structure is named FlyObject. The data item information of this data structure is shown in the table below.

[0081]

[0082]

[0083] The description of each data item in this data structure is shown in Table 1 below.

[0084] Table 1

[0085]

[0086] Based on the key characteristics and change features of each data item, the metadata of the FlyObject data structure is as follows when it is registered:

[0087]

[0088]

[0089]

[0090]

[0091]

[0092] Step 2, Data Parsing. In this step, the sender needs to parse each piece of data, breaking it down into data items and generating a list of data items.

[0093] Step 3, Data Pruning. In this step, the sender iterates through the generated list of data items and prunes them based on the attribute values ​​of each item. For data items with a variable attribute of 0, they are pruned directly. For data items with an attribute of 1, the current value of the data item is compared with the previous value; if the values ​​are the same, it is pruned. After pruning, 9 data items are retained, and the metadata list is as follows:

[0094]

[0095]

[0096]

[0097] The truncated data to be sent includes two lists, the first of which is as follows: Figure 2 As shown:

[0098] Figure 2 This describes the content information of the sent data. Each sent data item consists of three columns: the first column represents the metadata sequence number corresponding to the data item, the second column is the data item name, and the third column is the memory space occupied by the data item.

[0099] The second list describes the data items to be clipped, such as... Figure 3 As shown;

[0100] Step 4, Data Assembly. In this step, the information receiver receives the sent data and assembles it based on the metadata information, restoring the values ​​of data items deleted before sending to the data object.

[0101] This invention provides a method and system for data transmission in a simulation system based on metadata. Many methods and approaches exist for implementing this technical solution; the above description is merely a preferred embodiment of the invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of this invention, and these improvements and modifications should also be considered within the scope of protection of this invention. All components not explicitly stated in this embodiment can be implemented using existing technologies.

Claims

1. A metadata-based simulation system data transmission method, characterized in that, The method comprises the following steps: Step 1, simulation data registration: according to the simulation data description method, the simulation data is registered, and the registered information includes: the number of data items contained in the simulation data, the basic information and attribute information of each data item; Step 2, simulation data analysis: a data item linked list space is established, and according to the metadata information of each simulation data, the simulation data is analyzed and decomposed into two or more data items; Step 3, simulation data cutting: based on the established data item linked list space, the simulation data is analyzed and cut, a data cutting number list is generated, and under the initial condition, the data cutting number list is empty: according to the attribute information and value space of each data item stored in the linked list space, the value of the data item is judged, if it meets the cutting condition, the data item number is recorded, the data item is cut, and the linked list space number corresponding to the data item is added to the data cutting number list for storage; if it does not meet the cutting condition, the data item value is recorded, and the next data item is traversed until all data item lists are traversed; Step 4, simulation data assembly: according to the received data item list and data cutting number list, the data items are assembled to form a complete transmission data structure; In step 1, when the simulation data is registered, a data registration specification is provided, which specifies the way and content of the simulation data description sent or received by each simulation model, and the data registration specification provides a simulation data description language SDDL, which respectively provides descriptions for the basic information of the simulation data, the attribute information and structure information of the simulation data item, and contains basic information tags and attribute information tags; In step 1, the basic information tag is used to describe the basic information of the integrated simulation data, including the simulation data name, the number of data items, and the simulation data name described by the simulation data basic information tag is unique; The attribute information tag is used to describe the attribute information of each simulation data item, including the data item name and the data item attribute description, and the attribute information tag includes variable attribute information and storage space information; The variable attribute information is used to describe whether the data item value is a fixed value, if the value is 0, it means that the data item value space is constant; if the value is 1, it means that the data item value space changes; The storage space information is used to describe the memory space size occupied by the data item, and the unit is byte number; In step 2, during the process of analyzing and decomposing the simulation data, the storage linked list space of the simulation data is first allocated, and the content stored in the linked list space is the metadata information of each data item in the simulation data and the value of the current simulation data; The metadata information includes the description content of the data structure of the simulation data, including the number of data items in the simulation data, the storage space size occupied by each data item, whether each data item is a variable value, and the data item value; In step 2, the linked list space generation step comprises: Step 2-1, read the number of data items of the simulation data structure, and establish the linked list structure storage space according to the number of data items; Step 2-2, according to the number of data items, traverse the metadata description information file of the simulation data, cyclically read the basic information of each data item, the basic information including data item name, data item storage space size, data item variable attribute value, store the basic information to the corresponding linked list space; In step 3, the variable attribute information of the data item is taken as 0, and the data item number is recorded, and the data item pruning list is added; In step 3, the variable attribute information of the data item is taken as 1, and the data item number is recorded, and the data item pruning list is added; the initial condition is that the value of each data item is empty; In step 3, after the whole data item list traversal is completed, the pruned data item linked list and the pruned data item number list are generated, and the value of each data item in the pruned data item linked list and the data item pruning number list are sent to the receiver; Step 4 includes the following steps: Step 4-1, according to the simulation data item linked list space information obtained by parsing, traverse the received data item list, and update the value of each received data item to the corresponding data item in the data item linked list space; Step 4-2, traverse the data pruning number list, and add each number corresponding data item to the received simulation data list in order, and restore the received pruned simulation data to the original simulation data length.

2. A metadata based simulation system data transfer system implemented based on the method as claimed in claim 1, characterized by, The simulation data registration module, the data parsing module, the data pruning module and the data assembly module are included; The simulation data registration module registers the simulation data according to the simulation data description method, and the registered information includes: the number of data items contained in the simulation data, the basic information of each data item and the attribute information; The data parsing module establishes a data item linked list space, parses and decomposes the simulation data according to the metadata information of each simulation data, and decomposes it into two or more data items; The data pruning module prunes the simulation data based on the established data item linked list space, generates a data pruning number list, and the initial condition is that the data pruning number list is empty: according to the attribute information and value space of each data item stored in the linked list space, the value of the data item is judged, if it meets the pruning condition, the data item number is recorded, the data item is pruned, and the linked list space number corresponding to the data item is added to the data pruning number list for saving; if it does not meet the pruning condition, the data item value is recorded, and the next data item is traversed until all data item lists are traversed; The data assembly module assembles the data items according to the received data item list and data pruning number list to form a complete transmission data structure.

Images