An efficient and easy-to-use method for multi-source heterogeneous data fusion

By initializing the interface state and establishing a bidirectional communication link, and combining time correlation algorithms to process multi-source heterogeneous data, the problem of data fusion in multi-sensor systems is solved, and an efficient and easy-to-use data fusion method is realized.

CN117931904BActive Publication Date: 2026-11-17JIANGSU AUTOMATION RESEARCH INSTITUTE +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311722200.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-12-13
Publication Date
2026-11-17
Estimated Expiration
2043-12-13

AI Technical Summary

Technical Problem

Existing technologies suffer from inconsistencies in protocols and interfaces during the synchronous acquisition and interaction of data from multiple sensors and actuators. This makes the unified acquisition and interaction of heterogeneous data from multiple sources cumbersome and difficult. Furthermore, existing methods struggle to efficiently handle the conversion and acquisition tasks of more than two interfaces or protocols.

Method used

By reading the interface group protocol configuration table stored in the erasable and rewritable storage unit, the interface state is initialized, and a bidirectional communication link is established using the interface group interconnection matrix. The timed task and dynamically configured data server are started, and the data is tagged and serialized using a time correlation algorithm to achieve the fusion of multi-source heterogeneous data.

Benefits of technology

It can widely adapt to sensors and actuators with different interfaces and protocol specifications, accurately describe the temporal correlation of data, reduce the difficulty of multi-source heterogeneous data fusion, and improve fusion efficiency and ease of use.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117931904B_ABST
    Figure CN117931904B_ABST
Patent Text Reader

Abstract

This invention discloses an efficient and easy-to-use method for multi-source heterogeneous data fusion. First, it reads the protocol configuration tables of each interface group stored in an erasable and rewritable memory unit to initialize the physical and logical states of the interfaces. Then, it reads the interface group interconnection matrix to initialize the bidirectional communication links between interfaces. Next, it starts a timed task and a dynamically configurable data server to track and publish data from each interface source. When data is captured, a time correlation algorithm is used to tag and serialize the data from each interface group and cache it in the database. The data server dynamically updates the data, completing the multi-source heterogeneous data fusion. This method can be widely adapted to sensors and actuators with different interfaces and protocol specifications, simultaneously handling the acquisition and publishing tasks of multiple heterogeneous data sources. It can accurately describe the time correlation of each source data and perform edge fusion calculations, thereby reducing the difficulty of multi-source heterogeneous data fusion processing and improving fusion efficiency and ease of use.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention belongs to the field of sensor signal data processing, specifically relating to an efficient and easy-to-use method for fusing multi-source heterogeneous data. Background Technology

[0002] In the existing industrial control field, in scenarios such as automated production lines and robot operations, there is a process of synchronous data acquisition, decision-making, and data interaction involving multiple sensors and actuators. However, due to the different times when the protocols were developed, the different problems they solve, and the different focus of the scenarios they are adapted to, the existing protocols have problems such as inconsistent voltage levels, inconsistent physical interfaces, and inconsistent protocol content, which makes the unified acquisition and interaction of multi-source heterogeneous data cumbersome and difficult.

[0003] Current solutions to such problems generally involve protocol conversion software or data acquisition gateways. The former requires configuring a computer and installing various protocol communication software, as well as some degree of program customization. While the latter has completed the development of protocol acquisition and conversion, it typically only performs pairwise protocol conversions according to the set acquisition cycle and parameters. Furthermore, the setup process requires a wired connection to a host computer via a dedicated interface, with separate configuration and distribution via host computer configuration software. Once configured, the protocol acquisition or conversion logic is fixed, resulting in a single conversion method and difficulty in handling efficient conversion and acquisition tasks for more than two interfaces or protocols, making configuration cumbersome. The above methods or devices do not provide efficient and easy-to-use solutions for the unified acquisition, caching, and fusion of multi-source heterogeneous data. Summary of the Invention

[0004] To address the aforementioned problems, the present invention aims to provide an efficient and easy-to-use method for fusing multi-source heterogeneous data.

[0005] The specific technical solution for achieving the objective of this invention is as follows:

[0006] An efficient and easy-to-use method for fusing multi-source heterogeneous data includes the following steps:

[0007] Step 1: Read the protocol configuration table of each interface group stored in the erasable and writable storage unit, and initialize the physical and logical states of the interface;

[0008] Step 2: Read the interface group interconnection matrix and initialize the bidirectional communication link between interfaces;

[0009] Step 3: Start the scheduled task and the dynamically configurable data server to track and publish data from each interface source;

[0010] Step 4: When capturing data, use a time correlation algorithm to tag and serialize the data of each interface group and cache it in the database. The data server will then dynamically update the data to complete the fusion of multi-source heterogeneous data.

[0011] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0012] This method initializes the physical and logical states of interfaces by parsing the protocol configuration tables and level configuration tables of each interface group stored in the erasable and rewritable memory unit. It then initializes the bidirectional communication links between interfaces by parsing the interface group interconnection matrix. Simultaneously, it initiates a timed task and a dynamically configurable data server to track and publish data from each interface source. When data is captured, a time correlation algorithm is used to tag and serialize the data from each interface group and cache it in the database, thus completing the multi-source heterogeneous data fusion task. This method is widely adaptable to sensors and actuators with different interface and protocol specifications, and can simultaneously handle the acquisition and publishing tasks of multiple heterogeneous data sources. It can accurately describe the time correlation of each source data and perform edge fusion calculations, thereby reducing the difficulty of multi-source heterogeneous data fusion processing and improving fusion efficiency and ease of use.

[0013] The present invention will be further described below with reference to specific embodiments. Attached Figure Description

[0014] Figure 1 This is a schematic diagram of the efficient and easy-to-use multi-source heterogeneous data fusion method of the present invention.

[0015] Figure 2 This is a schematic diagram of the system configuration in an embodiment of the present invention.

[0016] Figure 3 This is a schematic diagram illustrating the specific process of an embodiment of the present invention.

[0017] Figure 4 This is a schematic representation of the protocol configuration of each interface group in the embodiments of the present invention.

[0018] Figure 5 This is a schematic diagram of the time correlation algorithm in an embodiment of the present invention.

[0019] Figure 6 This is a schematic diagram of the fusion valid flag determination process in an embodiment of the present invention. Detailed Implementation

[0020] An efficient and easy-to-use method for fusing multi-source heterogeneous data includes the following steps:

[0021] Step 1: Read the protocol configuration table of each interface group stored in the erasable and writable storage unit, and initialize the physical and logical states of the interface;

[0022] The interface group protocol configuration table includes an enumeration variable of interface group member bus types, an enumeration variable of interface group bus protocols, an interface group protocol parameter description table, and an array of interface group address ranges.

[0023] The enumerated variables of the bus types in the interface group include RS232, RS485, RS422, CAN, and network interface;

[0024] The interface group bus protocol enumeration variables include MODBUS-RTU, MODBUS-TCP, CAN-OPEN, TCPSERVER / CLIENT, HTTP, and PROFIBUS;

[0025] The interface group protocol parameter description table sets different descriptions for different protocols.

[0026] Step 2: Read the interface group interconnection matrix and initialize the bidirectional communication link between interfaces;

[0027] The interface group interconnection matrix is ​​an N*N matrix, where each independent element represents the interconnection relationship between a pair of interfaces, including the overall interconnection enable flag E1, the uplink interconnection enable flag E1, the downlink interconnection enable flag E3, the interconnection address range ADDR, and the upper limit of the interconnection rate RATE.

[0028]

[0029]

[0030] Among them, F mn This indicates the interconnection relationship between interface number m and interface number n. The overall interconnection enable flag E1 indicates whether the communication link is enabled for this cross-connection pair; the uplink interconnection enable flag E2 indicates whether communication from m to n is enabled for this cross-connection pair; the downlink interconnection enable flag E3 indicates whether communication from n to m is enabled for this cross-connection pair; the interconnection address range ADDR indicates the address pool for which this cross-connection pair can perform interoperation communication; and the maximum interconnection rate RATE indicates the maximum communication control rate for this cross-connection pair.

[0031] Step 3: Start the scheduled task and the dynamically configurable data server to track and publish data from each interface source;

[0032] Step 4: When capturing data, use a time correlation algorithm to tag and serialize the data of each interface group and cache it in the database. The data server will then dynamically update the data to complete the fusion of multi-source heterogeneous data.

[0033] The process of the time correlation algorithm is as follows:

[0034] Determine the failure time of the interface data fusion itself;

[0035] Determine the timeframe for interface data fusion and collaboration;

[0036] Perform fusion operations on the data according to the fusion operation formula;

[0037] The determined interface data fusion failure time is restored to its initial value after the latest data is generated and the count is continuously reduced with the system cycle. When the count is 0, it means that the data has expired.

[0038] The fusion and collaboration time recovers to its initial value after the latest data is generated and decreases continuously with the system cycle. When the count is 0, it means that the fusion period of this data with other interface group data has expired.

[0039] The fusion expression can be any valid multi-input single-output mathematical expression;

[0040] The fusion validity flag indicates whether the current multi-source data fusion result is valid.

[0041] The validity of the current multi-source data fusion result is determined based on the fusion validity indicator, specifically:

[0042] First, the interface data fusion failure time is checked. If it is not 0, the next step is checked. Otherwise, the fusion validity flag is set to false and the operation is exited.

[0043] Then, the interface group interconnection matrix is ​​scanned, and all interface data fusion and coordination times of data sources with interconnection flags are extracted, sorted to obtain the maximum time difference and minimum time. When the minimum time is non-zero and the maximum time difference is less than the set fusion time tolerance threshold, the fusion valid flag is set to true; otherwise, the fusion valid flag is set to false, and the judgment of the fusion valid flag ends.

[0044] The data server is built on a data server with publish-subscribe functionality, enabling dynamic addition and deletion of data tags and providing fused data to the cascading interconnection interface.

[0045] The process of dynamically adding and deleting data tags is as follows:

[0046] When any interface group data source generates data, first scan the data server to see if a data tag item consistent with the newly added data has been established. If not, automatically create a new data tag according to the interface group name and data characteristics, and set the flag that the data server can be restarted.

[0047] When the failure time of data fusion of each interface decreases to 0, a deletion timer is started and decreases with the system time. When the count is 0, the data tag item is deleted and the flag that the data server can be restarted is set.

[0048] The data server checks the restart flag at regular intervals. When the flag is set, the data server is immediately interrupted, new parameters are loaded, and then the server is restarted.

[0049] The process of providing fused data to the cascading interconnection interface is as follows:

[0050] When the fusion valid flag is true, the fused data is cached in the data server database after being overlaid with the system timestamp and unread flag, and the fused data is notified to the connected data server client on the cascaded interconnection interface in the form of an event that the fused data has been updated.

[0051] Example

[0052] Combination Figure 1 An efficient and easy-to-use method for fusing multi-source heterogeneous data includes the following steps:

[0053] Step 1: Read the protocol configuration table of each interface group stored in the erasable and writable storage unit, and initialize the physical and logical states of the interface;

[0054] The interface group protocol configuration table includes an enumeration variable of interface group member bus types, an enumeration variable of interface group bus protocols, an interface group protocol parameter description table, and an array of interface group address ranges.

[0055] The enumerated variables of the bus types in the interface group include RS232, RS485, RS422, CAN, and network interface;

[0056] The interface group bus protocol enumeration variables include MODBUS-RTU, MODBUS-TCP, CAN-OPEN, TCPSERVER / CLIENT, HTTP, and PROFIBUS;

[0057] The interface group protocol parameter description table sets different descriptions for different protocols. For example, for MODBUS-RTP, it can be set to baud rate, parity bit, stop bit, whether there is a handshake signal, etc. The interface group address range array S14 can generally be set to [1,255] or [1,65535] according to the protocol, or to the address space specified by the operator on the human-machine interaction unit H7.

[0058] Combination Figure 2 The hardware operating environment in this embodiment includes a data fusion central processing unit H1, three sets of interface groups H2 to H4, a cascaded interface H5, a storage unit H6, and a human-machine interaction unit H7. The data fusion central processing unit H1 processes interface data and performs fusion calculations. The three sets of interface groups H2 to H4 are used to connect to external sensors or actuator communication buses, and are divided into three groups based on physical interface styles, which can respectively use DB9, RJ45, and 5.08 terminal blocks to provide external interface forms. The cascaded interface H5 is used to provide data services to data fusion requesters. The storage unit H6 provides a carrier for data caching and persistent parameter storage.

[0059] Step 2: Read the interface group interconnection matrix and initialize the bidirectional communication link between interfaces;

[0060] The interface group interconnection matrix is ​​an N*N matrix, where each independent element represents the interconnection relationship between a pair of interfaces, including the overall interconnection enable flag E1, the uplink interconnection enable flag E1, the downlink interconnection enable flag E3, the interconnection address range ADDR, and the upper limit of the interconnection rate RATE.

[0061]

[0062]

[0063] Among them, F mn This indicates the interconnection relationship between interface number m and interface number n. The overall interconnection enable flag E1 indicates whether the communication link is enabled for this cross-connection pair; the uplink interconnection enable flag E2 indicates whether communication from m to n is enabled for this cross-connection pair; the downlink interconnection enable flag E3 indicates whether communication from n to m is enabled for this cross-connection pair; the interconnection address range ADDR indicates the address pool for which this cross-connection pair can perform interoperation communication; and the maximum interconnection rate RATE indicates the maximum communication control rate for this cross-connection pair.

[0064] Step 3: Start the scheduled task and the dynamically configurable data server to track and publish data from each interface source;

[0065] Step 4, Combining Figures 3 to 5 When capturing data, a time correlation algorithm is used to tag and serialize the data of each interface group and cache it in the database. The data server performs dynamic updates to complete the fusion of multi-source heterogeneous data.

[0066] The process of the time correlation algorithm is as follows:

[0067] Determine the failure time of the interface data fusion itself;

[0068] Determine the timeframe for interface data fusion and collaboration;

[0069] Perform fusion operations on the data according to the fusion operation formula;

[0070] The determined interface data fusion failure time is restored to its initial value after the latest data is generated and the count is continuously reduced with the system cycle. When the count is 0, it means that the data has expired.

[0071] The fusion and collaboration time recovers to its initial value after the latest data is generated and decreases continuously with the system cycle. When the count is 0, it means that the fusion period of this data with other interface group data has expired.

[0072] The fusion expression can be any valid multi-input single-output mathematical expression;

[0073] The fusion validity flag indicates whether the current multi-source data fusion result is valid.

[0074] The validity of the current multi-source data fusion result is determined based on the fusion validity indicator, specifically:

[0075] First, the interface data fusion failure time is checked. If it is not 0, the next step is checked. Otherwise, the fusion validity flag is set to false and the operation is exited.

[0076] Then, the interface group interconnection matrix is ​​scanned, and all interface data fusion and coordination times of data sources with interconnection flags are extracted, sorted to obtain the maximum time difference and minimum time. When the minimum time is non-zero and the maximum time difference is less than the set fusion time tolerance threshold, the fusion valid flag is set to true; otherwise, the fusion valid flag is set to false, and the judgment of the fusion valid flag ends.

[0077] The data server is built upon a data server with publish / subscribe functionality, enabling dynamic addition and deletion of data tags and providing fused data to the cascading interface. In this example, an OPC UA server is used to construct a data server with publish / subscribe capabilities. The OPC UA server can then provide data transmission services to third-party connectors via the OPC UASERVER on the H5 cascading interface.

[0078] The process of dynamically adding and deleting data tags is as follows:

[0079] When any interface group's data source generates data, the system first scans the OPC UA server to see if a data tag entry consistent with the newly added data has been created. If not, a new data tag is automatically created based on the interface group name and data characteristics, and the OPC UA server restart flag is set. Once the fusion failure time of each interface's data decreases to 0, a deletion timer is started and decrements with the system time. When the count reaches 0, the data tag entry is deleted, and the OPC UA server restart flag is set. The OPC UA server checks the restart flag at regular intervals. When the flag is set, the data server is immediately interrupted, new parameters are loaded, and the server restarts. At this point, the latest data and fusion data results can be immediately obtained on the OPC UA server's cascaded port.

[0080] The process of providing fused data to the cascading interconnection interface is as follows:

[0081] When the fusion validity flag is true, the fused data is overlaid with a system timestamp and an unread flag and cached in the OPC UA data server database. The connected data server clients on the cascading interface are then notified via an event that the fused data has been updated. In this example, a MySQL database is used, and the connected OPC UA server clients on the cascading interface H5 are notified via an event that the fused data has been updated.

[0082] Specifically in this embodiment, combined with Figure 6 The main operating logic of the method is to read the protocol configuration parameters of each interface group, initialize the interface level, protocol and communication parameters K1 of each interface group member interface based on the parameters, then read the interface group interconnection matrix and determine whether to establish a communication link K2 based on the values ​​of each row and column element of the interconnection matrix, then connect to the local database to establish a time-related table and data cache pool K3 and start K4 to start the data interface timed communication task.

[0083] Subsequently, K5 establishes a subscription and publish data server to provide data services for the cascaded interfaces, K6 monitors changes in the parameters of the human-computer interaction unit, K7 monitors whether there are new data sources in each interface group, and K8 monitors whether there is new data on each port and enables time-related algorithms to calculate and merge data. K9 dynamically adds data tags in the data server and restarts the service.

[0084] This method can be widely adapted to sensors and actuators with different interfaces and protocol specifications, and can simultaneously handle the acquisition and distribution tasks of multiple heterogeneous data sources. It can accurately describe the temporal correlation of each source data and perform edge fusion operations, thereby reducing the difficulty of multi-source heterogeneous data fusion processing and improving fusion efficiency and ease of use.

[0085] The above embodiments illustrate and describe the basic principles and main features of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Various changes and modifications can be made to the present invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed.

Claims

1. A highly efficient and easy-to-use method for fusing multi-source heterogeneous data, characterized in that, Includes the following steps: Step 1: Read the protocol configuration table of each interface group stored in the erasable and writable storage unit, and initialize the physical and logical states of the interface; Step 2: Read the interface group interconnection matrix and initialize the bidirectional communication link between interfaces; The interface group interconnection matrix is ​​an N*N matrix, where each independent element represents the interconnection relationship between a pair of interfaces, including the overall interconnection enable flag, the uplink interconnection enable flag, the downlink interconnection enable flag, the interconnection address range, and the upper limit of the interconnection rate. ; ; Wherein, Interworking relationship between interface number m and interface number n E1 Indicates whether the cross-connect pair opens a communication link; interworking uplink enable flag E2 Indicates whether the cross-connect pair opens communication from m to n; interworking downlink enable flag E3 Indicates whether the cross-connect pair opens communication from n to m; interworking address interval ADDR Indicates the address pool that the cross-connect pair can interwork; interworking rate upper limit RATE Indicates the maximum communication control rate of the cross-connect pair; Step 3: Start the scheduled task and the dynamically configurable data server to track and publish data from each interface source; Step 4: When capturing data, a time correlation algorithm is used to tag and serialize the data from each interface group and cache it in the database. The data server then dynamically updates the data to complete the fusion of multi-source heterogeneous data. Determine the failure time of the interface data fusion itself; Determine the timeframe for interface data fusion and collaboration; Perform fusion operations on the data according to the fusion operation formula; Determine whether the current multi-source data fusion result is valid based on the fusion validity indicator; The process for determining the valid fusion flag is as follows: First, the interface data fusion failure time is checked. If it is not 0, the next step is checked. Otherwise, the fusion validity flag is set to false and the operation is exited. Then, the interface group interconnection matrix is ​​scanned, and all interface data fusion and coordination times of data sources with interconnection flags are extracted, sorted to obtain the maximum time difference and minimum time. When the minimum time is non-zero and the maximum time difference is less than the set fusion time tolerance threshold, the fusion valid flag is set to true; otherwise, the fusion valid flag is set to false, and the judgment of the fusion valid flag ends. The interface data fusion failure time recovers to its initial value after the latest data is generated and decreases continuously with the system cycle. When the count is 0, it means that the data has expired. The fusion and collaboration time recovers to its initial value after the latest data is generated and decreases continuously with the system cycle. When the count is 0, it means that the fusion period of this data with other interface group data has expired. The fusion expression can be any valid multi-input single-output mathematical expression; The fusion validity flag indicates whether the current multi-source data fusion result is valid.

2. The method as claimed in claim 1, wherein, The interface group protocol configuration table in step 1 includes interface group member bus type enumeration variables, interface group bus protocol enumeration variables, interface group protocol parameter description table, and interface group address range array.

3. The method of claim 2, wherein, The enumerated variables of the bus types in the interface group include RS232, RS485, RS422, CAN, and network interface; The interface group bus protocol enumeration variables include MODBUS-RTU, MODBUS-TCP, CAN-OPEN, TCP SERVER / CLIENT, HTTP, and PROFIBUS; The interface group protocol parameter description table sets different descriptions for different protocols.

4. The efficient and easy-to-use multi-source heterogeneous data fusion method according to claim 1, characterized in that, The data server is built on a data server with publish-subscribe functionality, enabling dynamic addition and deletion of data tags and providing fused data to the cascading interconnection interface.

5. The efficient and easy-to-use multi-source heterogeneous data fusion method according to claim 4, characterized in that, The process of dynamically adding and deleting data tags is as follows: When any interface group data source generates data, first scan the data server to see if a data tag item consistent with the newly added data has been established. If not, automatically create a new data tag according to the interface group name and data characteristics, and set the flag that the data server can be restarted. When the failure time of data fusion of each interface decreases to 0, a deletion timer is started and decreases with the system time. When the count is 0, the data tag item is deleted and the flag that the data server can be restarted is set. The data server checks the restart flag at regular intervals. When the flag is set, the data server is immediately interrupted, new parameters are loaded, and then the server is restarted.

6. The method as claimed in claim 4, wherein, The process of providing fused data to the cascading interconnection interface is as follows: When the fusion valid flag is true, the fused data is cached in the data server database after being overlaid with the system timestamp and unread flag, and the fused data is notified to the connected data server client on the cascaded interconnection interface in the form of an event that the fused data has been updated.

Citation Information

Patent Citations

  • Method and apparatus for self-healing symmetric multi-processor system interconnects

    CN101221551A

  • Joint query method and system for multi-source heterogeneous data

    CN112417225A