Edge gateway modeling method and system based on data format fusion

Abstract

The invention relates to the technical field of power system automation, and provides an edge gateway modeling method and system based on data format fusion, and the method comprises the steps: fusing the data format of multi-source heterogeneous protocol data into a JSON format; the equipment is accessed to the edge gateway based on the data format of the JSON format and the plug-and-play technology; and carrying out identification, fusion and simulation verification on the data format of the protocol data of the equipment accessed to the edge gateway, and completing modeling after the verification is passed. The model file in the JSON format can represent a complex data structure and various data types, and is suitable for different devices and communication protocols. Therefore, the configuration of the edge gateway machine has high flexibility. The model file in the JSON format has readability, and adjustment and optimization of equipment parameters and communication protocols are facilitated.

Description

Technical Field

[0001] This invention relates to the field of power system automation technology, and in particular to an edge gateway modeling method and system based on data format fusion. Background Technology

[0002] An edge gateway is a hardware device used to monitor and manage new energy equipment (such as solar photovoltaic power generation systems, wind power generation systems, and energy storage devices). As a crucial node connecting the dispatch master station and the substation, it is responsible for collecting real-time data, status information, and alarm information from the equipment and transmitting this information to a remote server or cloud platform for data analysis, fault diagnosis, and remote control. Substations involve various devices (such as photovoltaic inverters, wind power controllers, protection and control devices, and battery management systems). These devices use different access protocols and collect data in different formats. For example, Modbus communication devices are distinguished by register addresses, IEC104 communication devices by data body addresses, and IEC61850 communication devices by references. These different data formats make it difficult for other modules to read and process the data. Inconsistent device modeling methods lead to complex device access configuration processes and poor compatibility, making it difficult to meet the real-time and flexibility requirements of new energy substations. Summary of the Invention

[0003] The purpose of this invention is to solve at least one technical problem in the background art and to provide an edge gateway modeling method and system based on data format fusion.

[0004] To achieve the above objectives, the present invention provides an edge gateway modeling method based on data format fusion, comprising: The data formats of multi-source heterogeneous protocol data are merged into JSON format; The device connects to the edge gateway based on JSON data format and plug-and-play technology. The data format of the protocol data of the devices accessing the edge gateway is identified, fused, and simulated for verification. Modeling is completed after the verification is successful.

[0005] According to one aspect of the present invention, the fusion of data formats of multi-source heterogeneous protocol data into JSON format includes: Construct a device model that connects to the edge gateway; The communication protocol type is automatically identified using a predefined format recognition method, and the data format of the communication protocol is also identified. After identifying the data format of the communication protocol, perform semantic conversion of multi-source heterogeneous protocol data; set up Let A represent the set of data object concepts in the source protocol, where A represents the attributes of data in the source protocol, and N represents the necessary conditions for the data object concepts. , Let R represent the set of data objects in the target protocol, R represent the classification rules for the attribute values ​​of the target protocol, and R represent the sufficient conditions for classifying the target protocol. Let F represent the mapping relationship between the two protocols. Then, the data conversion of multi-source heterogeneous protocols can be represented as the data object of the source protocol. Find the corresponding target protocol , make conditions Established, it formally describes the mapping problem, that is, given a set of source protocol data objects, it classifies and maps them to target protocol data objects, and the mapping process is realized through the semantic characteristics of both parties; The source protocol provides a collection of source data objects and their attributes. The target protocol provides the target data object set and classification rules. Then the source data object This can be achieved by finding conditions that are met. To achieve semantic conversion of multi-source heterogeneous protocol data; Data format integration: The semantically transformed data is uniformly converted into JSON format to generate a standardized data structure.

[0006] According to one aspect of the present invention, the device accesses an edge gateway based on a JSON data format and plug-and-play technology, comprising: Edge gateway model establishment includes its own information model, which includes edge gateway operating status and device ledger parameter information; Automatic device discovery and registration: After a device connects to the network, it will send a JSON message to the bus. After receiving the device online message, the edge gateway will send a registration request, and the device will respond to the registration request.

[0007] Protocol Adaptation and Dynamic Configuration: The edge gateway identifies the device communication protocol based on a JSON format file. If the device supports the plug-and-play protocol, it communicates with the device directly through the plug-and-play protocol. Fault self-diagnosis and recovery: The edge gateway periodically sends heartbeats to the device. The device responds to the heartbeat and returns status information. If the device does not respond to the heartbeat message, the edge gateway marks the device as faulty, issues a fault notification, and reconnects to the device.

[0008] According to one aspect of the present invention, the process of identifying, fusing, and simulating the data format of the protocol data of the device accessing the edge gateway, and completing the modeling after successful verification, includes: Data format recognition: Automatically identifies the format of communication protocol data of access devices through predefined format recognition methods, and finds data that is not in JSON format; Parsing and conversion: For XML format data, an XML parser is used to extract data fields and convert them into key-value pairs; for Modbus protocol data, binary data is parsed into structured data according to the register address mapping table. Data format integration converts multi-source format data parsed with different specifications into a unified JSON format, generating a standardized data structure. Edge gateway model establishment includes its own information model, which includes edge gateway operating status and device ledger parameter information; Each device connects to the edge gateway model based on JSON format communication protocol data and plug-and-play technology and performs simulation verification. Modeling is completed when the verification is normal.

[0009] To achieve the above objectives, the present invention also provides an edge gateway modeling system based on data format fusion, comprising: The data format fusion module merges the data formats of multi-source heterogeneous protocol data into JSON format; The device access module allows multiple devices to connect to the edge gateway based on JSON data format and plug-and-play technology. The simulation verification module identifies, integrates, and simulates the data formats of protocol data from various devices connected to the edge gateway. Once the verification is successful, the modeling is completed.

[0010] To achieve the above objectives, the present invention also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the edge gateway modeling method based on data format fusion as described above.

[0011] To achieve the above objectives, the present invention also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the edge gateway modeling method based on data format fusion as described above.

[0012] According to the solution of the present invention, the present invention can achieve the following beneficial effects: Flexible configuration: JSON format model files can represent complex data structures and various data types, suitable for different devices and communication protocols. This makes edge gateway configuration highly flexible.

[0013] Plug and play: Enables rapid deployment and adjustment of device configuration and parameter settings, shortening the time for device launch and debugging.

[0014] Easy to maintain: The JSON format model file is readable, which is beneficial for adjusting and optimizing device parameters and communication protocols. Attached Figure Description

[0015] Figure 1 The flowchart schematically illustrates an edge gateway modeling method based on data format fusion according to an embodiment of the present invention. Detailed Implementation

[0016] The invention will now be discussed with reference to exemplary embodiments. It should be understood that the described embodiments are merely intended to enable those skilled in the art to better understand and thus implement the invention, and are not intended to imply any limitation on the scope of the invention.

[0017] As used herein, the term "comprising" and its variations are to be interpreted as open-ended terms meaning "including but not limited to". The term "based on" is to be interpreted as "at least partially based on". The terms "one embodiment" and "an embodiment" are to be interpreted as "at least one embodiment".

[0018] Figure 1 The flowchart schematically illustrates an edge gateway modeling method based on data format fusion according to an embodiment of the present invention. Figure 1 As shown, in this embodiment, the edge gateway modeling method based on data format fusion includes: The data formats of multi-source heterogeneous protocol data from multiple devices are merged into JSON format; The device connects to the edge gateway (model) based on JSON data format and plug-and-play technology. The data format of the protocol data of the devices accessing the edge gateway is identified, integrated, and simulated for verification (the validity of the generated JSON data file is verified). Modeling is completed after the verification is successful.

[0019] Furthermore, according to one embodiment of the present invention, the data formats of multi-source heterogeneous protocol data are merged into JSON format, including: Construct a device model that connects to the edge gateway; The communication protocol type from each device model is automatically identified using a predefined format recognition method, and the data format of the communication protocol is also identified. After identifying the data format of the communication protocol, perform semantic conversion of multi-source heterogeneous protocol data; set up Let A represent the set of data object concepts in the source protocol, where A represents the attributes of data in the source protocol, and N represents the necessary conditions for the data object concepts. , Let R represent the set of data objects in the target protocol, R represent the classification rules for the attribute values ​​of the target protocol, and R represent the sufficient conditions for classifying the target protocol. Let F represent the mapping relationship between the two protocols. Then, the data conversion of multi-source heterogeneous protocols can be represented as the data object of the source protocol. Find the corresponding target protocol , make conditions Established, it formally describes the mapping problem, that is, given a set of source protocol data objects, it classifies and maps them to target protocol data objects, and the mapping process is realized through the semantic characteristics of both parties; The source protocol provides a collection of source data objects and their attributes. The target protocol provides the target data object set and classification rules. Then the source data object This can be achieved by finding conditions that are met. To achieve semantic conversion of multi-source heterogeneous protocol data; Data format integration: The semantically transformed data is uniformly converted into JSON format to generate a standardized data structure.

[0020] Furthermore, according to one embodiment of the present invention, the device accesses the edge gateway based on JSON data format and plug-and-play technology, including: Edge gateway model establishment includes its own information model, which includes edge gateway operating status and device ledger parameter information; Automatic device discovery and registration: After a device model connects to the network, it will send a JSON message to the bus. After receiving the device model's online message, the edge gateway model will send a registration request, and the device will respond to the registration request.

[0021] Protocol Adaptation and Dynamic Configuration: The edge gateway identifies the device communication protocol based on a JSON format file. If the device supports the plug-and-play protocol, it communicates with the device directly through the plug-and-play protocol. Fault self-diagnosis and recovery: The edge gateway periodically sends heartbeats to the device. The device responds to the heartbeat and returns status information. If the device does not respond to the heartbeat message, the edge gateway marks the device as faulty, issues a fault notification, and reconnects to the device.

[0022] Furthermore, according to one embodiment of the present invention, the data format of the protocol data of the device accessing the edge gateway is identified, fused, and simulated for verification. After successful verification, modeling is completed, including: Data format recognition: Automatically identifies the format of communication protocol data of access device models through predefined format recognition methods, and finds non-JSON format data; Parsing and conversion: For XML format data, an XML parser is used to extract data fields and convert them into key-value pairs; for Modbus protocol data, binary data is parsed into structured data according to the register address mapping table. Data format integration converts multi-source format data parsed with different specifications into a unified JSON format, generating a standardized data structure. Each device connects to the edge gateway model based on JSON format communication protocol data and plug-and-play technology and performs simulation verification. Modeling is completed when the verification is normal.

[0023] According to the solution of the present invention, the present invention can achieve the following beneficial effects: Flexible configuration: JSON format model files can represent complex data structures and various data types, suitable for different devices and communication protocols. This makes edge gateway configuration highly flexible.

[0024] Plug and play: Enables rapid deployment and adjustment of device configuration and parameter settings, shortening the time for device launch and debugging.

[0025] Easy to maintain: The JSON format model file is readable, which is beneficial for adjusting and optimizing device parameters and communication protocols.

[0026] Furthermore, to achieve the above objectives, the present invention also provides an edge gateway modeling system based on data format fusion, comprising: The data format fusion module merges the data formats of multi-source heterogeneous protocol data into JSON format; The device access module allows multiple devices to connect to the edge gateway based on JSON data format and plug-and-play technology. The simulation verification module identifies, integrates, and simulates the data formats of protocol data from various devices connected to the edge gateway. Once the verification is successful, the modeling is completed.

[0027] Furthermore, according to one embodiment of the present invention, the data formats of multi-source heterogeneous protocol data are merged into JSON format, including: Construct a device model that connects to the edge gateway; Communication protocols for power transmission and distribution networks are divided into two categories. The communication protocol type from each device model is automatically identified using a predefined format recognition method, and the data format of the communication protocol is also identified. After identifying the data format of the communication protocol, perform semantic conversion of multi-source heterogeneous protocol data; set up Let A represent the set of data object concepts in the source protocol, where A represents the attributes of data in the source protocol, and N represents the necessary conditions for the data object concepts. , Let R represent the set of data objects in the target protocol, R represent the classification rules for the attribute values ​​of the target protocol, and R represent the sufficient conditions for classifying the target protocol. Let F represent the mapping relationship between the two protocols. Then, the data conversion of multi-source heterogeneous protocols can be represented as the data object of the source protocol. Find the corresponding target protocol , make conditions Established, it formally describes the mapping problem, that is, given a set of source protocol data objects, it classifies and maps them to target protocol data objects, and the mapping process is realized through the semantic characteristics of both parties; The source protocol provides a collection of source data objects and their attributes. The target protocol provides the target data object set and classification rules. Then the source data object This can be achieved by finding conditions that are met. To achieve semantic conversion of multi-source heterogeneous protocol data; Data format integration: The semantically transformed data is uniformly converted into JSON format to generate a standardized data structure.

[0028] Furthermore, according to one embodiment of the present invention, the device accesses the edge gateway based on JSON data format and plug-and-play technology, including: Edge gateway model establishment includes its own information model, which includes edge gateway operating status and device ledger parameter information; Automatic device discovery and registration: After a device connects to the network, it will send a JSON message to the bus. After receiving the device online message, the edge gateway will send a registration request, and the device will respond to the registration request.

[0029] Protocol Adaptation and Dynamic Configuration: The edge gateway identifies the device communication protocol based on a JSON format file. If the device supports the plug-and-play protocol, it communicates with the device directly through the plug-and-play protocol. Fault self-diagnosis and recovery: The edge gateway periodically sends heartbeats to the device. The device responds to the heartbeat and returns status information. If the device does not respond to the heartbeat message, the edge gateway marks the device as faulty, issues a fault notification, and reconnects to the device.

[0030] Furthermore, according to one embodiment of the present invention, the data format of the protocol data of the device accessing the edge gateway is identified, fused, and simulated for verification. After successful verification, modeling is completed, including: Data format recognition: Automatically identifies the format of communication protocol data of access devices through predefined format recognition methods, and finds data that is not in JSON format; Parsing and conversion: For XML format data, an XML parser is used to extract data fields and convert them into key-value pairs; for Modbus protocol data, binary data is parsed into structured data according to the register address mapping table. Data format integration converts multi-source format data parsed with different specifications into a unified JSON format, generating a standardized data structure. Each device connects to the edge gateway model based on JSON format communication protocol data and plug-and-play technology and performs simulation verification. Modeling is completed when the verification is normal.

[0031] According to the solution of the present invention, the present invention can achieve the following beneficial effects: Flexible configuration: JSON format model files can represent complex data structures and various data types, suitable for different devices and communication protocols. This makes edge gateway configuration highly flexible.

[0032] Plug and play: Enables rapid deployment and adjustment of device configuration and parameter settings, shortening the time for device launch and debugging.

[0033] Easy to maintain: The JSON format model file is readable, which is beneficial for adjusting and optimizing device parameters and communication protocols.

[0034] Furthermore, to achieve the above objectives, the present invention also provides an electronic device, including a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, it implements the edge gateway modeling method based on data format fusion as described above.

[0035] Furthermore, to achieve the above objectives, the present invention also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the edge gateway modeling method based on data format fusion as described above.

[0036] Those skilled in the art will recognize that the modules and algorithm steps described in conjunction with the embodiments disclosed herein can be implemented using electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0037] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described apparatus and equipment can be referred to the corresponding process in the foregoing method implementation, and will not be repeated here.

[0038] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0039] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the objectives of the embodiments of the present invention, depending on actual needs.

[0040] In addition, the functional modules in the embodiments of the present invention can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module.

[0041] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the sending / receiving methods of various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0042] The above description is merely a preferred embodiment of this application and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions disclosed in this application.

[0043] It should be understood that the sequence number of each step in the invention and its embodiments does not absolutely imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

Claims

1. An edge gateway modeling method based on data format fusion, characterized in that, include: The data formats of multi-source heterogeneous protocol data are merged into JSON format; The device connects to the edge gateway based on JSON data format and plug-and-play technology. The data format of the protocol data of the devices accessing the edge gateway is identified and integrated, and the validity of the generated JSON data file is verified. After the verification is successful, the modeling is completed.

2. The edge gateway modeling method based on data format fusion according to claim 1, characterized in that, The process of merging multi-source heterogeneous protocol data into JSON format includes: Construct a device model that connects to the edge gateway; The communication protocol type from each device model is automatically identified using a predefined format recognition method, and the data format of the communication protocol is also identified. After identifying the data format of the communication protocol, perform semantic conversion of multi-source heterogeneous protocol data; set up Let A represent the set of data object concepts in the source protocol, where A represents the attributes of data in the source protocol, and N represents the necessary conditions for the data object concepts. , Let R represent the set of data objects in the target protocol, R represent the classification rules for the attribute values ​​of the target protocol, and R represent the sufficient conditions for classifying the target protocol. Let F represent the mapping relationship between the two protocols. Then, the data conversion of multi-source heterogeneous protocols can be represented as the data object of the source protocol. Find the corresponding target protocol , make conditions Established, it formally describes the mapping problem, that is, given a set of source protocol data objects, it classifies and maps them to target protocol data objects, and the mapping process is realized through the semantic characteristics of both parties; The source protocol provides a collection of source data objects and their attributes. The target protocol provides the target data object set and classification rules. Then the source protocol's data object This can be achieved by finding conditions that are met. To achieve semantic conversion of multi-source heterogeneous protocol data; Data format integration: The semantically transformed data is uniformly converted into JSON format to generate a standardized data structure.

3. The edge gateway modeling method based on data format fusion according to claim 2, characterized in that, The device connects to the edge gateway based on JSON data format and plug-and-play technology, including: Edge gateway model establishment includes its own information model, which includes edge gateway operating status and device ledger parameter information; Automatic device discovery and registration: After a device model connects to the network, it will send a JSON message to the bus. After receiving the device online message, the edge gateway model will send a registration request, and the device will respond to the registration request. Protocol Adaptation and Dynamic Configuration: The edge gateway model identifies the device model's communication protocol based on a JSON-formatted file. If the device supports the plug-and-play protocol, it communicates directly with the device model via the plug-and-play protocol. Fault self-diagnosis and recovery: The edge gateway model periodically sends heartbeats to the device. The device responds to the heartbeat and returns status information. If the device model does not respond to the heartbeat message, the edge gateway model marks the device model as faulty, issues a fault notification, and reconnects to the device model.

4. The edge gateway modeling method based on data format fusion according to claim 1, characterized in that, The process of identifying, fusing, and simulating the data format of the protocol data from the devices accessing the edge gateway, followed by modeling after successful verification, includes: Data format recognition: Automatically identifies the format of communication protocol data of access device models through predefined format recognition methods, and finds non-JSON format data; Parsing and conversion: For XML format data, an XML parser is used to extract data fields and convert them into key-value pairs; for Modbus protocol data, binary data is parsed into structured data according to the register address mapping table. Data format integration converts multi-source format data parsed with different specifications into a unified JSON format, generating a standardized data structure. Each device model is connected to the edge gateway model based on JSON format communication protocol data and plug-and-play technology and is simulated and verified. Modeling is completed when the verification is normal.

5. An edge gateway modeling system based on data format fusion, characterized in that, include: The data format fusion module merges the data formats of multi-source heterogeneous protocol data into JSON format; The device access module allows multiple devices to connect to the edge gateway based on JSON data format and plug-and-play technology. The simulation verification module identifies, merges, and simulates the data formats of protocol data from various devices connected to the edge gateway. Once the verification is successful, the modeling is completed.

6. An electronic device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the edge gateway modeling method based on data format fusion as described in any one of claims 1-4.

7. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, which, when executed by a processor, implements the edge gateway modeling method based on data format fusion as described in any one of claims 1-4.

Images