A method and system for cross-region data aggregation, collection and processing of a substation digital system

Abstract

The present invention discloses a method and system for cross-regional data aggregation, collection and processing of a digital substation system, the method comprising: constructing a data collection engine; constructing a data resource pool, performing data processing, and uniformly storing and managing data; constructing a unified data access interface, the request interface input parameter data and callback interface return parameter data contained in the interface interaction data are both in JSON format string mode, and permission verification is performed during interaction; according to different data types and function types, four data interaction modes are provided: data query, data subscription (WebSocket, message queue mode) and data reverse push. The present invention focuses on data aggregation, forms a plant-level data base, provides a safe and reliable standardized data call interface, and improves the data interaction efficiency between applications; separates the underlying data from the application, provides convenient data support for other advanced applications, reduces the data integration cost brought by application expansion, and shortens the application construction cycle.

Description

Technical Field

[0001] The present invention relates to a data aggregation, collection and processing method and system, and in particular to a cross-region data aggregation, collection and processing method and system for a digital substation system. Background Art

[0002] At present, there are many subsystems in substations, which are relatively isolated and data interaction is difficult, which is still a common phenomenon. It is not convenient for the incremental development of advanced applications such as panoramic display, comprehensive analysis, business linkage, and trend prediction. Every time an application is added to the substation, it is necessary to reconsider the acquisition of data sources and the resulting data integration and construction costs, and the value of data cannot be fully explored.

[0003] Most existing substation data collection methods are demand-oriented and use conventional communication protocols to collect specified data types. The data types are limited to structured data such as real-time telemetering and telemetry, and a small amount of file data. The collected data types are few and cannot be called in a standardized manner. When there are extended business applications, the collected data cannot be reused, resulting in the need for re-integration of data and additional construction costs. Summary of the invention

[0004] Purpose of the invention: The purpose of the present invention is to provide a method and system for cross-regional data aggregation, collection and processing in a digital substation system, which forms a data resource pool by processing multiple heterogeneous data, and constructs a unified data access interface to form a data base for standardized interface calls.

[0005] Technical solution: The present invention includes the following steps: constructing a data acquisition engine; constructing a data resource pool, performing data processing, and uniformly storing and managing the data; constructing a unified data access interface, wherein the request interface input parameter data and callback interface return parameter data contained in the interface interaction data are both in JSON format string mode, and permission verification is performed during interaction.

[0006] The data collection includes real-time data and resource information of the main equipment in Zone I; real-time data and map files in Zone II; structured data and unstructured data of sensors in Zone IV; Zone I transmits data to Zone IV through a firewall and a forward isolation device; and the data in Zone II is transmitted to Zone IV via a forward isolation device.

[0007] The data processing includes data classification, data encoding, data screening, and data model mapping.

[0008] The construction of the data resource pool specifically includes: for structured data, establishing a plant-level data model and mapping it to the real-time library and the relationship library; for real-time data of specified configuration, regularly indexing it in the real-time library according to the unique id in the model and storing it in the history library; for file data, storing it in the file library according to the function and file index level, and returning the unique index to be saved in the relationship library; for video data, storing it in the hard disk burner; for the key objects of the substation, aggregating related data types with the object id as the unique key, generating a data chain indexed by the object id, and saving it in the relationship library.

[0009] The interaction provides data query, data subscription and data reverse push interaction modes according to different data types and function types.

[0010] The data query is: the application requests to query the required data by actively calling, and the queried data types include information structure data, real-time data, historical data, historical alarm data and file data.

[0011] The data subscription includes a WebSocket method and a message queue method.

[0012] The WebSocket method is: a WebSocket connection is established between the application and the data publishing service, and the data publishing service sends data to the application periodically or according to changes; the message queue method is: the data publishing service publishes data to the message queue periodically, and the application obtains real-time data by subscribing to topics.

[0013] The data reverse push is: the application calls the real-time and historical data reverse push interface provided by the data publishing service to write the real-time and historical data to be saved into the data resource pool, and provides a reverse channel for other applications to perform analysis and logical operations.

[0014] A cross-region data aggregation, collection and processing system for a digital transformer substation system is used to implement a cross-region data aggregation, collection and processing method for a digital transformer substation system.

[0015] Beneficial effects: The present invention focuses on data collection, forms a plant-level data base, provides a safe and reliable standardized data calling interface, and improves the efficiency of data interaction between applications; separates the underlying data from the application, provides convenient data support for other advanced applications, reduces the data integration cost brought by application expansion, and shortens the application construction cycle. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is the architecture diagram of the cross-region data acquisition and processing system of the present invention;

[0017] Figure 2 It is a flow chart of constructing a data resource pool according to the present invention;

[0018] Figure 3 It is the plant-level real-time data model of the present invention;

[0019] Figure 4 It is a schematic diagram of the standardized release of the data interface of the present invention. DETAILED DESCRIPTION

[0020] The present invention will be further described below in conjunction with the accompanying drawings.

[0021] like Figure 1 As shown, the cross-region data aggregation, collection and processing method of the substation digital system of the present invention comprises the following steps:

[0022] S1. Build a data acquisition engine based on the conventional communication protocol of the substation: collect remote signals, telemetry real-time data, and fault recording files generated by the device of the main equipment in Zone I; real-time data and graph files of online monitoring, dynamic environment, security, fire protection, etc. in Zone II; structured data of sensors in Zone IV and unstructured data such as videos, pictures, and logs.

[0023] Substation Zone I transmits the real-time production data of primary equipment related telesignaling, telemetry, etc. to Zone IV through the firewall and forward isolation device through the unidirectional IEC104 protocol, and transmits the main equipment resource information to Zone IV through the UDP protocol in the form of E files. The real-time data of online monitoring, fire fighting, security, environmental monitoring, intelligent lighting, etc. in Substation Zone II are transmitted to Zone IV through the unidirectional IEC104 protocol through the forward isolation device. The oil chromatography, partial discharge, fault recording and other map files are sent to the data acquisition platform of Zone IV through the forward isolation device using the ftp and sftp protocols. Provide raw data for building a data resource pool. Among them, conventional communication protocols include IEC61850, DL / T 634.5104, DL / T 476, etc.

[0024] S2. Build a data resource pool: perform data processing on all the multivariate heterogeneous data collected in Zone IV, including data classification, data coding, data screening, data model mapping, and unified storage and management of data. The data resource pool mainly includes real-time data, historical data, configuration parameters, file data, video data, operation logs, and external reverse push data. Perform relevant data analysis and aggregation on key focus objects of the substation to meet the data call requirements in different scenarios.

[0025] For structured data such as real-time data and parameter configuration data, a plant-level data model is established and mapped to the real-time library and the relationship library. For real-time data of a specified configuration, it is indexed regularly in the real-time library based on the unique id in the model and stored in the historical library. For file data such as graphics, configurations, waveforms, etc., they are stored in the file library according to the function (subsystem) and file index level, and the unique index is returned and saved in the relationship library. For video data, it is stored in the NVR hard disk burner. For the key objects of the substation, the object id is used as the unique key to aggregate related data types, generate a data chain indexed by the object id, and save it in the relationship library to meet the data processing requirements in different scenarios.

[0026] S3. Build a unified data access interface: The request interface input parameter data and callback interface return parameter data contained in the interface interaction data are all in JSON format string mode, and permission verification is performed during interaction. According to different data types and function types, four data interaction methods are provided, including data query, data subscription (WebSocket, message queue method) and data reverse push, and a data source is provided for various advanced applications through standardized unified interface calls.

[0027] Data query: The application actively requests the required data through HTTP (HTTPS) protocol and follows the RESTful style. The queried data types include information structure data, real-time data, historical data, historical alarm data and file data.

[0028] Data subscription (WebSocket mode): A WebSocket connection is established between the application and the data publishing service, and the data publishing service sends data to the application periodically or according to changes. The application actively establishes a connection with the data publishing service and subscribes to the service. After subscription, the data publishing service periodically sends the subscribed real-time data to the application and triggers notification of changes in real-time data; the data notified periodically is the real-time data in the data resource pool.

[0029] Data subscription (message queue mode): The data publishing service periodically publishes data to the message queue, and the application obtains real-time data by subscribing to topics. The data publishing service periodically publishes full data to the message queue and publishes changed data in real time. At the same time, the application subscribes to the specified topic to the message queue and processes the subscribed messages.

[0030] Data reverse push: The application calls the real-time and historical data reverse push interface provided by the data publishing service to write the real-time and historical data to be saved into the data resource pool, providing a reverse channel for other applications to perform analysis and logical operations.

[0031] The present invention constructs a data acquisition engine based on the conventional communication protocol of the substation, collects the data of the entire station in the power IV zone, and constructs a data resource pool through classification processing, data encoding, data screening, and data model mapping of multi-dimensional heterogeneous data. On the basis of the data resource pool, a unified data access interface is constructed, and finally a data base with standardized interface calls is formed to support the rapid construction of application functions and reduce application construction costs.

[0032] Example

[0033] Step 1: Build a data collection engine

[0034] like Figure 1 As shown, the telesignaling and telemetry data of the main equipment in zone I are connected to the main equipment data access node according to IEC61850, IEC104 and other protocols, and then sent to the data acquisition platform in zone IV through the forward isolation device according to the IEC104 protocol.

[0035] The event alarm of zone I is sent to the data acquisition platform of zone IV in the form of text through the DL476 protocol in the data access node of the main device.

[0036] The data of auxiliary equipment such as online monitoring, fire protection, security, and environmental monitoring in Zone II are sent to the data acquisition platform in Zone IV via the forward isolation device through the convergence node using the unidirectional IEC104 protocol. The graph files such as oil chromatography, partial discharge, vibration sound pattern, and fault recording are sent to the data acquisition platform in Zone IV via the forward isolation device using the ftp and sftp protocols.

[0037] After the wireless sensor data of Zone IV is collected, it is accessed through the secure gateway, and the wired sensor data is converted and sent to the data collection platform of Zone IV. The video stream is stored in the NVR hard disk recorder.

[0038] External third-party applications can store data in the queue in the specified data format through the message queue, and the internal service of the data collection platform reads the message queue in real time for collection and processing.

[0039] Step 2: Build a data resource pool

[0040] like Figure 2 As shown, all the multivariate heterogeneous data collected in Zone IV are processed, including data classification, data coding, data screening, data model mapping, and unified storage management of data. It mainly includes real-time data, historical data, configuration parameters, file data, video data, operation logs, and external reverse push data.

[0041] For real-time telemetering and telemetry data, a plant-level real-time data model is established, such as Figure 3As shown in the figure, the raw data transmitted by the data acquisition engine is written into the message cache, and the model is mapped according to the ref or point number, and written into the real-time library and the relationship library respectively. The plant-level data large model is split down in four levels according to the plant-interval-equipment-signal, and all nodes are indexed by the unique id of the whole station. According to the historical measurement point configuration and the collected real-time data, the timed sampling is performed and stored in the time series library.

[0042] For unstructured file data such as graphics, configuration files, E files, waveform files, etc., they are stored in the file library according to the level of function (subsystem) and file index, and the unique index is returned and saved in the relationship library to locate resources when the unified interface is called.

[0043] For video data stored in NVR hard disk recorders, address encoding is performed on all cameras, alarm devices and other resources in the video subsystem, and resource information interfaces are encapsulated. Signaling interfaces and streaming media interfaces are encapsulated when viewing real-time video and video playback. Signaling uses standard SIP INVITE+SDP, and media transmission uses RTP / RTCP.

[0044] The key objects in the substation use the object id as the unique key to bind multi-heterogeneous data, aggregate them into a data chain indexed by the object id, and save them in the relational database to meet the data processing requirements in different scenarios.

[0045] Step 3: Build a standardized data call interface

[0046] like Figure 4 As shown in the figure, the standardized data call interface is defined in JSON format, and the interactive interface complies with the RESTful API specification, which reflects the resources and corresponding interface methods in the form of http(s) URL. The complete interface method consists of domain name (IP address), version, path (method name), http verb (GET and POST), filtering information, status code, return result, etc. For example: http(s): / / {host}:{port} / v{n} / {method}.

[0047] Serial number URL composition illustrate 1 {host}:{port} The host address and port required to access the interface using the http protocol 2 v{n} Indicates the version number, such as v1 means the first version 3 {method} Indicates the path (method name), used to identify the specific interface

[0048] Before an application obtains data from a data resource pool through a standard interface, it must register on the data management platform and obtain two identification codes: client ID and client key. The client ID is stored by the application itself, and the client key is only allowed to be stored in the data management platform. Before interaction, the application undergoes an application permission check. When the application accesses the data publishing service interface, the legitimacy of the service caller is ensured by verifying the token.

[0049] The present invention also includes a substation digital system constructed by applying the substation digital system cross-region data aggregation, collection and processing method, which is used to implement the substation digital system cross-region data aggregation, collection and processing method.

[0050] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0051] The computer storage medium of the embodiment of the present invention can adopt any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program, which can be used by an instruction execution system, a device or a device or used in combination with it.

[0052] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0053] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0054] A computer device comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of a method for cross-area data aggregation, collection and processing of a digital substation system are implemented.

Claims

1. A method for cross-region data collection and processing of a substation digital system, characterized in that: The following steps are involved: Build a data collection engine; build a data resource pool and perform data processing; The data processing includes data classification, data encoding, data screening, and data model mapping. The construction of the data resource pool specifically includes: for structured data, establishing a plant-level data model and mapping it to the real-time library and the relationship library; for real-time data of a specified configuration, indexing it in the real-time library according to the unique id in the model and storing it in the history library; for file data, storing it in the file library according to the function and file index level, and returning the unique index to be saved in the relationship library; for video data, storing it in the hard disk burner; for the key objects of the substation, aggregating related data types with the object id as the unique key, generating a data chain with the object id as the index, and saving it in the relationship library; building a unified data access interface, and the request interface input parameter data and callback interface return parameter data contained in the interface interaction data all use a unified string method, and perform permission verification during interaction; The data collection includes real-time data and resource information of the main equipment in Zone I; real-time data and map files in Zone II; structured data and unstructured data of sensors in Zone IV; Zone I transmits data to Zone IV through a firewall and a forward isolation device; and the data in Zone II is transmitted to Zone IV via a forward isolation device.

2. According to claim 1, a method for cross-region data aggregation, collection and processing of a substation digital system is characterized in that: The interaction provides data query, data subscription and data reverse push interaction modes according to different data types and function types.

3. A method for cross-region data aggregation, collection and processing of a substation digital system according to claim 2, characterized in that: The data query is: the application requests to query the required data by actively calling, and the queried data types include information structure data, real-time data, historical data, historical alarm data and file data.

4. A method for cross-region data aggregation, collection and processing of a substation digital system according to claim 2, characterized in that: The data subscription includes a WebSocket method and a message queue method.

5. A method for cross-region data aggregation, collection and processing of a substation digital system according to claim 4, characterized in that: The WebSocket method is: a WebSocket connection is established between the application and the data publishing service, and the data publishing service sends data to the application periodically or according to changes; the message queue method is: the data publishing service publishes data to the message queue periodically, and the application obtains real-time data by subscribing to topics.

6. A method for cross-region data aggregation, collection and processing of a substation digital system according to claim 2, characterized in that: The data reverse push is: the application calls the real-time and historical data reverse push interface provided by the data publishing service to write the real-time and historical data to be saved into the data resource pool, and provides a reverse channel for other applications to perform analysis and logical operations.

7. A cross-region data collection and processing system for a substation digital system, characterized in that: The system is used to implement the cross-region data aggregation, collection and processing method of a substation digital system as described in any one of claims 1 to 6.

Images