New energy station cross-gatekeeper remote data acquisition method and system

Abstract

The invention discloses a new energy station cross-gatekeeper remote data acquisition method and system, and the method comprises the following steps: a station first area data acquisition server collects data from new energy station equipment, and carries out the analysis and conversion of the data, and forms standardized station real-time data; 2, according to the standardized station real-time data, the data are transmitted in a one-way mode through an isolation device, and the station data are set to be transmitted from the inside to the outside; step 3, according to the data transmitted by the isolation device, the station three-area data forwarding server performs deep standardization processing on the data of different protocols, uniformly converts the data into an internal format, and adjusts a data forwarding strategy according to a dynamic configuration requirement; and step 4, according to the data in the unified internal standardized format, publishing the data by using message middleware, and carrying out serialized compression by using a Probuf technology for data acquisition and transmission in a new energy station cross-gatekeeper environment. The efficiency of operation and maintenance personnel is improved, and the reliability management level of auxiliary equipment is improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of power system communication and data acquisition, and more specifically, relates to a new energy station cross-network switch remote data acquisition method and system. Background Art

[0002] Under the goal of large-scale, high-quality and rapid development, there is an urgent need for intensive and intelligent development. New energy stations are generally built in relatively remote areas, and may even be in mountainous areas, Gobi, deserts and other places with harsh environments. They have the characteristics of scattered distribution of stations, many points and wide areas, generally remote locations, inconvenient transportation, a large number of units, and different models. The traditional "many people on duty, many people on duty" decentralized management mode consumes a lot of manpower and material resources, is difficult to operate and manage, and is not convenient for staff to stay for a long time. With the increasing number of new energy stations, production and operation management issues have become increasingly prominent. Major new energy companies are focusing on promoting the construction of new energy remote centralized monitoring systems to achieve centralized operation and management of discrete stations, improve the efficiency of operation and maintenance personnel, improve the reliability management level of auxiliary equipment, promote the implementation of the "unmanned duty, few people on duty" management mode of stations, and improve production efficiency.

[0003] Since the locations of new energy stations are generally remote, most of them can only transmit data through the wired / wireless private network of telecommunications companies. The network bandwidth is mostly 5M, 10M, etc., and the data transmission channel is often shared with the video stream transmission channel, which forms a bandwidth bottleneck for data transmission. If the station is large in scale and the video stream is pulled intensively, it may not even be possible to complete the upload of all data within the time required by the specification, and data interruption may occur in extreme cases.

[0004] Considering the limitations of the natural environment and communication conditions, when constructing a station, the data upload cycle will be set or some data will be selected for upload according to the on-site conditions to reduce the occupation of bandwidth resources and avoid affecting the transmission of important data. This strategy is generally determined during the commissioning process before the station is put into operation. It does not support dynamic modification during operation. During operation, the station can only upload data according to the established configuration. New energy stations have harsh natural conditions and are far away from urban areas. If the above strategy is adopted, some less important information will be missed. If such information is not uploaded in time, the on-duty personnel of the regional centralized control master station may not be able to find the problem in time, which will lead to serious consequences. Summary of the invention

[0005] In order to solve the deficiencies in the prior art, the present invention provides a method and system for remote data collection across network gateways for new energy stations, which is particularly suitable for scenarios where the network bandwidth between new energy stations and regional centralized control master stations is limited, the stations are large in scale, and the amount of data collected and uploaded is large.

[0006] The present invention provides the following technical solutions:

[0007] A first aspect of the present invention provides a method for remote data collection across network gates of a new energy station, comprising the following steps:

[0008] The data collection server in area 1 of the station collects data from the new energy station equipment, identifies and preliminarily analyzes the data of different communication protocols based on the global unique identifier, and divides the data into message content and message attributes;

[0009] According to the global identification and message attributes of the parsed data, set the priority of the collected data, adjust the data transmission strategy according to the priority, and transmit the data unidirectionally to the data forwarding server in Zone 3 of the station through the isolation device;

[0010] After receiving the data, the data forwarding server in Zone 3 of the station conducts in-depth standardization processing on the data of different protocols according to the message attributes, adjusts the data processing order according to the data priority, and adjusts the data forwarding strategy according to the station scale and dynamic configuration requirements to select the optimal target node for data forwarding;

[0011] Based on the data after deep standardization processing, the message middleware is used to publish the data, and Protobuf is used for serialization and compression, which is used for data collection and transmission in the cross-gate environment of new energy stations.

[0012] Preferably, the data acquisition server of the first zone of the station collects data from the new energy station equipment, identifies and preliminarily analyzes the data of different communication protocols based on the global unique identifier, and divides the data into message content and message attributes, as follows:

[0013] The data acquisition server in area 1 of the station is connected to various new energy equipment in the station, including wind turbines, photovoltaic panels and substation equipment, to collect equipment status, measurement data and control instructions, and is compatible with communication protocols including IEC104, OPC, Modbus and DNP3;

[0014] The server performs a preliminary analysis of the collected data according to the communication protocol, identifies the specific fields in each data message, and classifies the data according to the format defined by the protocol; the analysis process includes the analysis of the protocol header information and the extraction of the data content;

[0015] The server divides the initially parsed data into two parts: message content and message attributes. The message content includes device status, measurement data and control instructions; the message attributes include protocol type, device identification, data type and timestamp information;

[0016] After completing the initial parsing and separation of the message content and message attributes, the server converts the parsed data content according to the initial standardized format, unifies the data fields of different communication protocols into the initial standardized data structure, and forms initial standardized data containing content fields and attribute fields.

[0017] Preferably, according to the global identification and message attributes of the parsed data, the priority of the collected data is set, and the data transmission strategy is adjusted according to the priority, and the data is transmitted unidirectionally to the data forwarding server of the third zone of the station through the isolation device, as follows:

[0018] The collected data is prioritized according to the global identifier and message attributes of the parsed data, and a priority tag is assigned to the data packet to identify the priority. The priority is set based on the following:

[0019] The data types include real-time data, event data, alarm information and historical data, among which alarm information and event data are transmitted and processed first;

[0020] For timestamp information, priority is given to transmission based on the difference between data collection time and processing time;

[0021] For equipment identification, including key equipment and conventional equipment, the data collected by key equipment will be transmitted and processed first;

[0022] According to the setting result of data priority, the data transmission strategy is dynamically adjusted, the transmission path and transmission time are allocated to each data packet according to the priority, and the queue position of the data packet during the transmission process is adjusted;

[0023] The data after priority setting and transmission strategy adjustment is transmitted unidirectionally through the isolation device;

[0024] By monitoring the data flow, checking whether there are any anomalies in the data packets, and encrypting and verifying the integrity of the transmitted data, each data packet generates an independent encrypted hash value and records it in the blockchain.

[0025] After the data is transmitted to the data forwarding server in zone 3 of the station through the isolation device, the data forwarding server in zone 3 of the station receives and parses the transmitted data, and further adjusts the data processing order and forwarding strategy according to the priority of the data, so that the data can be transmitted within the station along the optimal path.

[0026] Preferably, the isolation device determines the transmission path and encryption method of different data according to the priority label of the data, filters the data at multiple levels and transmits the data in a graded manner;

[0027] By real-time monitoring of network bandwidth and load conditions, the data transmission frequency is dynamically adjusted; when network congestion is detected, non-critical data is automatically cached in the internal storage of the isolation device and waits for the next transmission opportunity.

[0028] Preferably, after receiving the data, the data forwarding server of the third zone of the station performs deep standardization processing on the data of different protocols according to the message attributes, and adjusts the data processing order according to the priority of the data. According to the station scale and dynamic configuration requirements, the data forwarding strategy is adjusted to select the optimal target node for data forwarding, as follows:

[0029] The data forwarding server in Zone 3 of the station receives the data packets transmitted from the isolation device and performs deep standardization processing on the data fields according to the data protocol type, data type and device identification;

[0030] During the deep standardization process, data fields in different protocol formats are mapped to standardized data structures through a dynamic mapping mechanism and uniformly converted into internal standardized structures;

[0031] The data forwarding strategy is adjusted in real time according to the dynamic configuration of the site; the configuration parameters include data priority, forwarding frequency and data receiving load; the data transmission path and priority are adjusted according to the configuration;

[0032] According to the real-time status of the station and the receiving capacity of the target node, the server dynamically optimizes the data forwarding strategy and transmits the data to the target node via the optimal path;

[0033] According to the real-time status of the target node, including the current load, response speed and receiving capacity, the optimal node is selected for data distribution; for nodes with low load and fast response speed, the server allocates data according to priority; when the target node fails, times out or cannot receive data, the server can automatically distribute the data to other backup nodes.

[0034] Preferably, the standardized data structure consists of the following fields:

[0035] The deep standardized data structure includes key fields, standardized fields, and extended fields;

[0036] Key fields include device ID, measurement point ID, and data type, which are basic fields used to identify and distinguish data sources and types;

[0037] Standardized fields are used to represent all data content in a unified format, including standardized information on voltage, current, device status, and control commands;

[0038] The extension field is used for additional information about specific devices and communication protocols, including alarm status, device health status, and control instructions, to supplement the specific characteristics of the description data;

[0039] During the deep standardization process, data fields in different protocol formats are mapped to standardized data structures through a dynamic mapping mechanism and uniformly converted into internal standardized structures, as follows:

[0040] The server preliminarily classifies and parses the data fields, and distinguishes between key fields and non-key fields according to predefined standardization rules; the standardization rules are set according to the protocol type and the device type, so that the fields of different protocols are positioned correspondingly in a unified structure;

[0041] The server selectively processes and maps different data fields according to the needs of each station, and dynamically adjusts the mapping rules. The mapping rule adjustment includes adding, ignoring and changing data fields, and only maps the data fields related to the station needs into the standardized data structure;

[0042] The data that has undergone deep standardization processing is reassembled into message content and message attributes to generate a complete standardized data structure, and the format is converted according to the internal standard format. The reassembled complete standardized data structure carries all the equipment data, attribute fields, priorities and extended information of the site, so that the data is complete and consistent when transmitted across network gates.

[0043] Preferably, dynamically adjusting the mapping rules also includes: the operation and maintenance personnel allow the user to define and adjust the mapping rules of the data fields on a graphical interface through a visual mapping configuration tool, the visual tool displays the correspondence between each protocol field and the standardized field, and the user adjusts the mapping rules by dragging and dropping or clicking.

[0044] Preferably, according to the data in a unified internal standardized format, the message middleware is used to publish the data, and Protobuf is used for serialization and compression, which is used for data collection and transmission in the cross-gate environment of new energy stations; the details are as follows:

[0045] Prepare to publish the complete and standardized data through RabbitMQ messaging middleware. The server will classify and allocate the topics for data publishing according to the needs of the site and optimize the transmission path.

[0046] Before publishing the data, the data fields are serialized according to the Protobuf definition, and the text and numerical data are compressed into binary format;

[0047] The data packet serialized by Protobuf is pushed to the RabbitMQ message middleware, and RabbitMQ will publish the data according to the predefined message topic.

[0048] Preferably, using Protobuf for serialization compression also includes:

[0049] Using incremental data compression, Protobuf compares the current data with the previous data before each data serialization, and only compresses and transmits the changed parts, while the unchanged data is processed through local cache;

[0050] For the cross-gate environment of new energy sites, identify specific network bottlenecks in the cross-gate environment, and adjust the size and transmission interval of data packets according to the characteristics of network isolation to optimize transmission under restricted network conditions.

[0051] A second aspect of the present invention provides a new energy station cross-gate remote data acquisition system, including: a station data acquisition module, a data transmission module, a data processing and forwarding module, and a data publishing and compression module;

[0052] The station data acquisition module is used to collect data from new energy station equipment, perform preliminary analysis on the data according to different communication protocols, and divide the data into message content and message attributes;

[0053] The data transmission module is used to transmit the standardized station data in combination with the set priority tags in one direction through the isolation device, so that the data is transmitted from the inside of the station to the outside;

[0054] The data processing and forwarding module is used to receive data transmitted by the isolation device, perform deep standardization processing on data of different protocols, and convert the data into an internal format, and adjust the data forwarding strategy according to the requirements of dynamic configuration;

[0055] The data publishing and compression module is used to publish unified internal standardized format data through the message middleware, and use Protobuf technology for serialization and compression to enable data transmission across network gates.

[0056] Compared with the prior art, the beneficial effects of the present invention include at least:

[0057] (1) By using Protobuf technology for serialization compression, the data volume is effectively reduced and the bandwidth usage is optimized, which is particularly suitable for remote site environments with limited bandwidth. Compared with traditional data transmission methods, the present invention can transmit data more efficiently under limited network resources and reduce congestion and data loss during the transmission process.

[0058] (2) In the present invention, the data transmission strategy is adjusted according to the actual operation status and dynamic configuration of the station through the data forwarding server of the third zone of the station. Different from the fixed data transmission cycle in the prior art, the present invention realizes flexible dynamic adjustment, ensuring that important data can be transmitted first, and secondary data can be transmitted without affecting the overall operation, thus ensuring the real-time and flexibility of data transmission.

[0059] (3) By deeply standardizing data of different protocols and converting them into internal formats, the present invention is compatible with a variety of data sources and communication protocols and meets the needs of a variety of new energy station equipment. Compared with the existing technology that may require manual adjustment for different equipment, the present invention greatly improves the adaptability of the system and reduces human intervention.

[0060] (4) During the data transmission process, the present invention realizes one-way transmission through an isolation device, and combines the use of Protobuf serialization compression and message middleware to ensure the security and integrity of data transmission. In the prior art, especially in a cross-gate environment, data transmission is vulnerable to external attacks or data loss risks, while the present invention greatly reduces these risks through multi-layer encryption and transmission verification mechanisms.

[0061] (5) The present invention is specially designed for the remote, scattered and harsh environment of new energy stations. Through the intelligent and intensive remote data collection and transmission system, it realizes the efficient management mode of "no one on duty, few people on duty", and improves the production and operation efficiency. Compared with the traditional decentralized management mode, the present invention reduces the dependence on manpower and reduces the operating cost.

[0062] (6) The present invention can effectively utilize limited bandwidth by compressing and optimizing the data transmission path, especially when sharing the network with the video stream, thereby avoiding the data interruption problem caused by insufficient bandwidth in the prior art. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 is a schematic diagram of data transmission provided according to an embodiment of the present invention;

[0064] Figure 2 This is a flow chart of a remote data collection method for a new energy station across network gates provided in accordance with an embodiment of the present invention. DETAILED DESCRIPTION

[0065] In order to make the purpose, technical scheme and advantages of the present invention clearer, the technical scheme of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. The embodiments described in this application are only part of the embodiments of the present invention, not all of them. Based on the spirit of the present invention, other embodiments obtained by ordinary technicians in this field without creative work are all within the scope of protection of the present invention.

[0066] Example 1 of the present invention provides a method for remote data collection across network gates of a new energy station, comprising the following steps:

[0067] The data acquisition server in area 1 of the station collects data from the new energy station equipment, performs preliminary analysis on the data according to different communication protocols, and divides the data into message content and message attributes;

[0068] Preferably, according to the message attributes of the data, the priority of the collected data is set, and the data transmission strategy is adjusted according to the priority, and the data is transmitted unidirectionally to the data forwarding server of the third zone of the station through the isolation device, as follows:

[0069] The data acquisition server in area 1 of the station is connected to various types of new energy equipment in the station, including wind turbines, photovoltaic panels and substation equipment, to collect equipment status, measurement data and control instructions, and is compatible with communication protocols including but not limited to IEC104, OPC, Modbus and DNP3; the design of the present invention is compatible with all communication protocols in the station;

[0070] The server performs a preliminary analysis of the collected data according to the communication protocol, identifies the specific fields in each data message, and classifies the data according to the format defined by the protocol; the analysis process includes the analysis of the protocol header information and the extraction of the data content;

[0071] The server divides the initially parsed data into two parts: message content and message attributes. The message content includes device status, measurement data and control instructions; the message attributes include protocol type, device identification, data type and timestamp information;

[0072] After completing the initial parsing and separation of the message content and message attributes, the server converts the parsed data content according to the initial standardized format, unifies the data fields of different communication protocols into the initial standardized data structure, and forms initial standardized data containing content fields and attribute fields.

[0073] According to the global identification and message attributes of the parsed data, set the priority of the collected data, adjust the data transmission strategy according to the priority, and transmit the data unidirectionally to the data forwarding server in Zone 3 of the station through the isolation device;

[0074] When processing different communication protocols, the existing technology can usually only parse according to a single protocol, and each protocol requires an independent parsing program, resulting in poor versatility and flexibility of the system. When the existing technology uniformly processes the data parsed from different protocols, it is easy to have problems such as field misalignment and inconsistent formats, resulting in the inability to achieve seamless flow of data within the system.

[0075] The significant difference from the prior art is that the present invention can uniformly process data parsed by different communication protocols (such as IEC104, OPC, Modbus, DNP3, etc.), by separating the data into "message content" and "message attributes" and adopting the "globally unique identifier (Global ID)" method, thereby realizing unified processing of multi-protocol data.

[0076] Preferably, according to the global identification and message attributes of the parsed data, the priority of the collected data is set, and the data transmission strategy is adjusted according to the priority, and the data is transmitted unidirectionally to the data forwarding server of the third zone of the station through the isolation device, as follows:

[0077] The collected data is prioritized according to the message attributes of the data, and a priority label is assigned to the data and attached to the data packet to identify the priority. The priority is set based on the following:

[0078] The data types include real-time data, event data, alarm information and historical data, among which alarm information and event data are transmitted and processed first;

[0079] For timestamp information, priority is given to transmission based on the difference between data collection time and processing time;

[0080] For equipment identification, including key equipment and conventional equipment, the data collected by key equipment will be transmitted and processed first;

[0081] According to the setting result of data priority, the data transmission strategy is dynamically adjusted, the transmission path and transmission time are allocated to each data packet according to the priority, and the queue position of the data packet during the transmission process is adjusted; the specific strategies are as follows:

[0082] High-priority data: including alarm information, emergency control instructions, and important equipment status data. The system processes and transmits this data first to ensure that it can be sent to the target node with the lowest delay.

[0083] Medium priority data: includes real-time data and measurement data of general equipment. These data are transmitted when the network is relatively idle according to the network bandwidth and load conditions to avoid occupying bandwidth resources.

[0084] Low-priority data: includes historical data and statistical information reported periodically. When the network load is high or congestion occurs, low-priority data will be temporarily stored in the local cache and will be transmitted after the network is restored.

[0085] The shortcomings of the existing technology are that the setting of the priority in the data transmission strategy is relatively simple, relying only on the static priority order, and cannot be dynamically adjusted according to the importance and time sensitivity of the data. For different types of data such as alarm data, real-time data and historical data, the existing technology usually adopts the same transmission strategy, which easily leads to network congestion or data loss.

[0086] The remarkable feature of the present invention is that it can set different priorities according to the message attributes of the data (such as data type, timestamp, device identification, etc.), and dynamically adjust the data transmission strategy according to the priority. In particular, different priorities and different transmission strategies are introduced between alarm data, real-time data and historical data to ensure that alarm data can be transmitted first, while historical data can be transmitted when the network is idle;

[0087] In terms of transmission strategy optimization, the present invention introduces a priority-based "one-way transmission strategy" so that data of different priorities can be transmitted through different transmission paths in the isolation device, avoiding data transmission delays and resource waste caused by improper priority processing in the prior art.

[0088] The data after priority setting and transmission strategy adjustment is transmitted unidirectionally through the isolation device; the specific process is as follows:

[0089] The isolation device dynamically adjusts the transmission order of data streams according to the priority, sends high-priority data first, and caches or delays the sending of low-priority data.

[0090] During data transmission, the isolation device performs integrity verification and encryption on the data packet to ensure that the data is not tampered with during one-way transmission.

[0091] The isolation device monitors the direction of data flow according to the transmission strategy to prevent the data flow from the external network from flowing back to the internal network, ensuring the unidirectionality and security of the data flow.

[0092] By monitoring the data flow, checking whether there are any anomalies in the data packets, and encrypting and verifying the integrity of the transmitted data, each data packet generates an independent encrypted hash value and records it in the blockchain.

[0093] After the data is transmitted to the data forwarding server in zone 3 of the station through the isolation device, the data forwarding server in zone 3 of the station receives and parses the transmitted data, and further adjusts the data processing order and forwarding strategy according to the priority of the data, so that the data can be transmitted within the station along the optimal path.

[0094] Preferably, the isolation device determines the transmission path and encryption method of different data according to the priority label of the data, filters the data at multiple levels and transmits the data in a graded manner;

[0095] By real-time monitoring of network bandwidth and load conditions, the data transmission frequency is dynamically adjusted; when network congestion is detected, non-critical data is automatically cached in the internal storage of the isolation device and waits for the next transmission opportunity.

[0096] The isolation device can monitor the data flow through the isolation device in real time and dynamically adjust the data transmission strategy according to the preset logical rules. Specific strategies include:

[0097] Transmission priority control: The isolation device adjusts the data transmission order according to the priority attributes of the data (such as alarm information, real-time data and historical data). It gives priority to the transmission of important alarm information and real-time data, and caches or delays the transmission of general data.

[0098] Data flow control: When transmitting data, the isolation device will dynamically adjust the data flow according to the current network bandwidth and load. In the case of limited bandwidth or high network load, the isolation device can temporarily limit the transmission rate of non-critical data to ensure stable transmission of critical data.

[0099] Data integrity verification: The isolation device performs integrity verification on each data packet to ensure that the data is not tampered with or lost during transmission. The data packet can continue to be transmitted only after passing the verification, otherwise it will be discarded or the abnormal status will be recorded.

[0100] After receiving the data, the data forwarding server in Zone 3 of the station conducts in-depth standardization processing on the data of different protocols according to the message attributes, adjusts the data processing order according to the data priority, and adjusts the data forwarding strategy according to the station scale and dynamic configuration requirements to select the optimal target node for data forwarding;

[0101] Preferably, after receiving the data, the data forwarding server of the third zone of the station performs deep standardization processing on the data of different protocols according to the message attributes, and adjusts the data processing order according to the priority of the data. According to the station scale and dynamic configuration requirements, the data forwarding strategy is adjusted to select the optimal target node for data forwarding, as follows:

[0102] The data forwarding server in Zone 3 of the station receives the data packets transmitted from the isolation device and performs deep standardization processing on the data fields according to the data protocol type, data type and device identification;

[0103] During the deep standardization process, data fields in different protocol formats are mapped to standardized data structures through a dynamic mapping mechanism and uniformly converted into internal standardized structures;

[0104] The data forwarding strategy is adjusted in real time according to the dynamic configuration of the site; the configuration parameters include data priority, forwarding frequency and data receiving load; the data transmission path and priority are adjusted according to the configuration;

[0105] According to the real-time status of the station and the receiving capacity of the target node, the server dynamically optimizes the data forwarding strategy and transmits the data to the target node via the optimal path;

[0106] According to the real-time status of the target node, including the current load, response speed and receiving capacity, the optimal node is selected for data distribution; for nodes with low load and fast response speed, the server allocates data according to priority; when the target node fails, times out or cannot receive data, the server can automatically distribute the data to other backup nodes.

[0107] After the deep standardization process is completed, the server sorts the standardized data objects according to the data priority attributes and adjusts the data processing order. The specific strategy is as follows:

[0108] Prioritize urgent data: such as alarm information, event data, and control instructions. The server places these data objects in a priority position in the internal processing queue to ensure that they can be forwarded and processed first.

[0109] Process regular data in sequence: For example, real-time data and measurement data of general equipment are processed in sequence in the queue according to priority tags to avoid data backlog during the processing.

[0110] Temporary storage of non-critical data: For example, non-critical data such as historical data and periodic status information. When the server load is high or the internal queue is congested, the server temporarily stores these data objects in the local cache and processes them after the processing resources are released or the load is restored.

[0111] Preferably, the standardized data structure consists of the following fields:

[0112] The deep standardized data structure includes key fields, standardized fields, and extended fields;

[0113] Key fields include device ID, measurement point ID, and data type, which are basic fields used to identify and distinguish data sources and types;

[0114] Standardized fields are used to represent all data content in a unified format, including standardized information on voltage, current, device status, and control commands;

[0115] The extension field is used for additional information about specific devices and communication protocols, including alarm status, device health status, and control instructions, to supplement the specific characteristics of the description data;

[0116] During the deep standardization process, data fields in different protocol formats are mapped to standardized data structures through a dynamic mapping mechanism and uniformly converted into internal standardized structures, as follows:

[0117] The server preliminarily classifies and parses the data fields, and distinguishes between key fields and non-key fields according to predefined standardization rules; the standardization rules are set according to the protocol type and the device type, so that the fields of different protocols are positioned correspondingly in a unified structure;

[0118] The server selectively processes and maps different data fields according to the needs of each station, and dynamically adjusts the mapping rules. The mapping rule adjustment includes adding, ignoring and changing data fields, and only maps the data fields related to the station needs into the standardized data structure;

[0119] The data that has undergone deep standardization processing is reassembled into message content and message attributes to generate a complete standardized data structure, and the format is converted according to the internal standard format. The reassembled complete standardized data structure carries all the equipment data, attribute fields, priorities and extended information of the site, so that the data is complete and consistent when transmitted across network gates.

[0120] Based on the data after deep standardization processing, the message middleware is used to publish the data, and Protobuf is used for serialization and compression, which is used for data collection and transmission in the cross-gate environment of new energy stations.

[0121] Preferably, dynamically adjusting the mapping rules also includes: the operation and maintenance personnel allow the user to define and adjust the mapping rules of the data fields on a graphical interface through a visual mapping configuration tool, the visual tool displays the correspondence between each protocol field and the standardized field, and the user adjusts the mapping rules by dragging and dropping or clicking.

[0122] Preferably, according to the data in a unified internal standardized format, the message middleware is used to publish the data, and Protobuf is used for serialization and compression, which is used for data collection and transmission in the cross-gate environment of new energy stations; the details are as follows:

[0123] Prepare to publish the complete and standardized data through RabbitMQ messaging middleware. The server will classify and allocate the topics for data publishing according to the needs of the site and optimize the transmission path.

[0124] Specifically, depending on the scale of the site, in addition to using RabbitMQ for transmission and interaction, other similar middleware such as kafka and rocketmq can also be used for transmission and interaction.

[0125] Before publishing the data, the data fields are serialized according to the Protobuf definition, and the text and numerical data are compressed into binary format;

[0126] The data packet serialized by Protobuf is pushed to the RabbitMQ message middleware, and RabbitMQ will publish the data according to the predefined message topic.

[0127] Preferably, using Protobuf for serialization compression also includes:

[0128] Using incremental data compression, Protobuf compares the current data with the previous data before each data serialization, and only compresses and transmits the changed parts, while the unchanged data is processed through local cache;

[0129] For the cross-gate environment of new energy sites, identify specific network bottlenecks in the cross-gate environment, and adjust the size and transmission interval of data packets according to the characteristics of network isolation to optimize transmission under restricted network conditions.

[0130] Example 2 of the present invention provides a new energy station cross-gate remote data acquisition system, including: a station data acquisition module, a data transmission module, a data processing and forwarding module, and a data publishing and compression module;

[0131] The station data acquisition module is used to collect data from new energy station equipment, perform preliminary analysis on the data according to different communication protocols, and divide the data into message content and message attributes;

[0132] The data transmission module is used to transmit the standardized station data in combination with the set priority tags in one direction through the isolation device, so that the data is transmitted from the inside of the station to the outside;

[0133] The data processing and forwarding module is used to receive data transmitted by the isolation device, perform deep standardization processing on data of different protocols, and convert the data into an internal format, and adjust the data forwarding strategy according to the requirements of dynamic configuration;

[0134] The data publishing and compression module is used to publish unified internal standardized format data through the message middleware, and use Protobuf technology for serialization and compression to enable data transmission across network gates.

[0135] like Figure 1 As shown, on the new energy station side, the station side data source equipment, the station area 1 data acquisition server, the isolation device, and the station area 3 data forwarding server are connected to the network in sequence; on the regional centralized control side, the RabbitMQ server, application server, and client / workstation are connected to the network in sequence.

[0136] Furthermore, the functions and uses of the above parts are as follows:

[0137] The data source collection equipment on the station side is used to obtain the real-time operation data of various equipment in the new energy station.

[0138] The data acquisition server in area 1 of the station is used for communication, protocol analysis, and data conversion with the data source equipment at the station side.

[0139] The isolation device is used to ensure that the station data can only be transmitted in one direction, ensuring the security of the station data.

[0140] The data forwarding server in Zone 3 of the station is used to receive the real-time data of the new energy station from the data collection server in Zone 1 of the previous station, receive the configuration data pushed by the RabbitMQ server on the regional centralized control side, parse and standardize the received real-time data of the station, organize the forwarding data according to the configuration, and push the forwarding data to the RabbitMQ server on the regional centralized control side. The data forwarding server in Zone 3 of the station communicates with the RabbitMQ server on the regional centralized control side through a wireless private network.

[0141] The RabbitMQ server on the regional centralized control side is used to receive forwarding data pushed by the data acquisition server in zone 1 of the station and push it to the application server on the regional centralized control side, receive configuration data uploaded by the application server on the regional centralized control side and send it to the data forwarding server in zone 3 of the station.

[0142] The application server on the regional centralized control side is used to receive data pushed by the RabbitMQ server on the regional centralized control side, and perform parsing and data processing.

[0143] The client / workstation on the regional centralized control side is used for visual display through the human-machine interface.

[0144] Based on the above components, preferably, the data collection method comprises the following specific steps:

[0145] The data acquisition server in area 1 of the station communicates with the data source equipment on the station side, performs protocol analysis and data conversion on the received data. The communication interface can be Ethernet or RS-485, etc., and the protocol can be IEC104, IEC101, IEC102, OPC, etc. The data obtained after protocol analysis and data conversion is the real-time data on the station side, and its data format varies according to different protocol formats. For example, the standard format after IEC104 protocol conversion includes "IEC104, channel number, station address, point number, value, timestamp, quality code, general call / change", where IEC104 is a fixed string, indicating that this data is collected through the IEC104 protocol; the standard format after OPC protocol conversion includes "OPC, tag, code, value, timestamp", where OPC is a fixed string, indicating that this data is collected through the OPC protocol.

[0146] The data acquisition server in area 1 of the station organizes the parsed data into TCP data packets and sends them to the data forwarding server in area 3 of the station through the isolation device.

[0147] The data forwarding server in zone three of the station receives the TCP data packets transmitted by the isolation device, parses, processes and standardizes the contents of the data packets, and converts data of different protocols into a unified format, including: internal ID, value, timestamp, and quality code.

[0148] The data forwarding server in the third area of ​​the station sends the specified data to the specified Topic of the regional centralized control RabbitMQ server according to the forwarding configuration at the set time frequency. In order to reduce the transmission bandwidth and ensure security, the data will be serialized using Protobuf technology before sending.

[0149] The regional centralized control application server establishes a connection with the regional centralized control RabbitMQ server and subscribes to the same Topic as in step 4.

[0150] The regional centralized control RabbitMQ server receives the data pushed by the data forwarding server in zone 3 of the station, and forwards the data to the regional centralized control application server that has subscribed to the same Topic.

[0151] The regional centralized control application server analyzes and stores the received station data.

[0152] Visual display is performed through the human-machine interface on the regional centralized control workstation / client.

[0153] Based on the above components, the acquisition configuration method is as follows:

[0154] On the regional centralized control workstation / client, the operation and maintenance personnel configure the measurement points and collection frequency that the regional centralized control needs to collect through the visual interface.

[0155] After the operation and maintenance personnel complete all configurations, they can operate on the configuration update interface.

[0156] After receiving the command, the regional centralized control application server sends the configuration data to the regional centralized control RabbitMQ server in the agreed format to specify the Topic.

[0157] The data forwarding server in zone 3 of the station establishes a connection with the regional centralized control RabbitMQ server and subscribes to the same Topic as in step 3.

[0158] The regional centralized control RabbitMQ server receives the configuration data sent from the regional centralized control application server and forwards the data to the data forwarding server in zone 3 of the site that has subscribed to the same Topic.

[0159] The data forwarding server in zone three of the station receives the configuration data, parses it, and updates the local configuration information and cache, thereby realizing the dynamic configuration and forwarding of new energy station data.

[0160] It should be noted that the station-side data source collection equipment, station zone 1 data collection server, isolation device, station zone 3 data forwarding server, regional centralized control RabbitMQ server, regional centralized control application server, and regional centralized control client / workstation in the present invention are all conventional equipment currently available on the market.

[0161] The beneficial effects of the present invention include at least:

[0162] (1) By using Protobuf technology for serialization compression, the data volume is effectively reduced and the bandwidth usage is optimized, which is particularly suitable for remote site environments with limited bandwidth. Compared with traditional data transmission methods, the present invention can transmit data more efficiently under limited network resources and reduce congestion and data loss during the transmission process.

[0163] (2) In the present invention, the data transmission strategy is adjusted according to the actual operation status and dynamic configuration of the station through the data forwarding server of the third zone of the station. Different from the fixed data transmission cycle in the prior art, the present invention realizes flexible dynamic adjustment, ensuring that important data can be transmitted first, and secondary data can be transmitted without affecting the overall operation, thus ensuring the real-time and flexibility of data transmission.

[0164] (3) By deeply standardizing data of different protocols and converting them into internal formats, the present invention is compatible with a variety of data sources and communication protocols and meets the needs of a variety of new energy station equipment. Compared with the existing technology that may require manual adjustment for different equipment, the present invention greatly improves the adaptability of the system and reduces human intervention.

[0165] (4) During the data transmission process, the present invention realizes one-way transmission through an isolation device, and combines the use of Protobuf serialization compression and message middleware to ensure the security and integrity of data transmission. In the prior art, especially in a cross-gate environment, data transmission is vulnerable to external attacks or data loss risks, while the present invention greatly reduces these risks through multi-layer encryption and transmission verification mechanisms.

[0166] (5) The present invention is specially designed for the remote, scattered and harsh environment of new energy stations. Through the intelligent and intensive remote data collection and transmission system, it realizes the efficient management mode of "no one on duty, few people on duty", and improves the production and operation efficiency. Compared with the traditional decentralized management mode, the present invention reduces the dependence on manpower and reduces the operating cost.

[0167] (6) The present invention can effectively utilize limited bandwidth by compressing and optimizing the data transmission path, especially when sharing the network with the video stream, thereby avoiding the data interruption problem caused by insufficient bandwidth in the prior art.

[0168] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0169] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents, and any modifications or equivalent replacements that do not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A remote data collection method for new energy stations across network gates, characterized in that: The following steps are involved: The data collection server in area 1 of the station collects data from the new energy station equipment, identifies and preliminarily analyzes the data of different communication protocols based on the global unique identifier, and divides the data into message content and message attributes; According to the global identification and message attributes of the parsed data, set the priority of the collected data, adjust the data transmission strategy according to the priority, and transmit the data unidirectionally to the data forwarding server in Zone 3 of the station through the isolation device; After receiving the data, the data forwarding server in Zone 3 of the station conducts in-depth standardization processing on the data of different protocols according to the message attributes, adjusts the data processing order according to the data priority, and adjusts the data forwarding strategy according to the station scale and dynamic configuration requirements to select the optimal target node for data forwarding; Based on the data after deep standardization processing, the message middleware is used to publish the data, and Protobuf is used for serialization and compression, which is used for data collection and transmission in the cross-gate environment of new energy stations.

2. According to claim 1, a new energy station cross-network gate remote data collection method is characterized by: The data collection server in area 1 of the station collects data from the new energy station equipment, identifies and preliminarily analyzes the data of different communication protocols based on the global unique identifier, and divides the data into message content and message attributes, as follows: The data acquisition server in area 1 of the station is connected to various new energy equipment in the station, including wind turbines, photovoltaic panels and substation equipment, to collect equipment status, measurement data and control instructions, and is compatible with communication protocols including IEC104, OPC, Modbus and DNP3; The server performs a preliminary analysis of the collected data according to the communication protocol, identifies the specific fields in each data message, and classifies the data according to the format defined by the protocol; the analysis process includes the analysis of the protocol header information and the extraction of the data content; The server divides the initially parsed data into two parts: message content and message attributes. The message content includes device status, measurement data and control instructions; the message attributes include protocol type, device identification, data type and timestamp information; After completing the initial parsing and separation of the message content and message attributes, the server converts the parsed data content according to the initial standardized format, unifies the data fields of different communication protocols into the initial standardized data structure, and forms initial standardized data containing content fields and attribute fields.

3. According to claim 1, a new energy station cross-network gate remote data collection method is characterized by: According to the global identification and message attributes of the parsed data, set the priority of the collected data, adjust the data transmission strategy according to the priority, and transmit the data unidirectionally to the data forwarding server of the third zone of the station through the isolation device, as follows: The collected data is prioritized according to the message attributes of the data, and a priority label is assigned to the data and attached to the data packet to identify the priority. The priority is set based on the following: The data types include real-time data, event data, alarm information and historical data, among which alarm information and event data are transmitted and processed first; For timestamp information, priority is given to transmission based on the difference between data collection time and processing time; For equipment identification, including key equipment and conventional equipment, the data collected by key equipment will be transmitted and processed first; According to the setting result of data priority, the data transmission strategy is dynamically adjusted, the transmission path and transmission time are allocated to each data packet according to the priority, and the queue position of the data packet during the transmission process is adjusted; The data after priority setting and transmission strategy adjustment is transmitted unidirectionally through the isolation device; By monitoring the data flow, checking whether there are any anomalies in the data packets, and encrypting and verifying the integrity of the transmitted data, each data packet generates an independent encrypted hash value and records it in the blockchain. After the data is transmitted to the data forwarding server in zone 3 of the station through the isolation device, the data forwarding server in zone 3 of the station receives and parses the transmitted data, and further adjusts the data processing order and forwarding strategy according to the priority of the data, so that the data can be transmitted within the station along the optimal path.

4. A new energy station cross-network gate remote data collection method according to claim 3, characterized in that: The isolation device determines the transmission path and encryption method of different data according to the priority label of the data, and filters the data at multiple levels and transmits the data in a graded manner; By real-time monitoring of network bandwidth and load conditions, the data transmission frequency is dynamically adjusted; when network congestion is detected, non-critical data is automatically cached in the internal storage of the isolation device and waits for the next transmission opportunity.

5. According to claim 1, a new energy station cross-network gate remote data collection method is characterized by: After receiving the data, the data forwarding server in Zone 3 of the station performs deep standardization processing on the data of different protocols according to the message attributes, adjusts the data processing order according to the data priority, and adjusts the data forwarding strategy according to the station scale and dynamic configuration requirements to select the optimal target node for data forwarding, as follows: The data forwarding server in Zone 3 of the station receives the data packets transmitted from the isolation device and performs deep standardization processing on the data fields according to the data protocol type, data type and device identification; During the deep standardization process, data fields in different protocol formats are mapped to standardized data structures through a dynamic mapping mechanism and uniformly converted into internal standardized structures; The data forwarding strategy is adjusted in real time according to the dynamic configuration of the site; the configuration parameters include data priority, forwarding frequency and data receiving load; the data transmission path and priority are adjusted according to the configuration; According to the real-time status of the station and the receiving capacity of the target node, the server dynamically optimizes the data forwarding strategy and transmits the data to the target node via the optimal path; According to the real-time status of the target node, including the current load, response speed and receiving capacity, the optimal node is selected for data distribution; for nodes with lower load and faster response speed, the server distributes data according to priority; When the target node fails, times out, or is unable to receive data, the server can automatically distribute the data to other backup nodes.

6. A new energy station cross-network gate remote data collection method according to claim 5, characterized in that: The normalized data structure consists of the following fields: The deep standardized data structure includes key fields, standardized fields, and extended fields; Key fields include device ID, measurement point ID, and data type, which are basic fields used to identify and distinguish data sources and types; Standardized fields are used to represent all data content in a unified format, including standardized information on voltage, current, device status, and control commands; The extension field is used for additional information about specific devices and communication protocols, including alarm status, device health status, and control instructions, to supplement the specific characteristics of the description data; During the deep standardization process, data fields in different protocol formats are mapped to standardized data structures through a dynamic mapping mechanism and uniformly converted into internal standardized structures, as follows: The server preliminarily classifies and parses the data fields, and distinguishes between key fields and non-key fields according to predefined standardization rules; the standardization rules are set according to the protocol type and the device type, so that the fields of different protocols are positioned correspondingly in a unified structure; The server selectively processes and maps different data fields according to the needs of each station, and dynamically adjusts the mapping rules. The mapping rule adjustment includes adding, ignoring and changing data fields, and only maps the data fields related to the station needs into the standardized data structure; The data that has undergone deep standardization processing is reassembled into message content and message attributes to generate a complete standardized data structure, and the format is converted according to the internal standard format. The reassembled complete standardized data structure carries all the equipment data, attribute fields, priorities and extended information of the site, so that the data is complete and consistent when transmitted across network gates.

7. A new energy station cross-network gate remote data collection method according to claim 5 or 6, characterized in that: Dynamic adjustment of mapping rules also includes: operation and maintenance personnel use visual mapping configuration tools to allow users to define and adjust the mapping rules of data fields on a graphical interface. The visual tool displays the correspondence between each protocol field and the standardized field, and users adjust the mapping rules by dragging and dropping or clicking.

8. The method for remote data collection across network gates of a new energy station according to claim 1 is characterized by: According to the data in a unified internal standardized format, the message middleware is used to publish the data, and Protobuf is used for serialization and compression, which is used for data collection and transmission in the cross-gate environment of new energy stations; the details are as follows: Prepare to publish the complete standardized data through RabbitMQ messaging middleware. The server will classify and allocate the topics for data publishing according to the needs of the site and optimize the transmission path. Before publishing the data, the data fields are serialized according to the Protobuf definition, and the text and numerical data are compressed into binary format; The data packet serialized by Protobuf is pushed to the RabbitMQ message middleware, and RabbitMQ will publish the data according to the predefined message topic.

9. A new energy station cross-network gate remote data collection method according to claim 8, characterized in that: Use Protobuf technology for serialization compression, including: Using incremental data compression, Protobuf compares the current data with the previous data before each data serialization, and only compresses and transmits the changed parts, while the unchanged data is processed through local cache; For the cross-gate environment of new energy sites, identify specific network bottlenecks in the cross-gate environment, and adjust the size and transmission interval of data packets according to the characteristics of network isolation to optimize transmission under restricted network conditions.

10. A remote data acquisition system for new energy stations across network gates, comprising: Station data acquisition module, data transmission module, data processing and forwarding module, and data publishing and compression module; A method for remote data collection across network gates of a new energy station is implemented as described in any one of claims 1 to 9, characterized in that: The station data acquisition module is used to collect data from new energy station equipment, perform preliminary analysis on the data according to different communication protocols, and divide the data into message content and message attributes; The data transmission module is used to transmit the standardized station data in combination with the set priority tags in one direction through the isolation device, so that the data is transmitted from the inside of the station to the outside; The data processing and forwarding module is used to receive data transmitted by the isolation device, perform deep standardization processing on data of different protocols, and convert the data into an internal format, and adjust the data forwarding strategy according to the requirements of dynamic configuration; The data publishing and compression module is used to publish unified internal standardized format data through the message middleware, and use Protobuf technology for serialization and compression to enable data transmission across network gates.

Images