Data synchronization method between substation centralized monitoring system and power grid resource business center

Abstract

The present invention discloses a data synchronization method between a substation centralized monitoring system and a power grid resource business middle station, belonging to the technical field of data transmission. The data synchronization method between the substation centralized monitoring system and the power grid resource business middle station includes the following steps: the substation centralized monitoring system pre-processes the received real-time monitoring data: according to the full amount of real-time monitoring data saved in advance, the real-time monitoring data with numerical changes are screened out, and then the real-time monitoring data with numerical changes are packaged and sent to the power grid resource business middle station; the power grid resource business middle station performs model splicing on the received real-time monitoring data with numerical changes. The real-time data generated by the screening is compressed and sent, and the power grid resource business middle station decompresses, processes and stores the data accordingly. The delay of transmitting the real-time monitoring data from the substation centralized monitoring system to the power grid resource business middle station is reduced to less than 5 seconds, and the accuracy and integrity can reach more than 99%.

Description

Technical Field

[0001] The present invention relates to the technical field of data transmission, and in particular to a data synchronization method, system and computer-readable storage medium between a centralized monitoring system of a substation and a power grid resource service center. Background Art

[0002] The scale of real-time monitoring data of the power grid system is huge. A centralized control station monitors an average of 100 substations, with an estimated 150,000 telemetry points, 50,000 telesignaling points, and 10,000 alarm events. For example, 15 centralized control stations are established in a certain place, and the synchronization volume of real-time monitoring data of the power grid system reaches 3.15 million each time, and it is synchronized every 15 seconds. Generally, the massive real-time data between the centralized monitoring system of the substation and the power grid resource business middle station is transmitted in full. When processing large amounts of real-time data, there are problems of high latency and data loss, which greatly affects the display and use of real-time data in the power grid resource business middle station. Summary of the invention

[0003] The object of the present invention is to provide a data synchronization method between a substation centralized monitoring system and a power grid resource service center to solve the problems of high delay in real-time data synchronization and data loss.

[0004] In order to solve the above technical problems, the present invention provides a data synchronization method between a substation centralized monitoring system and a power grid resource service center, comprising the following steps:

[0005] S1: The substation centralized monitoring system pre-processes the received real-time monitoring data: based on the pre-saved full amount of real-time monitoring data, the real-time monitoring data with value changes are screened out, and then the real-time monitoring data with value changes are packaged and sent to the power grid resource business middle station;

[0006] S2: The power grid resource service middle station performs model splicing on the received real-time monitoring data of the value changes, and stores the real-time monitoring data of the value changes in a corresponding manner in a distributed cache database.

[0007] Preferably, the types of the real-time monitoring data include measurement information and alarm information, wherein the structure of the real-time monitoring data accessing the substation centralized monitoring system is a message queue.

[0008] Preferably, S1 further comprises: synchronously updating the screened real-time monitoring data of the value change to the full amount of real-time monitoring data as the full amount of real-time monitoring data for next screening.

[0009] Preferably, in S1, the step of screening the real-time monitoring data with numerical changes includes: obtaining the data values ​​of the real-time monitoring data and the full real-time monitoring data, performing hash value verification, if the hash values ​​are different, the real-time monitoring data is the real-time monitoring data with numerical changes, sending the real-time monitoring data with numerical changes to the power grid resource business middle station, and updating the full real-time monitoring data at the same time; if the hash values ​​are the same, no processing is performed.

[0010] Preferably, S1 includes: the substation centralized monitoring system compresses the real-time monitoring data of the numerical changes and sends it to the power grid resource business middle station through a message channel in the data structure of a message queue. Correspondingly, in S2, the service bus of the power grid resource business middle station consumes the message queue from the message channel and then performs data decompression and model splicing in sequence.

[0011] Preferably, in S2, the step of model splicing by the service bus of the power grid resource business center includes: the service bus finds the corresponding resource account in the power grid resource business center according to the received real-time monitoring data of the value change, and updates the value of the resource account.

[0012] Preferably, in S2, the service bus uses a distributed streaming computing framework to process the real-time monitoring data of the numerical changes, and operates several stream processing instances in parallel, wherein each of the stream processing instances consumes the real-time monitoring data of the numerical changes from the message channel and then decompresses it, and then finds the resource account corresponding to the power grid resource business middle station, performs file splicing, and stores it in a distributed cache database for retrieval, display or use.

[0013] Preferably, the step of the substation centralized monitoring system accessing the real-time monitoring data includes: the real-time monitoring data is generated in safety zone I and safety zone II, and then synchronized to the real-time library of safety zone III through an isolation device, and the real-time library of safety zone III is synchronized to safety zone IV in the form of real-time messages for data storage, and the real-time monitoring data of the numerical changes are screened, saved and sent in the safety zone IV.

[0014] A data synchronization system between a substation centralized monitoring system and a power grid resource business middle station, comprising:

[0015] A first storage module is used to pre-store the full amount of real-time monitoring data, and access and store the real-time monitoring data generated by the substation centralized monitoring system;

[0016] An audit module is used to read the values ​​of the real-time monitoring data and the full real-time monitoring data to perform hash value verification: if the hash values ​​are different, the real-time monitoring data with different hash values ​​are compressed and packaged by the sending module and sent to the power grid resource business middle station in the data structure of the message queue, and the full real-time monitoring data is updated; if the hash values ​​are the same, the processing is terminated;

[0017] A processing module is used to consume and decompress the real-time monitoring data with different hash values ​​received by the power grid resource service center, and then read the real-time monitoring data with different hash values ​​and distribute it to the corresponding resource account in the power grid resource service center, wherein the processing module uses a distributed stream computing framework to consume and process data, and parallelly calculates a number of stream processing instances;

[0018] The second storage module adopts distributed storage to store the real-time monitoring data under the corresponding resource account in the power grid resource business.

[0019] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the data synchronization method between a centralized monitoring system of a substation and a resource business middle station as described above.

[0020] In the data synchronization method between the substation centralized monitoring system and the power grid resource business middle station provided by the present invention, the generated real-time monitoring data is first audited and screened, wherein the real-time monitoring data that has changed relative to the pre-saved original data is the data that needs to be transmitted and updated, thereby greatly reducing the amount of data transmitted. Secondly, the transmitted data is packaged and compressed to save space, further reducing the amount of data sent. Finally, the data is sent in the structure of a message queue. The power grid resource business middle station correspondingly adopts a distributed streaming computing framework to consume data and improves the data processing speed. Through the above-mentioned real-time data processing flow, data loss is avoided while reducing data delay and improving the accuracy of data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a structural diagram of the transmission of data from the centralized monitoring system of the substation to the power grid resource business center;

[0022] Figure 2 It is a timing diagram of data transmission within the centralized monitoring system of a substation;

[0023] Figure 3 It is a data transmission flow chart of the security IV zone of the centralized monitoring system of the substation transmitting data to the power grid resource business center;

[0024] Figure 4 It is a flowchart of how the service bus parses and stores data. DETAILED DESCRIPTION

[0025] The following is a further detailed description of the data synchronization method between the substation centralized monitoring system and the power grid resource business middle station proposed in the present invention in combination with the accompanying drawings and specific embodiments. According to the following description, the advantages and features of the present invention will become clearer. It should be noted that the accompanying drawings are all in a very simplified form and are not in precise proportions, which are only used to conveniently and clearly assist in explaining the purpose of the embodiments of the present invention.

[0026] The inventors found that the method of transmitting massive real-time monitoring data of the power grid from the centralized monitoring system of the substation to the power grid resource business center has high latency and data loss problems.

[0027] Based on this, the core idea of ​​the present invention is to filter the generated real-time data, filter out the data with numerical changes and transmit them to the power grid resource business middle station, and perform data analysis and processing on the power grid business resource business middle station side, so as to improve the timeliness, completeness and accuracy of real-time data access.

[0028] For details, please refer to Figure 1-Figure 4 , which is a schematic diagram of an embodiment of the present invention. Figure 1 As shown, a data synchronization method between a substation centralized monitoring system and a power grid resource service center comprises the following steps:

[0029] S1: The substation centralized monitoring system pre-processes the received real-time monitoring data: based on the pre-saved full amount of real-time monitoring data, the real-time monitoring data with value changes are screened out, and then the real-time monitoring data with value changes are packaged and sent to the power grid resource business middle station.

[0030] like Figure 3 By screening all the real-time monitoring data generated, unchanged data is not processed, and changed data is compressed and sent to the message channel and transmitted to the power grid resource business middle station, the amount of data that needs to be transmitted is greatly reduced, data loss is avoided, and the delay time of data update is reduced.

[0031] The data that generally need to be updated and transmitted in real time can be found in the various data accessed by the substation centralized monitoring system listed in Table 1 below. The types of real-time monitoring data include measurement information and alarm information, wherein the structure of the real-time monitoring data accessed by the substation centralized monitoring system is a message queue.

[0032]

[0033] Table 1 Real-time monitoring data types

[0034] The steps of accessing the real-time monitoring data to the centralized monitoring system of the substation include: the real-time monitoring data is generated in safety zone I and safety zone II, and then synchronized to the real-time library of safety zone III through an isolation device. The real-time library of safety zone III is synchronized to safety zone IV in the form of real-time messages for data storage, and the real-time monitoring data of the numerical changes are screened, saved and sent in safety zone IV.

[0035] In order to achieve information security between different devices in the substation, the equipment deployment in the general smart substation is divided into four areas, among which the safety areas I and II are production control areas, which mainly complete the monitoring and control functions of various primary and secondary equipment in the substation, and the safety areas III and IV are management information areas, which are mainly used for scheduling production management and office automation information management. Figure 2 As shown in the figure, real-time monitoring data (telemetry, telesignaling and abnormal alarm) is generated in safety zone I and II and refreshed every 6 seconds; then the real-time monitoring data is synchronized to the real-time library of safety zone III through the message service and the isolation device, and the transmission process is expected to take 15 seconds; finally, the real-time monitoring data is synchronized from the real-time library of safety zone III to the real-time library of safety zone IV through the firewall in the form of real-time messages for data storage, and the delay from the real-time library of safety zone III to the data storage of safety zone IV is 1 second. It is estimated that 22 seconds are required for data generation and storage in the substation. The generation of data in the substation terminal itself has a certain delay. The data transmission time between the substation and the middle station needs to be compressed as much as possible to ensure the timeliness of information transmission.

[0036] like Figure 3 As shown, in S1, the step of screening the real-time monitoring data of the value change includes: obtaining the data values ​​of the real-time monitoring data and the full real-time monitoring data, performing hash value verification, if the hash values ​​are different, the real-time monitoring data is the real-time monitoring data of the value change, sending the real-time monitoring data of the value change to the power grid resource business middle station, and updating the full real-time monitoring data at the same time; if the hash values ​​are the same, no processing is performed. Specifically, the screened real-time monitoring data of the value change is synchronously updated to the full real-time monitoring data as the full real-time monitoring data for the next screening.

[0037] Generally speaking, when all real-time monitoring data is first accessed, it is used as the full amount of real-time monitoring data. When subsequent data enters, it is compared one by one with the values ​​of the full amount of real-time monitoring data. The changed data is screened out and a cache library is established for storage. The structure is: lc-data:key-value lc-data:telemetry / telesignaling ID:telemetry / telesignaling value. The key-value distributed storage system has fast query speed, large data storage volume, and supports high concurrency. Here, hash value verification is used to compare whether the data value under the same entry has changed. The characteristic that it is difficult to find two different inputs corresponding to the same hash value is used to avoid data tampering.

[0038] In addition, the S1 also includes: the substation centralized monitoring system compresses the real-time monitoring data of the numerical changes and sends it to the power grid resource business middle station through the message channel in the data structure of the message queue. Correspondingly, in the following S2, the service bus of the power grid resource business middle station consumes the message queue from the message channel and then decompresses the data and splices the model in turn. In order to save space and reduce the amount of data sent, data compression technology is used to compress the data, and the string data is converted into binary before sending, and transmitted to the power grid resource business middle station through the message channel.

[0039] S2: Figure 1 As shown, the power grid resource business middle station performs model splicing on the received real-time monitoring data of the numerical changes, and stores the real-time monitoring data of the numerical changes in a distributed cache database. The power grid resource business middle station can receive monitoring data from multiple substations. After the service bus on the power grid resource business middle station side collects the monitoring data from each station, it decompresses the data and converts it from binary to a string structure. Then, through model splicing, it finds the corresponding power grid resource business middle station resource account, and finally stores it in a distributed database to provide data support for real-time data display and other business systems.

[0040] The S2 also includes: the substation centralized monitoring system compresses the real-time monitoring data of the value change and sends it to the power grid resource business center through the message channel in the data structure of the message queue, and the service bus of the power grid resource business center consumes the message queue from the message channel and then performs data decompression and model splicing in sequence. In the S2, the step of model splicing by the service bus of the power grid resource business center includes: the service bus finds the corresponding resource account in the power grid resource business center according to the received real-time monitoring data of the value change, and updates the value of the resource account.

[0041] In S2, the service bus uses a distributed streaming computing framework to process the real-time monitoring data of the value changes, and parallelizes several stream processing instances, wherein each stream processing instance consumes the real-time monitoring data of the value changes from the message channel, decompresses it, and then finds the resource account corresponding to the power grid resource business middle station, performs file splicing, and stores it in the distributed cache database for retrieval, display or use. Figure 4 ,The service bus uses a distributed stream computing framework to consume and process data, and runs five stream processing instances in parallel, each instance is divided into three nodes: data consumption, data processing, and data storage.,That is, consuming real-time data from the message channel, and then processing,finding the corresponding resource account of the power grid resource business middle platform, performing file splicing, and then storing the real-time monitoring data in the distributed cache database.

[0042] Based on the above data synchronization method, a control experiment was also conducted. By monitoring the same value displayed on the display device on the substation side and the display device on the middle station side, in the first group of experiments, when the data displayed on the display device on the substation side changed, the corresponding display device on the middle station side changed after 1.5s; in the second group of experiments, the display device on the middle station side changed 3.6s after the data displayed on the display device on the substation side changed. Therefore, the method provided by this application can greatly reduce the delay, the transmission time delay is within 5 seconds, and the timeliness of data access is improved.

[0043] Based on the same conception above, the present invention also provides a data synchronization system between a substation centralized monitoring system and a power grid resource service center, comprising:

[0044] A first storage module is used to pre-store the full amount of real-time monitoring data, and access and store the real-time monitoring data generated by the substation centralized monitoring system;

[0045] An audit module is used to read the values ​​of the real-time monitoring data and the full real-time monitoring data to perform hash value verification: if the hash values ​​are different, the real-time monitoring data with different hash values ​​are compressed and packaged by the sending module and sent to the power grid resource business middle station in the data structure of the message queue, and the full real-time monitoring data is updated; if the hash values ​​are the same, the processing is terminated;

[0046] A processing module is used to consume and decompress the real-time monitoring data with different hash values ​​received by the power grid resource service center, and then read the real-time monitoring data with different hash values ​​and distribute it to the corresponding resource account in the power grid resource service center, wherein the processing module uses a distributed stream computing framework to consume and process data, and parallelly calculates a number of stream processing instances;

[0047] The second storage module adopts distributed storage to store the real-time monitoring data under the corresponding resource account in the power grid resource business.

[0048] The present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the data synchronization method between the substation centralized monitoring system and the resource business middle station are implemented.

[0049] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (such as a floppy disk, a hard disk, a tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state drive Solid State Disk (SSD)), etc.

[0050] In summary, it can be seen that in the data synchronization method between the substation centralized monitoring system and the power grid resource business middle station provided in the embodiment of the present invention, all real-time monitoring data generated are audited and screened in real time, and the changed data is compressed and transmitted to the power grid resource business middle station, thereby reducing the amount of data transmission. The power grid resource business middle station performs data decompression, processing and storage accordingly. The delay in transmitting massive power grid real-time monitoring data from the substation centralized monitoring system to the power grid resource business middle station is within 5 seconds, and the accuracy and completeness can reach more than 99%, thereby solving the problems of high delay and data loss when processing large amounts of real-time data.

[0051] The above description is only a description of the preferred embodiments of the present invention, and is not intended to limit the scope of the present invention. Any changes or modifications made by a person skilled in the art in the field of the present invention based on the above disclosure shall fall within the scope of protection of the claims.

Claims

1. A data synchronization method between a substation centralized monitoring system and a power grid resource service center, characterized in that: The following steps are involved: S1: The substation centralized monitoring system pre-processes the received real-time monitoring data: based on the pre-saved full amount of real-time monitoring data, the real-time monitoring data with value changes are screened out, and then the real-time monitoring data with value changes are packaged and sent to the power grid resource business middle station. The types of the real-time monitoring data include measurement information and alarm information, wherein the structure of the real-time monitoring data accessing the substation centralized monitoring system is a message queue; The step of accessing the real-time monitoring data to the centralized monitoring system of the substation includes: the real-time monitoring data is generated in the safety zone I and the safety zone II, and then synchronized to the real-time library of the safety zone III through the isolation device, the real-time library of the safety zone III is synchronized to the safety zone IV in the form of real-time messages for data storage, and the real-time monitoring data of the value changes is screened, saved and sent in the safety zone IV; S2: the power grid resource service middle station performs model splicing on the received real-time monitoring data of the value change, and stores the real-time monitoring data of the value change in a distributed cache database; Among them, in said S2, the step of model splicing by the service bus of the said power grid resource business middle station includes: the service bus finds the corresponding resource account in the said power grid resource business middle station according to the received real-time monitoring data of the value change, and updates the value of the resource account; In S2, the service bus uses a distributed streaming computing framework to process the real-time monitoring data of the numerical changes, and parallelly calculates several stream processing instances, wherein each of the stream processing instances consumes the real-time monitoring data of the numerical changes from the message channel and then decompresses it, and then finds the resource account corresponding to the power grid resource business middle station, performs file splicing, and stores it in a distributed cache database for retrieval, display or use.

2. The data synchronization method between the substation centralized monitoring system and the power grid resource service center according to claim 1, characterized in that: The S1 further includes: synchronously updating the filtered real-time monitoring data of the value change to the full real-time monitoring data as the full real-time monitoring data for the next filtering.

3. The data synchronization method between the substation centralized monitoring system and the power grid resource service center according to claim 2, characterized in that: In S1, the step of screening the real-time monitoring data with numerical changes includes: obtaining the data values ​​of the real-time monitoring data and the full real-time monitoring data, performing hash value verification, if the hash values ​​are different, the real-time monitoring data is the real-time monitoring data with numerical changes, sending the real-time monitoring data with numerical changes to the power grid resource business middle station, and updating the full real-time monitoring data at the same time; if the hash values ​​are the same, no processing is performed.

4. The data synchronization method between the substation centralized monitoring system and the power grid resource service center according to claim 1, characterized in that: The S1 includes: the substation centralized monitoring system compresses the real-time monitoring data of the numerical changes and sends it to the power grid resource business middle station through the message channel in the data structure of the message queue. Correspondingly, in the S2, the service bus of the power grid resource business middle station consumes the message queue from the message channel and then performs data decompression and model splicing in sequence.

5. A data synchronization system between a substation centralized monitoring system and a power grid resource service center, characterized in that: include: A first storage module is used to pre-store the full amount of real-time monitoring data, and access and store the real-time monitoring data generated by the substation centralized monitoring system; The audit module pre-processes the received real-time monitoring data of the substation centralized monitoring system: based on the pre-saved full amount of real-time monitoring data, the real-time monitoring data with value changes are screened out, and then the real-time monitoring data with value changes are packaged and sent to the power grid resource business middle station, the types of the real-time monitoring data include measurement information and alarm information, wherein the structure of the real-time monitoring data accessing the substation centralized monitoring system is a message queue; The step of accessing the real-time monitoring data to the centralized monitoring system of the substation includes: the real-time monitoring data is generated in the safety zone I and the safety zone II, and then synchronized to the real-time library of the safety zone III through the isolation device, the real-time library of the safety zone III is synchronized to the safety zone IV in the form of real-time messages for data storage, and the real-time monitoring data of the value changes is screened, saved and sent in the safety zone IV; Among them, the step of screening the real-time monitoring data with value changes includes: the audit module reads the values ​​of the real-time monitoring data and the full real-time monitoring data to perform hash value verification, if the hash values ​​are different, compresses and packages the real-time monitoring data with different hash values ​​through the sending module and sends them to the power grid resource business middle station in the data structure of the message queue, updates the full real-time monitoring data, and ends the processing if the hash values ​​are the same; A processing module is used to enable the power grid resource business middle station to perform model splicing on the received real-time monitoring data of the value change, and store the real-time monitoring data of the value change in a distributed cache database; wherein the step of the service bus of the power grid resource business middle station performing model splicing includes: the service bus finds the corresponding resource account in the power grid resource business middle station according to the received real-time monitoring data of the value change, and updates the value of the resource account; The processing module is used to consume and decompress the real-time monitoring data with different hash values ​​received by the power grid resource business center, and then read the real-time monitoring data with different hash values ​​and distribute it to the corresponding resource account in the power grid resource business center, wherein the processing module uses a distributed streaming computing framework to consume and process data, and parallelly calculates a number of stream processing instances, wherein each of the stream processing instances consumes the real-time monitoring data of the value change from the message channel and then decompresses it, and then finds the resource account corresponding to the power grid resource business center, performs file splicing, and stores it in a distributed cache database for retrieval, display or use; The second storage module adopts distributed storage to store the real-time monitoring data under the corresponding resource account in the power grid resource business.

6. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the data synchronization method between the substation centralized monitoring system and the resource business middle station as described in any one of claims 1 to 4 are implemented.

Images