A highly reliable power grid data synchronization method and system
By filtering, compressing, classifying, and synchronizing power grid data in real time, the problems of error and security in power distribution network data transmission are solved, and highly reliable data synchronization is achieved.
Patent Information
- Application Number
- CN202410701644.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-31
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2044-05-31
AI Technical Summary
Existing power distribution network data transmission systems cannot effectively and timely process data from various power stations, resulting in insufficient data synchronization and transmission security, and failing to guarantee the real-time performance and accuracy of data transmission.
By collecting data from various power grid nodes, a node database is formed after first and second screening. The data is then compressed and merged to form a sub-node database. The data is then sorted and corrected, and correction data packets are transmitted synchronously in real time. Data is classified using a data hierarchical processing and fuzzy evaluation model. Data is collected in real time for anomaly analysis and early warning.
It improves the efficiency and accuracy of data transmission, ensures data security and real-time performance, and reduces system load and enhances data security and reliability through hierarchical processing and anomaly analysis and early warning.
Smart Images

Figure CN118820356B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of power grid data synchronization technology, specifically to a highly reliable power grid data synchronization method and system. Background Technology
[0002] With the rapid development of smart grids, power facilities at different levels, such as substations, distribution stations, and transmission lines, need to process and analyze a large amount of information from multiple fields. This information includes, but is not limited to, equipment status, energy flow, market demand, and environmental factors. For example, the temperature of transformers in substations, the status (on / off) of circuit breakers in distribution stations, the voltage and current levels of transmission lines, the amount of electricity transmitted from power plants to substations, the amount of electricity distributed from substations to users, and climatic conditions such as temperature, humidity, wind speed, and solar radiation intensity, which may affect the operating efficiency and lifespan of power grid equipment.
[0003] The power stations at different nodes on the distribution network need to transmit their daily data to the distribution network system for unified management. The real-time performance and accuracy of the data transmission process must be guaranteed. The current distribution network data transmission system cannot effectively and timely process the data from each power station node during transmission, which leads to errors in data synchronization. Moreover, data anomalies and leaks may occur during data transmission, so security needs to be improved. Summary of the Invention
[0004] In view of the above-mentioned problems, the present invention is proposed.
[0005] Therefore, in order to solve the above-mentioned technical problems, the present invention provides the following technical solution: a highly reliable power grid data synchronization method, comprising: collecting data from each node power station, performing a first screening on the collected data, using the first-screened data to form a node database, and performing a second screening on the data in the node database;
[0006] The data after the second screening is compressed and merged to form a secondary node database, and the data in the secondary node database is arranged and corrected.
[0007] The calibration data packet is obtained from the calibrated data in the secondary node database. The data in the calibration data packet is processed into a data classification to obtain a classified data packet. The classified data packet is then transmitted to all node databases in real time.
[0008] Collect data in real time, analyze anomalies in the real-time data and issue early warnings, predict risks and provide handling suggestions;
[0009] The process of obtaining the correction data packet from the corrected data in the secondary node database includes:
[0010] The corrected data packets are transmitted back to the node database in real time, the data in the corrected data packets are classified, and all node databases are updated and synchronized.
[0011] The data to be processed in the power grid data has multiple hierarchical attributes, including the amount of finance and funds contained in the data to be processed, the temporal span of the data blocks, the spatial span of the data blocks, and the correlation between the data blocks.
[0012] The data in the correction data packet is classified and output into multiple data classification levels;
[0013] The data classification level is positively correlated with the amount of finance, the amount of funds, the temporal span of data blocks, the spatial span of data blocks, and the correlation between data blocks;
[0014] When data is classified according to the degree of correlation between data blocks, the data classification includes low correlation data, medium correlation data, and high correlation data.
[0015] Low-correlation data are weakly linked and are considered as independent data blocks, including load data and weather data from different regions and systems;
[0016] Each data block with low correlation is classified separately, without considering the correlation between blocks. The classification rules are formulated based on the time span, spatial span, and financial quantity of the data blocks.
[0017] There are certain inherent connections between moderately correlated data, including power generation data, power transmission data and load data in a certain region. When classifying moderately correlated data, the influence of the attributes of the data block itself and the degree of correlation between blocks is considered at the same time. A fuzzy evaluation model is constructed to calculate the classification score by comprehensively considering multiple influencing factors.
[0018] The calculation formula for the fuzzy evaluation model is as follows:
[0019] ;
[0020] in, Let i be the grading score of the i-th data block. Let j be the weight of the j-th evaluation index. Let be the rating score of the i-th data block on the j-th indicator, where n is the total number of data blocks and m is the number of evaluation indicators. and These are indices representing weights and rating scores, used to adjust for their degree of influence. The coefficient for controlling the influence of inter-block correlation can be adjusted according to actual needs. Let be the correlation distance between the i-th data block and the k-th data block. The closer the distance, the higher the correlation between the two. and These are the rating scores of the i-th and k-th data blocks on the j-th metric, respectively.
[0021] As a preferred embodiment of the highly reliable power grid data synchronization method of the present invention, the first screening includes data integrity, data quality, data frequency, source reliability, and a specific identifier;
[0022] The node database consists of,
[0023] Collect daily data from each node power station;
[0024] It receives data from each node power station and pre-caches the data;
[0025] The pre-cached data is stored to generate a data packet;
[0026] The second filtering involves filtering the data in the node database;
[0027] The filtering criteria include time range, data size, and data type.
[0028] As a preferred embodiment of the high-reliability power grid data synchronization method described in this invention, the following includes: rearranging and correcting the data in the secondary node database.
[0029] The filtered data is then merged to combine data of the same type and form a data type database.
[0030] Data compression technology is used to compress the data storage volume in a data type database and merge similar or related data to form a secondary node database.
[0031] Organize and arrange the data in the secondary node database;
[0032] The sorting and arrangement includes arranging the logic and timing of the secondary node database, as well as discarding data that exceeds the threshold.
[0033] As a preferred embodiment of the highly reliable power grid data synchronization method described in this invention, the step of predicting risks and providing processing suggestions includes:
[0034] Continuously monitor the data stream and collect newly generated data in the node database in real time;
[0035] Analyze data patterns and historical data to obtain data analysis results, and identify potential risks or anomalies in the data based on the data analysis results;
[0036] The analytical data patterns and historical data include,
[0037] The normal operating range of various power grid parameters is calculated by using the average and standard deviation of historical data.
[0038] Use real-time data stream monitoring tools to track the latest power grid operation data;
[0039] Compare real-time data with the normal operating range to check for any deviations outside the normal range and obtain data analysis results;
[0040] Based on the data analysis results, predict potential risks or abnormal events in the data;
[0041] When an anomaly or risk is detected, the system automatically generates an alarm and notifies relevant personnel.
[0042] Based on the analysis results and risk assessment, specific handling measures and suggestions are proposed to help operators take appropriate measures.
[0043] Another objective of this invention is to provide a highly reliable power grid data synchronization system. To solve the above-mentioned technical problems, this invention provides the following technical solution: a highly reliable power grid data synchronization system, comprising: a central processing module, a data acquisition module, a data processing module, a data fusion module, a data correction module, a data synchronization module, a user interface module, a database module, a security and privacy module, and an early warning module;
[0044] The data acquisition module includes a receiving module and a storage module;
[0045] The data processing module includes a pre-selection module and a filtering module;
[0046] The data fusion module includes a compression module and a fusion module;
[0047] The data correction module includes an arrangement module and a correction module;
[0048] The data synchronization module includes a data packet acquisition module and a data packet transmission module;
[0049] The security and privacy module includes a data identification unit, a data filtering unit, a data classification unit, and a data grading unit.
[0050] As a preferred embodiment of the highly reliable power grid data synchronization method described in this invention, the user interface module is used by operators or administrators to log in to their accounts and operate the system.
[0051] The data acquisition module is used to collect daily data from each node power station and generate a node database;
[0052] The receiving module is used to receive data from each node power station and pre-cache the data; the storage module is used to store the pre-cache data and generate data packets.
[0053] The data processing module is used to process and filter the data in the node database.
[0054] The pre-selection module is used to pre-screen the data of the node power station acquired by the data acquisition module. The pre-screening conditions are set by setting multiple limiting conditions. The filtering module is used to further filter the pre-screened data. The filtering conditions include storage time and storage size.
[0055] The data fusion module is used to fuse the filtered data, merge data of the same type, and generate a data type database.
[0056] The compression module is used to compress the data processed by the data processing module to reduce the storage volume of the data packets. The fusion module is used to fuse the compressed data packets so that data packets of the same type can be fused. The type can be distinguished by the first character, time, and node network type.
[0057] The data correction module is used to correct the data in the secondary node database and rearrange the disordered data.
[0058] The sorting module is used to sort the merged data according to certain rules, while the correction module is used to correct the sorted data, modifying error information and deleting duplicate data.
[0059] The data synchronization module is used to integrate the rearranged data and transmit it synchronously in real time.
[0060] The data packet acquisition module is used to acquire the data packets arranged by the data correction module;
[0061] The data packet transmission module is used to synchronously transmit the arranged data packets and transmit the data packets to the database module for storage;
[0062] The database module includes a local database and a cloud database.
[0063] As a preferred embodiment of the highly reliable power grid data synchronization method of the present invention, the data identification unit is used to identify the power grid data to be identified in the database, and to store the identified power grid data to be identified in the corresponding power grid classification sub-database.
[0064] The data filtering unit is used for power grid data filtering criteria to filter out the data to be processed from the power grid data to be identified.
[0065] The data classification unit is used to classify the data to be processed in the power grid data;
[0066] The data grading unit performs data value grading and security and privacy assessment on the data to be processed in the power grid data based on the classification results of the data classification unit.
[0067] The early warning module includes a reading unit, a summarizing unit, an encryption unit, and an analysis unit. The encryption unit is connected to a key generation unit and a key management unit.
[0068] The analysis unit is connected to a monitoring terminal, a security management unit, and an alarm unit;
[0069] The reading unit is used to collect power grid data information from the database module;
[0070] The aggregation unit is used to aggregate the power grid data information stored in the database module in real time;
[0071] The analysis unit is used to analyze the collected power grid data and to issue data anomaly alarms and notify the monitoring terminal through the alarm unit.
[0072] The security management unit predicts the results of the analysis by the analysis unit and provides corresponding processing suggestions and measures to reduce risks independently to the user.
[0073] After the alarm unit issues a data anomaly alarm, the encryption unit encrypts the abnormal power grid data and generates a key at the same time.
[0074] A computer device includes a memory and a processor, the memory storing a computer program, characterized in that the processor executes the computer program to implement the steps of the highly reliable power grid data synchronization method described above.
[0075] A computer-readable storage medium having a computer program stored thereon, characterized in that, when the computer program is executed by a processor, it implements the steps of the highly reliable power grid data synchronization method described above.
[0076] The beneficial effects of this invention are as follows: The highly reliable power grid data synchronization system proposed in this invention improves transmission efficiency by processing data from each node power grid. By setting up data acquisition, data processing, data fusion, data correction, and data synchronization modules, it enhances data validity and avoids excessive system load from redundant data. By setting up security and privacy modules and early warning modules, it can simultaneously achieve hierarchical classification of existing and real-time data, ensuring data transmission security. Furthermore, it collects various indicator data in real time, performs anomaly analysis and early warning through an analysis unit combined with data from a summary unit, and conducts risk prediction and assessment through a security management unit. It deeply explores the relationships and trends between various indicator data and initiates risk reduction measures, greatly improving data security. Attached Figure Description
[0077] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0078] Figure 1 This is a schematic diagram of the terminal structure in the first embodiment of the present invention;
[0079] Figure 2 This is a flowchart illustrating the process in the first embodiment of the present invention;
[0080] Figure 3 This is a schematic diagram of the structure of a computer device in the third embodiment of the present invention.
[0081] Figure 4 This is a system module diagram according to the second embodiment of the present invention; Detailed Implementation
[0082] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the protection scope of the present invention.
[0083] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.
[0084] Example 1
[0085] Reference Figure 1 This invention provides a highly reliable power grid data synchronization method as one embodiment.
[0086] First, the highly reliable power grid data synchronization method provided in this application can be applied to, for example... Figure 1 In the terminal shown. For example... Figure 1 As shown, the terminal may include one or two ( Figure 1 Only one processor and a memory for storing data are shown in the diagram. The processor may be, but is not limited to, a processing system such as a microprocessor (MCU) or a programmable logic device (FPGA). The terminal may also include transmission devices for communication functions and input / output devices. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the terminal described above. For example, the terminal may also include components that are larger than... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.
[0087] The memory can be used to store computer programs, such as the computer program corresponding to the high-reliability power grid data synchronization method in this embodiment. The processor executes various functional applications and data processing by running the computer program stored in the memory, thereby implementing the above-described method. The memory may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage systems, flash memory, or other non-volatile solid-state memory. In some instances, the memory may further include memory remotely located relative to the processor, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.
[0088] The transmission device is used to receive or send data via a network. This network includes a wireless network provided by the terminal's communication provider. In one example, the transmission device includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device may be a Radio Frequency (RF) module, used for wireless communication with the Internet.
[0089] like Figure 2 As shown, this embodiment of the invention provides a highly reliable power grid data synchronization method, which is applied to... Figure 1Taking the terminal in the example, the explanation includes the following steps:
[0090] S1: Collect data from each node power station, perform a first screening on the collected data, combine the first-screened data to form a node database, and perform a second screening on the data in the node database.
[0091] S1.1: The first screening includes data integrity, data quality, data frequency, source reliability, and specific identifiers;
[0092] The node database consists of,
[0093] Collect daily data from each node power station;
[0094] It receives data from each node power station and pre-caches the data;
[0095] The pre-cached data is stored to generate a data packet;
[0096] S1.2: The second filtering includes filtering the data in the node database;
[0097] The filtering criteria include time range, data size, and data type.
[0098] S2: Compress and merge the data after the second screening to form a secondary node database, and then sort and correct the data in the secondary node database.
[0099] S2.1: The data fusion module is used to fuse the filtered data, so that data of the same type are merged and a secondary node database is formed.
[0100] Data compression technology is used to reduce the storage size of data, making it easier to process and transmit;
[0101] Similar or related data are merged to form a comprehensive secondary node database;
[0102] Organize and arrange the data in the secondary node database to ensure the logical and temporal correctness of the data.
[0103] S3: Obtain the correction data packet from the corrected data in the secondary node database and transmit it to the node database in real time.
[0104] S3.1: Extract the organized and corrected data packets from the data correction process;
[0105] The corrected data packets are transmitted back to the node database in real time to ensure that the database updates of all nodes are synchronized.
[0106] S3.2: The data to be processed in the power grid data has multiple hierarchical attributes. The hierarchical attributes include the amount of finance and funds contained in the data to be processed in the power grid data, the time span of the data block, the spatial span of the data block, and the correlation between the data blocks. The data hierarchical step outputs multiple data hierarchical levels.
[0107] The data classification level is positively correlated with the amount of financial data, the amount of capital data, the temporal span of data blocks, the spatial span of data blocks, and the correlation between data blocks. The data classification level and value are determined based on the following aspects: the amount of capital / finance data; larger data size indicates higher value and a higher classification level.
[0108] The data is large in volume, high in value, and of a high classification level.
[0109] Data with detailed classifications is of high value and has a high level of grading.
[0110] The data is highly complex, valuable, and classified at a high level.
[0111] The data is closely related, highly valuable, and has a high classification level.
[0112] When data is classified according to the degree of correlation between data blocks, the data classification includes low correlation data, medium correlation data, and high correlation data.
[0113] Low correlation data are weakly linked and can be considered as relatively independent data blocks, including load data and weather data from different regions and systems. For this type of data, each data block is classified separately without considering the correlation between blocks. The classification rules are formulated based on individual attributes such as the time span, spatial span, and financial quantity of the data block.
[0114] There are certain inherent connections between moderately correlated data, but the correlation strength is limited. This includes power generation data, transmission data, and load data in a certain region. There is a potential energy balance relationship between them, but there may also be deviations due to differences in data sources. For this type of data, when classifying, it is necessary to consider the influence of the attributes of the data block itself and the degree of correlation between blocks, construct a fuzzy evaluation model, and calculate the classification score by comprehensively considering multiple influencing factors.
[0115] Fuzzy evaluation models include,
[0116] ;
[0117] in, Let i be the grading score of the i-th data block. Let j be the weight of the j-th evaluation index. Let be the rating score of the i-th data block on the j-th indicator, where n is the total number of data blocks and m is the number of evaluation indicators. and These are indices representing weights and rating scores, used to adjust for their degree of influence. The coefficient for controlling the influence of inter-block correlation can be adjusted according to actual needs. Let be the correlation distance between the i-th data block and the k-th data block. The closer the distance, the higher the correlation between the two. and These are the rating scores of the i-th and k-th data blocks on the j-th metric, respectively.
[0118] We can also discuss the grading process in different scenarios based on the varying amounts of finance and capital in the power grid data. Specifically, we can categorize finance and capital into three levels, including...
[0119] Low financial and capital data do not contain financial or capital information, including monitoring data and weather data. For this type of data, there is no need to consider the impact of financial or capital factors during the classification process, and classification and evaluation can be carried out directly based on other attributes.
[0120] The data on medium financial and capital volume contains a certain amount of financial or capital volume, but the proportion is limited. This includes user data involving a small amount of electricity purchases, data on the purchase of ancillary services, etc. For this type of data, when classifying, it is necessary to consider financial and capital volume and other influencing factors at the same time. A weighted scoring method is used to score financial and capital volume, and then the scores of other attributes are weighted to calculate the comprehensive classification score.
[0121] In data with high financial and capital volume, finance or capital volume dominates, such as electricity spot or futures market trading data and large user electricity bill data. For this type of data, the impact of finance and capital volume should be given priority in the classification process. Other attributes can be used as auxiliary evaluation factors. First, the data should be initially classified according to finance / capital volume, and then further subdivided in combination with other attributes to finally obtain the classification result.
[0122] This grading method embodies the idea of intersection, which integrates and considers multiple influencing factors. The effects of different factors are intertwined and inseparable. It also embodies the idea of sequence, that is, first classifying according to the dominant factors, and then refining to secondary levels.
[0123] The process of classifying data based on its spatiotemporal characteristics includes:
[0124] Using the power grid's time series as a baseline, all data are divided into multiple time periods according to their time span, including annual, quarterly, and monthly periods, which is equivalent to segmenting the data in the time dimension.
[0125] Within each time period, the segmented data is further divided according to its spatial span characteristics. For annual data, it is divided into different regions according to the scope of the covered countries, further subdivided by province within the region, and further subdivided by city level within the province, and so on until the whole country is covered.
[0126] Within each spatiotemporal unit, the data blocks are evaluated and graded based on their correlation, financial / capital volume, and other attributes to obtain the final grading result.
[0127] S4: Collect data in real time, analyze anomalies and issue early warnings, predict risks and provide handling suggestions.
[0128] S4.1: Predicting risks and providing handling recommendations includes,
[0129] Continuously monitor the data stream and collect newly generated data in the node database in real time;
[0130] Analyze data patterns and historical data to obtain data analysis results, and identify potential risks or anomalies in the data based on the data analysis results.
[0131] S4.2: Analyzing data patterns and historical data includes,
[0132] The normal operating range of various power grid parameters is calculated by using the average and standard deviation of historical data.
[0133] Use real-time data stream monitoring tools to track the latest power grid operation data;
[0134] The real-time data is compared with the normal operating range to check for any deviations outside the normal range, and the data analysis results are obtained.
[0135] S4.3: Based on the data analysis results, predict potential risks or abnormal events in the data;
[0136] When an anomaly or risk is detected, the system automatically generates an alarm and notifies relevant personnel.
[0137] Based on the analysis results and risk assessment, specific handling measures and suggestions are proposed to help operators take appropriate measures.
[0138] Example 2
[0139] Reference Figure 4 According to one embodiment of the present invention, a highly reliable power grid data synchronization system is provided, comprising: a central processing module, a data acquisition module, a data processing module, a data fusion module, a data correction module, a data synchronization module, a user interface module, a database module, a security and privacy module, and an early warning module;
[0140] The data acquisition module includes a receiving module and a storage module;
[0141] The data processing module includes a pre-selection module and a filtering module;
[0142] The data fusion module includes a compression module and a fusion module;
[0143] The data correction module includes an arrangement module and a correction module;
[0144] The data synchronization module includes a data packet acquisition module and a data packet transmission module;
[0145] The security and privacy module includes a data identification unit, a data filtering unit, a data classification unit, and a data grading unit;
[0146] The early warning module includes a reading unit, a summarizing unit, an encryption unit, and an analysis unit;
[0147] The encryption unit includes a key generation unit and a key management unit;
[0148] The analysis unit includes a monitoring terminal, a security management unit, and an alarm unit;
[0149] The user interface module is used by operators or administrators to log in to their accounts and operate the system;
[0150] The data acquisition module collects data from each node power station through the receiving module and the storage module to form a node database;
[0151] The receiving module is used to receive data from each node power station and pre-cache the data. The storage module is used to store the pre-cache data and generate data packets.
[0152] The data processing module retrieves data from the node database and performs a first and second filtering of the data through a pre-selection module and a filtering module.
[0153] The pre-selection module is used to pre-screen the data of the node power station acquired by the data acquisition module. The pre-screening conditions are set by setting multiple limiting conditions. The filtering module is used to further filter the pre-screened data. The filtering conditions include storage time and storage size.
[0154] The data processing module outputs the filtered data to the data fusion module;
[0155] The data fusion module compresses and merges these data through the compression module and the fusion module to form a secondary node database. The data fusion module then outputs the secondary node database to the data correction module.
[0156] The compression module is used to compress the data processed by the data processing module to reduce the storage size of the data packets. The fusion module is used to fuse the compressed data packets so that data packets of the same type can be merged. The type can be distinguished by the first character, time, and node network type.
[0157] The data correction module is used to correct the data in the data model, rearrange the disordered data, and output the corrected data to the data synchronization module.
[0158] The sorting module is used to sort the merged data according to certain rules, while the correction module is used to correct the sorted data, modifying error information and deleting duplicate data.
[0159] The data synchronization module is used to acquire correction data packets through the data packet acquisition module and transmit the data to all node databases in real time through the data packet transmission module.
[0160] The data packet acquisition module is used to acquire the data packets arranged by the data correction module, and the data packet transmission module is used to synchronously transmit the arranged data packets to the database module for storage.
[0161] The database module includes local databases and cloud databases;
[0162] The security and privacy module is integrated into all data processing stages to ensure data security and privacy;
[0163] The data identification unit is used to identify the power grid data to be identified in the database, and to store the identified power grid data to be identified in the corresponding power grid classification sub-database;
[0164] The data filtering unit is used for power grid data filtering criteria to filter out the data to be processed from the power grid data to be identified.
[0165] The data classification unit is used to classify the data to be processed in the power grid data;
[0166] Based on the classification results of the data classification unit, the data grading unit performs data value grading and security and privacy assessment on the data to be processed in the power grid data;
[0167] The data to be processed in the power grid data has multiple hierarchical attributes, including the amount of finance, the amount of funds, the temporal span of the data block, the spatial span of the data block, and the correlation between the data blocks. The data hierarchical step outputs multiple data hierarchical levels, and the data hierarchical level is positively correlated with the amount of finance, the amount of funds, the temporal span of the data block, the spatial span of the data block, and the correlation between the data blocks.
[0168] The early warning module monitors data in the database module, performs anomaly analysis, and provides early warnings.
[0169] The reading unit is used to collect power grid data information from the database module;
[0170] The aggregation unit is used to aggregate power grid data information stored in the database module in real time;
[0171] The analysis unit is used to analyze the collected power grid data and to issue data anomaly alarms and notify the monitoring terminal through the alarm unit;
[0172] The security management unit predicts the results of the analysis by the analysis unit and provides corresponding processing suggestions and autonomous risk reduction measures to the user.
[0173] After the alarm unit issues a data anomaly alarm, the encryption unit encrypts the abnormal power grid data and generates a key at the same time.
[0174] The user interface module provides an interface for system operation and management;
[0175] Each module in the aforementioned high-reliability power grid data synchronization system can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so that the processor can call and execute the corresponding operations of each module.
[0176] Example 3
[0177] Reference Figure 3 This is the third embodiment of the present invention. Based on the first two embodiments, this embodiment provides a computer device, which can be a server, and its internal structure diagram can be as follows. Figure 3 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system, computer programs, and databases. The internal memory provides the environment for the operation of the operating system and computer programs stored in the non-volatile storage media.
[0178] The computer device's database is used to store motion detection data. The computer device's network interface is used to communicate with external terminals via a network connection. When the computer program is executed by the processor, it implements the steps in any of the above embodiments of the sparse tensor computation acceleration method.
[0179] Those skilled in the art will understand that Figure 3 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.
[0180] In one embodiment, the present invention provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps in any of the above embodiments of the sparse tensor operation acceleration method.
[0181] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the methods described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.
[0182] Example 4
[0183] As one embodiment of the present invention, a highly reliable power grid data synchronization method is provided. To verify the beneficial effects of the present invention, scientific demonstration is carried out through economic benefit calculations and simulation experiments.
[0184] To verify the effectiveness of this highly reliable power grid data synchronization method, we conducted the following experiment:
[0185] Experimental preparation
[0186] Construct a simulated power grid environment, including 10 virtual node power stations.
[0187] Different types of power grid data are simulated at each node power station, including load data, voltage data, current data, etc., totaling 1,000 data records.
[0188] Set data quality scoring criteria, including data integrity, data consistency, and timestamp accuracy, for the first screening.
[0189] Implementation process
[0190] Data was collected from each power grid node and initially filtered, resulting in 1000 data records from 10 power grid nodes. Based on a preset data quality scoring standard, the collected data underwent an initial screening, removing low-quality data. After this initial screening, 890 high-quality data records were retained. The filtered data was then merged to form the node database.
[0191] A second filtering and compression process is performed on the node database data. The 890 data records in the node database are filtered based on the following criteria: time frame within the past hour, data size less than 1MB, and data type either load or voltage. After this second filtering, 450 data records meeting the criteria are retained. The retained data is then fused, with load and voltage data of the same type being merged separately. The LZW algorithm is used to compress the fused data, resulting in compressed data packets of 20KB and 15KB respectively. These compressed data packets are then used to construct the secondary node database.
[0192] The secondary node database data is sorted and corrected by chronological and logical arrangement, discarding data with timestamps older than one hour. The sorted data is then corrected to remove errors and duplicates. Two correction data packets, 20KB and 15KB respectively, are retrieved from the corrected data.
[0193] The correction data packets are graded and synchronized. The 20KB correction data packet is classified as a high-level packet due to its high financial volume and large time span. The 15KB correction data packet is classified as a medium-level packet due to its lower financial volume and time span. The two graded data packets are then synchronously transmitted back to the database of 10 nodes in real time to complete data synchronization.
[0194] Real-time monitoring and early warning: Continuously monitors the real-time data streams of 10 node databases. Analyzes data patterns and historical data from the past hour to calculate the normal operating range of voltage data as 220V±10V. When the voltage data of a certain node power station continuously exceeds the normal range to 225V, an anomaly warning is issued. Based on the anomaly analysis, it predicts the risk of line overload and provides suggestions for switching to a backup line.
[0195] Table 1 Results Data Table
[0196]
[0197] As can be seen from the table above, this high-reliability power grid data synchronization method can effectively collect, process, and synchronize power grid data.
[0198] The data quality improvement process involved two rounds of screening. Low-quality original data was filtered out, resulting in a significant improvement in the quality of the remaining data. Of the 1000 original data entries, 890 were high-quality entries after the first screening, and an additional 450 high-quality entries meeting the criteria were retained after the second screening.
[0199] Data compression optimization significantly reduces data transmission and storage pressure through data fusion and compression techniques. 450 data entries were compressed into two data packets totaling 35KB, drastically reducing the data size.
[0200] Hierarchical synchronization enhances real-time performance by employing a data hierarchy strategy, prioritizing the synchronization of high-priority data packets to ensure the real-time performance of critical data. As shown in the table, the synchronization latency of high-priority data packets is generally lower than that of medium-priority data packets.
[0201] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.
Claims
1. A highly reliable power grid data synchronization method, characterized in that, include: Collect data from each node power station, perform a first screening on the collected data, combine the first-screened data to form a node database, and then perform a second screening on the data in the node database; The data after the second screening is compressed and merged to form a secondary node database, and the data in the secondary node database is arranged and corrected. The calibration data packet is obtained from the calibrated data in the secondary node database. The data in the calibration data packet is processed into a data classification to obtain a classified data packet. The classified data packet is then transmitted to all node databases in real time. Collect data in real time, analyze anomalies in the real-time data and issue early warnings, predict risks and provide handling suggestions; The step of obtaining the correction data packet from the corrected data in the secondary node database includes: The corrected data packets are transmitted back to the node database in real time, the data in the corrected data packets are classified, and all node databases are updated and synchronized. The data to be processed in the power grid data has multiple hierarchical attributes, including the amount of finance and funds contained in the data to be processed, the temporal span of the data blocks, the spatial span of the data blocks, and the correlation between the data blocks. The data in the correction data packet is classified and output into multiple data classification levels; The data classification level is positively correlated with the amount of finance, the amount of funds, the temporal span of data blocks, the spatial span of data blocks, and the correlation between data blocks; When data is classified according to the degree of correlation between data blocks, the data classification includes low correlation data, medium correlation data, and high correlation data. The low-correlation data are weakly linked and are considered as independent data blocks, including load data and weather data from different regions and systems; Each data block with low correlation is classified separately, without considering the correlation between blocks. The classification rules are formulated based on the time span, spatial span, and financial quantity of the data blocks. The moderately correlated data have certain inherent connections, including power generation data, power transmission data and load data in a certain region. When classifying moderately correlated data, the influence of the attributes of the data block itself and the degree of correlation between blocks is considered at the same time. A fuzzy evaluation model is constructed to calculate the classification score by comprehensively considering multiple influencing factors. The calculation formula for the fuzzy evaluation model is as follows: ; in, Let i be the grading score of the i-th data block. Let j be the weight of the j-th evaluation index. Let be the rating score of the i-th data block on the j-th indicator, where n is the total number of data blocks and m is the number of evaluation indicators. and These are indices representing weights and rating scores, used to adjust for their degree of influence. The coefficient for controlling the influence of inter-block correlation can be adjusted according to actual needs. Let be the correlation distance between the i-th data block and the k-th data block. The closer the distance, the higher the correlation between the two. and These are the rating scores of the i-th and k-th data blocks on the j-th metric, respectively.
2. The high-reliability power grid data synchronization method as described in claim 1, characterized in that: The first screening includes data integrity, data quality, data frequency, source reliability, and specific identifiers; The node database consists of, Collect daily data from each node power station; It receives data from each node power station and pre-caches the data; The pre-cached data is stored to generate a data packet; The second filtering involves filtering the data in the node database; The filtering criteria include time range, data size, and data type.
3. The high-reliability power grid data synchronization method as described in claim 2, characterized in that: The data arrangement and correction in the secondary node database includes, The filtered data is then merged to combine data of the same type and form a data type database. Data compression technology is used to compress the data storage volume in a data type database and merge similar or related data to form a secondary node database. Organize and arrange the data in the secondary node database; The sorting and arrangement includes arranging the logic and timing of the secondary node database, as well as discarding data that exceeds the threshold.
4. The high-reliability power grid data synchronization method as described in claim 3, characterized in that: The predicted risks and the provision of handling suggestions include Continuously monitor the data stream and collect newly generated data in the node database in real time; Analyze data patterns and historical data to obtain data analysis results, and identify potential risks or anomalies in the data based on the data analysis results; The analytical data patterns and historical data include, The normal operating range of various power grid parameters is calculated by using the average and standard deviation of historical data. Use real-time data stream monitoring tools to track the latest power grid operation data; Compare real-time data with the normal operating range to check for any deviations outside the normal range and obtain data analysis results; Based on the data analysis results, predict potential risks or abnormal events in the data; When an anomaly or risk is detected, the system automatically generates an alarm and notifies relevant personnel. Based on the analysis results and risk assessment, specific handling measures and suggestions are proposed to help operators take appropriate measures.
5. A highly reliable power grid data synchronization system, applied to a highly reliable power grid data synchronization method as described in any one of claims 1 to 4, characterized in that, include: The system includes a central processing module, a data acquisition module, a data processing module, a data fusion module, a data correction module, a data synchronization module, a user interface module, a database module, a security and privacy module, and an early warning module. The data acquisition module includes a receiving module and a storage module; The data processing module includes a pre-selection module and a filtering module; The data fusion module includes a compression module and a fusion module; The data correction module includes an arrangement module and a correction module; The data synchronization module includes a data packet acquisition module and a data packet transmission module; The security and privacy module includes a data identification unit, a data filtering unit, a data classification unit, and a data grading unit.
6. The high-reliability power grid data synchronization system as described in claim 5, characterized in that: The user interface module is used by operators or administrators to log in to their accounts and operate the system; The data acquisition module is used to collect daily data from each node power station and generate a node database; The receiving module is used to receive data from each node power station and pre-cache the data; the storage module is used to store the pre-cache data and generate data packets. The data processing module is used to process and filter the data in the node database. The pre-selection module is used to pre-screen the data of the node power station acquired by the data acquisition module. The pre-screening conditions are set by setting multiple limiting conditions. The filtering module is used to further filter the pre-screened data. The filtering conditions include storage time and storage size. The data fusion module is used to fuse the filtered data, merge data of the same type, and generate a data type database. The compression module is used to compress the data processed by the data processing module to reduce the storage volume of the data packets. The fusion module is used to fuse the compressed data packets so that data packets of the same type can be fused. The type can be distinguished by the first character, time, and node network type. The data correction module is used to correct the data in the secondary node database and rearrange the disordered data. The sorting module is used to sort the merged data according to certain rules, while the correction module is used to correct the sorted data, modifying error information and deleting duplicate data. The data synchronization module is used to integrate the rearranged data and transmit it synchronously in real time. The data packet acquisition module is used to acquire the data packets arranged by the data correction module; The data packet transmission module is used to synchronously transmit the arranged data packets and transmit the data packets to the database module for storage; The database module includes a local database and a cloud database.
7. The high-reliability power grid data synchronization system as described in claim 6, characterized in that: The data identification unit is used to identify the power grid data to be identified in the database, and to store the identified power grid data to be identified in the corresponding power grid classification sub-database. The data filtering unit is used for power grid data filtering criteria to filter out the data to be processed from the power grid data to be identified. The data classification unit is used to classify the data to be processed in the power grid data; The data grading unit performs data value grading and security and privacy assessment on the data to be processed in the power grid data based on the classification results of the data classification unit. The early warning module includes a reading unit, a summarizing unit, an encryption unit, and an analysis unit. The encryption unit is connected to a key generation unit and a key management unit. The analysis unit is connected to a monitoring terminal, a security management unit, and an alarm unit; The reading unit is used to collect power grid data information from the database module; The aggregation unit is used to aggregate the power grid data information stored in the database module in real time; The analysis unit is used to analyze the collected power grid data and to issue data anomaly alarms and notify the monitoring terminal through the alarm unit. The security management unit predicts the results of the analysis by the analysis unit and provides corresponding processing suggestions and measures to reduce risks independently to the user. After the alarm unit issues a data anomaly alarm, the encryption unit encrypts the abnormal power grid data and generates a key at the same time.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the high-reliability power grid data synchronization method according to any one of claims 1 to 4.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the high-reliability power grid data synchronization method according to any one of claims 1 to 4.
Citation Information
Patent Citations
Real-time synchronous integration system for comprehensive data of power grid based on streaming technology
CN113422827A
Electric power data security sharing method and system, and storage medium
CN117201187A
