Distributed acquisition method and system for electric power data

Abstract

The invention discloses a distributed acquisition method and system for electric power data, and the method comprises the steps: obtaining real-time electric power data in a database, and building distributed storage based on a storage index; obtaining a corresponding clone address according to the storage index, generating a corresponding mirror image virtual network card based on the clone address, and allocating a handshake channel for the mirror image virtual network card; acquiring data streams of a plurality of handshake channels, identifying data features of the data streams, classifying each handshake channel according to the data features, and determining actual acquisition objects of the handshake channels; and performing distributed storage according to mapping between the actual collection object of the handshake channel and the storage index. And independent communication is established through the clone address and the mirror image virtual network card, so that mirror image telecontrol one-way synchronous access is provided for the power monitoring system under the condition that the IP channel of the original telecontrol equipment is occupied. And characterization control is carried out on storage and communication of real-time electric power data through data features, so that data confusion is avoided.

Description

Technical Field

[0001] The present invention relates to the technical field of power data distribution, and in particular to a distributed collection method and system for power data. Background Art

[0002] In the current real-time channel access work, it is necessary to access the dual-channel system power station, single-channel user station and single-channel distributed photovoltaic station respectively. The current channel access work takes a long time, and the access plan of the user station and the distributed photovoltaic station can only be abandoned, waiting for the user owner to agree to cooperate with the transformation. Secondly, most equipment manufacturers are difficult to support operation and maintenance, and it is impossible to contact technical personnel, making real-time channel access difficult. When the IP channel is occupied, it is difficult to collect real-time power data in a timely manner.

[0003] For example, a “management method and system for accessing distributed energy to a distribution network” disclosed in a Chinese patent document, with publication number: CN118137589A, discloses that based on historical operation data and meteorological environment data in a set time management unit, the operation status data of each distributed energy storage device in the set time management unit is obtained; the operation status data of the energy storage device is input into a pre-built balanced output prediction model of the energy storage device to obtain the balanced output index of each distributed energy storage device in the set time management unit; the power prediction model of the power generation device pre-built is used to predict the online power of the power generation device in the set time management unit; and the online power of the power generation device in the set time management unit and the preset online stable power are subjected to fluctuation analysis. However, this solution still does not solve the problem that the remote control device cannot be accessed when the IP channel is occupied. Summary of the invention

[0004] In order to solve the problem of time-consuming real-time channel access in the prior art, the present invention provides a distributed collection method and system for power data, which provides a one-way synchronous access of mirrored telecontrol for the power monitoring system when the IP channel of the telecontrol equipment is occupied.

[0005] In order to achieve the above object, the present invention provides the following technical solutions: A distributed collection method for power data includes: acquiring real-time power data in a database, and establishing distributed storage based on storage indexes; Obtain the corresponding clone address according to the storage index, generate the corresponding mirror virtual network card based on the clone address, and allocate a handshake channel for the mirror virtual network card; Obtain data streams of several handshake channels, identify data features of the data streams, classify each handshake channel according to the data features, and determine the actual collection object of the handshake channel; Distributed storage is performed based on the actual collection object and storage index mapping of the handshake channel. Independent communication is established by cloning addresses and mirrored virtual network cards, so that when the original remote control device IP channel is occupied, one-way synchronous access of mirrored remote control is provided to the power monitoring system. In addition, the storage and communication of real-time power data are characterized by data features to avoid data confusion, so that multiple real-time power data can be cloned and collected simultaneously in the same communication system without interfering with each other, meeting network security isolation requirements. Data collection can be adaptively performed for both multi-channel and single-channel users, avoiding interference caused by different channels in data collection.

[0006] Preferably, when establishing the distributed storage based on the storage index, the real-time power data is traced, and storage indexes are allocated to different real-time power data according to the traceability characteristics. The storage index is determined by the traceability characteristics of the real-time power data, so that different real-time power data are set with their own storage locations and storage tags. This allows real-time power data from different sources to be stored separately, meeting the requirements of data isolation.

[0007] Preferably, the storage index is arranged in a grid, and after the storage index is allocated, the real-time power data is stored in the corresponding grid through the corresponding channel according to the storage index. By arranging the storage index as a grid, distributed storage of data from different sources is achieved. In the grid, grid units at different positions are combined and generated.

[0008] Preferably, when obtaining the corresponding clone address, the address feature in the storage index and the data feature of the real-time power data are obtained, and the address to be cloned is selected by the address feature and the data feature respectively. The specific clone address is determined by combining the address feature and the data feature, so that each real-time power data from different sources can obtain a specific clone address, so that the real-time power data from different sources will not have the same clone address, thereby realizing the collection of data from multiple other data stations through multiple clone addresses.

[0009] Preferably, when allocating the handshake channel, the data volume is determined according to the data characteristics of the real-time power data, and the data is filtered according to the data volume; Several handshake channels are preset for different clone addresses, and the same handshake channel corresponds to several clone addresses. The handshake channels are screened by the data volume, which improves the efficiency of data collection and realizes the selection of the most suitable handshake channel for data collection for different clone addresses.

[0010] Preferably, when identifying the data features of the data stream, the real-time power data is updated according to the data stream, the data features of the updated real-time power data are identified, and the new data features are temporarily stored in the intermediate node. The real-time power data is updated through the data stream, and the data features of the data stream are identified through the intermediate node, thereby reducing the data processing amount of the data master station.

[0011] Preferably, when determining the actual acquisition object of the handshake channel, the temporarily stored data features are identified with the corresponding storage indexes for similarity, and when the similarity between the features in the storage index and the data features reaches a threshold, the data acquisition is determined to be accurate. The similarity is used to determine whether the current actual acquisition object is accurate, and at the same time, to determine whether the acquired data and acquisition method are reliable.

[0012] Preferably, when mapping the actual acquisition object with the storage index, the data features of the actual acquisition object are determined, and the data features are traversed in the storage index. When more than a threshold value n of several data features correspond to the same storage index, a mapping between the storage index and the actual acquisition object is established. By screening and corresponding the data features with several existing storage indexes, accurate distributed storage of data streams is achieved.

[0013] A distributed management system for power data, applicable to a distributed collection method for power data as described in any one of the embodiments, comprises: a data master station for storing data; The data master station is connected to a mirror server and collects data through a mirror virtual network card; The mirror server is connected to the data forwarding area and connected to other data stations through the handshake channel; The data forwarding area is connected to other data stations to collect real-time power data. This shortens the data acquisition time and channel establishment time, realizes automatic data collection, and avoids the problem that most equipment manufacturers are unable to support operation and maintenance, cannot contact technical personnel, make real-time channel access difficult, and when the IP channel is occupied, it is difficult to collect real-time power data in a timely manner.

[0014] Preferably, the mirror server is provided with several mirror virtual network cards, each of which corresponds to a clone address; each of which corresponds to a plurality of handshake channels. Through different clone addresses and a plurality of handshake channels, data collection in isolation state can be realized synchronously or asynchronously from a plurality of other data stations.

[0015] The present invention has the following advantages: By cloning addresses and mirroring virtual network cards to establish independent communications, the power monitoring system can be provided with one-way synchronous access to mirrored telecontrol when the original telecontrol device IP channel is occupied. In addition, data features are used to perform characteristic control on the storage and communication of real-time power data to avoid data confusion, so that multiple real-time power data can be cloned and collected simultaneously in the same communication system without interfering with each other, meeting network security isolation requirements. Data collection can be adaptively performed for both multi-channel and single-channel users, avoiding interference caused by different channels in data collection. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The drawings described below are merely exemplary. A person skilled in the art can derive other implementation drawings based on the provided drawings without inventive effort.

[0017] Figure 1 Schematic diagram of the method steps in the embodiment.

[0018] Figure 2 Schematic diagram of system connection in the embodiment.

[0019] In the figure: 1-Data master station; 2-Mirror server; 3-Other data stations; 4-Data forwarding area. DETAILED DESCRIPTION

[0020] Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in the field without making any creative work shall fall within the scope of protection of the present invention.

[0021] like Figure 1-Figure 2 As shown, in a preferred embodiment, the present solution discloses a distributed collection method for power data, including the following steps: first, all real-time power data are obtained from the database, the real-time power data are divided to obtain multiple groups of real-time power data groups, a storage index is established based on the real-time power data group, and several real-time power data groups are distributedly stored according to the storage index. The distributed storage includes storing different real-time power data groups in corresponding storage locations according to the storage index. Thereby, the distributed storage of real-time data is realized. At this time, several real-time concentrated data are divided in a specific way and stored together, and real-time power data with the same specific characteristics are stored together, which avoids data confusion and facilitates separate calls during the data call process.

[0022] In other embodiments, the present solution discloses a distributed collection method for power data, including the following steps: obtaining real-time power data in a database, ensuring the timeliness and freshness of the data, and realizing instant analysis to respond to dynamic changes in the power grid by directly accessing the real-time power data in the database. Establishing distributed storage based on storage indexes; allowing data to be dispersed and stored on different nodes according to the index, effectively improving the parallelism of data access and the scalability of the system. As the amount of data increases, the system capacity can be expanded simply by adding storage nodes.

[0023] Obtain the corresponding clone address based on the storage index. Through virtualization technology, you can quickly adjust resource allocation according to demand and provide an independent processing environment for different data collection tasks. Generate the corresponding mirror virtual network card based on the clone address and allocate a handshake channel for the mirror virtual network card. Reduce resource conflicts and improve overall efficiency.

[0024] Acquire the data streams of several handshake channels, and at this time acquire the data stream of the actual handshake channel, and the data stream contains real-time power data. Identify the data features of the data stream, and accurately determine the actual acquisition object of each handshake channel. Classify each handshake channel according to the data features, so that the handshake channels can be classified according to the information features transmitted therein, and then accurately determine the actual acquisition object of the handshake channel; it helps to reduce the collection and storage of invalid data, and improve data quality and storage efficiency.

[0025] According to the actual collection object and storage index mapping of the handshake channel, data access is made more accurate and efficient. Distributed storage is performed. Independent communication is established by cloning addresses and mirrored virtual network cards, so that when the IP channel of the original remote control equipment is occupied, the power monitoring system is provided with one-way synchronous access to the mirrored remote control. And through data characteristics, the storage and communication of real-time power data are characterized and controlled to avoid data confusion, so that multiple real-time power data can be cloned and collected simultaneously in the same communication system without interfering with each other, meeting the network security isolation requirements. For multi-channel and single-channel users, data collection can be adaptively performed to avoid interference caused by different channels in data collection. Through the design of the handshake channel, it can adapt to complex network environments. The handshake channel not only provides a channel for data transmission, but also ensures the security and reliability of data transmission, especially in environments where network conditions are unstable or there are potential security threats.

[0026] In other embodiments, the establishment of distributed storage based on storage indexes includes the following steps: first, tracing the real-time power data to determine the source information of the existing real-time power data. By allocating storage indexes to different real-time power data based on the traceability characteristics, accurate classification and management of data can be achieved, which is convenient for subsequent data retrieval and analysis. By allocating storage indexes to different real-time power data based on the traceability characteristics, reasonable storage index allocation can optimize the storage structure, improve the efficiency and accuracy of data retrieval, and further enhance the effectiveness of the traceability system. The storage index is determined by the traceability characteristics of the real-time power data, so as to set respective storage locations and storage tags for different real-time power data. Real-time power data from different sources can be stored separately to meet the requirements of data isolation.

[0027] In other embodiments, the present solution includes arranging the storage index according to a grid, and the gridded index layout helps to achieve load balancing. Different grids can be assigned to different storage nodes or servers to avoid overloading of a single node or server and improve the overall performance and stability of the system; as the amount of power data grows, the storage capacity and processing power can be expanded by increasing the number of grids or adjusting the size of the grid. This expansion method is simple and flexible, and can easily cope with changes in data volume. It includes the following steps. First, after the storage index is allocated, the real-time power data is stored in the corresponding grid through the corresponding channel according to the storage index. By arranging the storage index as a grid, distributed storage of data from different sources is achieved. In the grid, grid units at different positions are combined and generated.

[0028] In other embodiments, further, real-time power data can be quickly located in the corresponding grid according to the storage index and stored through the corresponding channel. This fast storage mechanism helps to ensure the real-time and accuracy of the data. When it is necessary to access or analyze real-time power data, the location of the data can be quickly located through the grid index, thereby achieving low-latency data access. The size and number of grids are divided according to factors including the access frequency, importance or geographical location of the data. Different grids are configured with different storage strategies, such as compression algorithms, encryption levels or data retention periods, to meet different business needs and data management requirements.

[0029] In other embodiments, the method of obtaining the corresponding cloned address described in this solution includes the following steps: first, obtaining the address features and data features of the real-time power data in the storage index to achieve multi-dimensional screening. The solution realizes double verification of the candidate address by considering the address features and data features of the real-time power data at the same time. This multi-dimensional screening mechanism can more accurately identify addresses that are highly matched with the target requirements, reducing the possibility of misselection or omission. Among them, the address features and real-time data features contain different information dimensions. The address features focus on static information including geographical location and equipment layout, while the real-time data features reflect dynamic information including the current operating status and load conditions. The combination of the two makes the screening process more comprehensive and detailed. The address to be cloned is selected by the address features and data features respectively. By combining the address features and data features to determine a specific cloned address, the real-time power data from each different source can obtain a specific cloned address, so that the real-time power data from different sources will not have the same cloned address, thereby realizing the collection of data from multiple other data stations through multiple cloned addresses.

[0030] The data characteristics of real-time power data will change over time, so the solution can dynamically adjust the screening conditions based on the latest data to ensure that the selected address always meets the current needs and conditions. Different application scenarios may have different requirements for addresses. By flexibly adjusting the weights and screening conditions of address characteristics and real-time data characteristics, the solution can adapt to a variety of different power data management and analysis needs. Furthermore, by filtering using address characteristics and real-time data characteristics respectively, the range of candidate addresses can be quickly narrowed, thereby speeding up address selection. This is especially important for power system management tasks that require a quick response. The automated screening process reduces the need for manual judgment, reduces the risk of human error, and improves the efficiency of decision-making.

[0031] In other embodiments, when allocating handshake channels in this solution, dynamic allocation is performed based on real-time power data, including determining the data volume based on the data characteristics of the real-time power data, so that the system can quickly respond to changes in the data volume and filter according to the data volume; the filtering mechanism based on the data volume helps to quickly identify the power data that needs to be processed first, thereby ensuring the timely transmission and processing of key data.

[0032] Several handshake channels are preset for different clone addresses. Through the preset handshake channels and flexible mapping relationships, limited resources can be used more effectively. The same handshake channel corresponds to several clone addresses. The handshake channels are screened by the data volume, which improves the efficiency of data collection and enables the selection of the most suitable handshake channel for data collection for different clone addresses. It can allow the number and mapping relationship of handshake channels to be flexibly configured according to different power data characteristics and clone address requirements. As the number of clone addresses increases or the power data characteristics change, the number of handshake channels can be easily increased or the mapping relationship of the channels can be adjusted to meet future expansion needs.

[0033] When in use, the preset handshake channels and mapping relationships are used to realize the centralized management of multiple cloned addresses and channels. When the system fails or needs to be adjusted, it is convenient to quickly locate the problem and repair or adjust it. The handshake channel and data screening mechanism can be developed, tested and maintained relatively independently. This modular design not only reduces the complexity of the system, but also improves the maintainability and scalability of the system. Determining the data volume and allocating the handshake channel by the data characteristics of real-time power data is actually conducting real-time data analysis to achieve further data mining. By mapping multiple cloned addresses to the same handshake channel and filtering and isolating data when necessary, the impact of a single address or channel failure on the entire system can be reduced. This ability to isolate risks improves the security and reliability of the system. It is convenient to achieve fault tolerance through backup channels and redundant data to ensure that the system can still operate normally when some system components fail.

[0034] In other embodiments, the identification of data features of data streams described in this solution includes the following steps: first, updating real-time power data according to the data stream ensures the timeliness of the data and accurately reflects the current operating status of the system. Identify the data features of the updated real-time power data. After the data is updated, immediately identify the new data features. This immediacy helps to accurately capture the dynamic changes of the power system and provide a reliable basis for subsequent decision-making and analysis. The new data features are temporarily stored in the intermediate node. Even if the main system fails, the intermediate node can still save the latest data features, providing an important basis for system recovery and troubleshooting. The real-time power data is updated through the data stream, and the data features of the data stream are identified through the intermediate node, reducing the data processing volume of the data master station. Based on the real-time updated data features and the data temporarily stored in the intermediate node, the demand and allocation of power resources can be more accurately evaluated, thereby optimizing the resource allocation strategy and improving resource utilization efficiency. In other embodiments, the actual acquisition object of the handshake channel as described in this solution is determined, including the following steps: first, the temporarily stored data features are identified with the corresponding storage indexes for similarity, and the temporarily stored data features can be accurately matched with the features in the storage index. Once the data features whose similarity reaches the threshold are identified, the system can respond quickly, judge that the data acquisition is accurate, and perform subsequent data processing or decision analysis accordingly. When the similarity between the features in the storage index and the data features reaches the threshold, it means that the data acquisition at this moment and the previous moment is accurate, and the data acquisition is accurate. The similarity is used to judge whether the current actual acquisition object is accurate, and at the same time, whether the acquired data and acquisition method are reliable. The similarity threshold can be flexibly configured according to actual needs to adapt to the data acquisition requirements in different scenarios. This flexibility enables the system to better adapt to the complex and changeable power system environment. Through similarity recognition, data that does not match the storage index features can be identified and eliminated, thereby achieving the purpose of data cleaning. This helps to improve data quality and reduce the interference of invalid data and noise data.

[0035] When in use, based on the accuracy of the data, the decision-making process is further optimized to adjust the allocation of power resources and optimize the grid operation strategy.

[0036] In other embodiments, when mapping the actual acquisition object with the storage index described in this solution, multiple verifications are used to reduce the erroneous mapping caused by the mismatch of a single data feature, thereby ensuring the accuracy of the mapping result, including the following steps: first, the data features of the actual acquisition object are determined, and the data features are traversed in the storage index. When traversing the data features, even if some features have errors or inconsistencies, as long as more than the threshold n features are successfully matched, the system can still establish the correct mapping relationship. The fault tolerance is enhanced, making it more stable and reliable when facing complex and changeable power data. When more than the threshold n of several data features correspond to the same storage index, it means that the above-mentioned several data features correspond to the storage index at this time, and a mapping between the storage index and the actual acquisition object is established. By screening and corresponding the data features with several existing storage indexes, accurate distributed storage of data streams is achieved.

[0037] like Figure 2 As shown, in other embodiments, the present solution discloses a distributed management system for power data, which is applicable to a distributed collection method for power data as described in any embodiment, including: a data master station 1 for data storage; using the data master station as the core of the entire system, all collected data are centrally stored.

[0038] The data master station 1 is connected to the mirror server 2. When the main data collection link has problems, the mirror server can be used as a backup to ensure the continuity and integrity of data collection. Data collection is performed through the mirror virtual network card; using the mirror virtual network card for data collection can reduce the impact on the original network performance and achieve efficient data capture. This non-intrusive collection method avoids adding additional delays or interference during the power data transmission process.

[0039] Real-time power data collection: The mirror server 2 is connected to the data forwarding area 4. The connection between the data forwarding area and other data stations is realized through the handshake channel. This design ensures the real-time collection of power data. With the expansion of the power network scale or the addition of new data stations, only corresponding configuration and adjustment are required in the data forwarding area to achieve seamless integration. The data forwarding area is connected to other data stations through the handshake channel; it not only ensures the reliability of data transmission, but also improves the security of data transmission to a certain extent. The handshake channel can implement security measures such as data encryption and identity authentication to prevent data leakage or tampering.

[0040] The data forwarding area 4 is connected to other data stations 3 to collect real-time power data. The data acquisition time and channel establishment time are shortened to realize automatic data collection, avoiding the problem that most equipment manufacturers are difficult to support operation and maintenance and cannot contact technical personnel, making real-time channel access difficult. When the IP channel is occupied, the real-time power data is difficult to collect in time. When in use, although the core data storage is concentrated in the data master station, the data collection and forwarding adopts a distributed architecture. This architecture can disperse system risks, reduce the impact of single point failures on the entire system, and improve the stability and reliability of the system.

[0041] In other embodiments, data collection in an isolated state is achieved by multiple other data stations synchronously or asynchronously through different clone addresses and multiple handshake channels.

[0042] When this solution is used, when the data master receives data from an external data source, the data will be copied to the mirror server. The mirror server receives the data through the mirror virtual network card on it and distributes it to different handshake channels as needed. The mirror virtual network card transmits the data to other data stations or system components through the corresponding handshake channel. During the transmission process, security measures such as data encryption, decryption, and verification are involved to ensure the security and integrity of the data.

[0043] After receiving the data, the data station or system component at the receiving end will perform corresponding processing, including parsing, analysis, and storage. The processed data is used for real-time monitoring, statistical analysis, and decision support.

[0044] When a data master station or a mirror virtual network card fails, it automatically switches to other mirror servers or virtual network cards for data transmission, thus ensuring the continuity and stability of the system.

[0045] In other embodiments, data collection is first performed, and the data collection includes collecting data from the same database or from different databases. Through the data collection, a number of real-time power data of different types and formats are obtained. After the data collection, the collected data is preprocessed, and the real-time power data of different formats and types are converted. The conversion process is performed in the cloud, and the conversion process includes data cleaning, data encryption, and data desensitization.

[0046] When cleaning the data, repeated sentence recognition, isolated data recognition, and mutation data recognition are performed on the real-time power data collected in real time, and the above data are recognized as abnormal data, and the abnormal data is smoothed.

[0047] The converted data is packaged into a processing data packet for uploading.

[0048] These modifications or improvements made on the basis of the present invention without departing from the spirit of the present invention all fall within the scope of protection required by the present invention.

Claims

1. A distributed collection method for power data, characterized in that: include: Obtain real-time power data from the database and establish distributed storage based on storage index; Obtain the corresponding clone address according to the storage index, generate the corresponding mirror virtual network card based on the clone address, and allocate a handshake channel for the mirror virtual network card; Obtain data streams of several handshake channels, identify data features of the data streams, classify each handshake channel according to the data features, and determine the actual collection object of the handshake channel; Distributed storage is performed based on the actual collection object and storage index mapping of the handshake channel.

2. A distributed power data collection method according to claim 1, characterized in that: When establishing the distributed storage based on the storage index, the real-time power data is traced, and storage indexes are allocated to different real-time power data according to the traceability characteristics.

3. A distributed power data collection method according to claim 2, characterized in that: It includes arranging the storage indexes according to the grids, and after the storage indexes are allocated, the real-time power data is stored in the corresponding grids through the corresponding channels according to the storage indexes.

4. A distributed method for collecting power data according to claim 1, 2 or 3, characterized in that: When obtaining the corresponding clone address, the address characteristics in the storage index and the data characteristics of the real-time power data are obtained, and the address to be cloned is selected according to the address characteristics and the data characteristics respectively.

5. A distributed power data collection method according to claim 4, characterized in that: When allocating the handshake channel, the data volume is determined according to the data characteristics of the real-time power data, and the data is filtered according to the data volume; Several handshake channels are preset for different clone addresses, and the same handshake channel corresponds to several clone addresses.

6. A distributed power data collection method according to claim 1, 2 or 3, characterized in that: When identifying the data features of the data stream, the real-time power data is updated according to the data stream, the data features of the updated real-time power data are identified, and the new data features are temporarily stored in the intermediate node.

7. A distributed power data collection method according to claim 6, characterized in that: When determining the actual collection object of the handshake channel, the temporarily stored data features are identified with the corresponding storage indexes for similarity. When the similarity between the features in the storage index and the data features reaches a threshold, it is determined that the data collection is accurate.

8. The distributed power data collection method according to claim 1, characterized in that: When mapping the actual acquisition object with the storage index, the data features of the actual acquisition object are determined, and the data features are traversed in the storage index. When more than a threshold value n of several data features correspond to the same storage index, a mapping between the storage index and the actual acquisition object is established.

9. A distributed management system for power data, applicable to a distributed collection method for power data as claimed in any one of claims 1 to 8, characterized in that: include: Data master station, for data storage; The data master station is connected to a mirror server and collects data through a mirror virtual network card; The mirror server is connected to the data forwarding area and connected to other data stations through the handshake channel; The data forwarding area is connected to other data stations to collect real-time power data.

10. A distributed management system for power data according to claim 9, characterized in that: The mirror server is provided with a plurality of mirror virtual network cards, each of which corresponds to a clone address; and each of which corresponds to a plurality of handshake channels.

Images