Electric power data acquisition system

Abstract

The invention discloses an electric power data acquisition system, and the system comprises a data acquisition module which is used for dynamically analyzing heterogeneous data of a multi-protocol measurement terminal, converting the heterogeneous data into a standard format, and automatically discovering and connecting distributed deployment measurement terminals; the data transmission module is used for carrying out encryption and compression transmission on the data and verifying the transmission integrity, and an encryption strategy and a compression algorithm are dynamically adjusted according to a network state; the data processing module is used for performing exception filtering and cleaning on the acquired data, generating an energy efficiency index and fault early warning based on a preset algorithm, and storing the structured data in different libraries; the system management module is used for configuring acquisition parameters, monitoring the running state, recording logs and dynamically adjusting the working mode of the system according to the real-time data flow; the power data acquisition system realizes cooperation among modules based on a distributed operating system architecture, and supports unified access of multi-protocol terminals through a protocol dynamic adaptation mechanism. According to the invention, multi-protocol dynamic adaptation and high-robustness transmission characteristics are realized.

Description

Technical Field

[0001] The present invention relates to the technical field of power systems, and in particular to a power data acquisition system. Background Art

[0002] As the perception center of the smart grid, the modern power data acquisition system undertakes the key functions of real-time collection, transmission and processing of terminal data such as smart meters and sensors, providing core data support for system monitoring, energy efficiency management and fault diagnosis.

[0003] However, existing systems have significant flaws in architecture design and protocol adaptation:

[0004] First, because measurement terminal manufacturers use differentiated communication protocol standards (such as Modbus and DL / T645), traditional systems lack a unified multi-protocol parsing engine. This results in the need to customize dedicated communication middleware when connecting heterogeneous devices, significantly increasing system deployment complexity and operation and maintenance costs.

[0005] Second, the existing data transmission mechanism is limited by a fixed protocol stack architecture, which can easily cause data delays and packet loss during network bandwidth fluctuations or protocol conversion, making it difficult to meet the strict requirements of smart grids for real-time data synchronization accuracy and transmission reliability. Summary of the Invention

[0006] The technical problem to be solved by the present invention is to provide an electric power data acquisition system to achieve dynamic adaptation of multiple protocols and highly robust transmission characteristics.

[0007] To solve the above technical problems, the present invention provides a power data acquisition system, comprising:

[0008] The data acquisition module is used to dynamically parse heterogeneous data from multi-protocol measurement terminals and convert it into a standard format, automatically discover and connect to distributed measurement terminals, and cache the collected data;

[0009] The data transmission module is used to encrypt and compress data for transmission, where the encryption strategy and compression algorithm are dynamically adjusted according to the network status;

[0010] The data processing module is used to perform anomaly filtering and cleaning on the collected data, generate energy efficiency indicators and fault warnings based on preset algorithms, and store structured data in separate databases;

[0011] System management module, used to configure acquisition parameters, monitor operating status and record logs, and dynamically adjust system operating mode according to real-time data flow;

[0012] The power data acquisition system realizes inter-module collaboration based on a distributed operating system architecture and supports unified access of multi-protocol terminals through a dynamic protocol adaptation mechanism.

[0013] Preferably, the data acquisition module specifically includes:

[0014] Protocol adapter unit, used to parse the communication protocols of various measurement terminals and convert them into a unified data format;

[0015] Device discovery unit, used to automatically discover and connect to measurement terminals based on the distributed capabilities of the Hongmeng operating system;

[0016] The data cache unit is used to start local storage when the network is interrupted and temporarily store the collected data.

[0017] Preferably, the data acquisition module is connected to the multi-protocol measurement terminal through a universal data acquisition interface, and the universal data acquisition interface is used for mixed access of smart meters, current sensors, voltage sensors and data collectors.

[0018] Preferably, the protocol adaptation unit realizes multi-protocol compatibility by dynamically loading protocol plug-ins.

[0019] Preferably, the data transmission module specifically includes:

[0020] A data encryption unit, used to encrypt data using the security mechanism of the Hongmeng operating system;

[0021] A data compression unit, used to compress the transmission data using a lossless compression algorithm;

[0022] The data verification unit is used to verify the transmitted data through double-end verification at the sending end and the receiving end.

[0023] Preferably, the data processing module specifically includes:

[0024] A data cleaning unit is used to pre-process the collected data based on a preset threshold and filter out abnormal data;

[0025] A data analysis unit, configured to generate a power consumption analysis report using a peak and valley period detection algorithm;

[0026] The data storage unit is used to store the processed data in a distributed database.

[0027] Preferably, the system management module specifically includes:

[0028] Configuration management unit, used to configure and adjust system parameters;

[0029] Monitoring and alarm unit, used to monitor the system operation status in real time and issue alarms in abnormal situations;

[0030] The log management unit is used to record the device connection status and data processing results.

[0031] Preferably, the distributed operating system architecture adopts the distributed communication mechanism of the Hongmeng system to realize data sharing between cross-regional devices and automatic takeover of faulty devices.

[0032] The implementation of the present invention has the following beneficial effects: at the device access level, the system's innovatively designed universal data acquisition interface and protocol adapter unit can dynamically parse heterogeneous protocols such as Modbus and DL / T 645, and achieve unified access to cross-brand devices without customized development, greatly improving the efficiency of system deployment. At the data processing level, relying on the distributed computing architecture of the Hongmeng operating system, the sensor noise data is filtered in real time through the data cleaning unit, and the massive power data is combined with the data analysis unit to perform millisecond-level calculations, which significantly improves energy utilization. The system as a whole adopts encrypted transmission and redundant verification mechanisms to ensure the reliability of data transmission in complex network environments. At the same time, cross-regional equipment collaboration and fault self-healing are achieved through a distributed architecture, effectively reducing operation and maintenance costs in industrial park monitoring scenarios. The present invention solves the core pain points that have long existed in the field of power data acquisition, such as protocol fragmentation, lack of real-time performance, and poor transmission reliability, and provides highly compatible and robust data infrastructure support for scenarios such as smart grids and industrial Internet of Things. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0034] Figure 1 The figure is a schematic structural diagram of a power data acquisition system according to an embodiment of the present invention.

[0035] Figure 2 Schematic diagram of the structure of the data acquisition module in an embodiment of the present invention.

[0036] Figure 3 Schematic diagram of the structure of the data transmission module in an embodiment of the present invention.

[0037] Figure 4 Schematic diagram of the structure of the data processing module in an embodiment of the present invention.

[0038] Figure 5 Schematic diagram of the structure of the system management module in an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following descriptions of the embodiments refer to the accompanying drawings to illustrate specific embodiments in which the present invention may be implemented.

[0040] Please refer to Figure 1 As shown, an embodiment of the present invention provides a power data acquisition system, including:

[0041] The data acquisition module is used to dynamically parse heterogeneous data from multi-protocol measurement terminals and convert it into a standard format, automatically discover and connect to distributed measurement terminals, and cache the collected data;

[0042] The data transmission module is used to encrypt and compress data for transmission, where the encryption strategy and compression algorithm are dynamically adjusted according to the network status;

[0043] The data processing module is used to perform anomaly filtering and cleaning on the collected data, generate energy efficiency indicators and fault warnings based on preset algorithms, and store structured data in separate databases;

[0044] System management module, used to configure acquisition parameters, monitor operating status and record logs, and dynamically adjust system operating mode according to real-time data flow;

[0045] The power data acquisition system realizes inter-module collaboration based on a distributed operating system architecture and supports unified access of multi-protocol terminals through a dynamic protocol adaptation mechanism.

[0046] Specifically, in a smart grid application scenario, the data acquisition module of the power data acquisition system of an embodiment of the present invention is deployed on the edge side and directly connected to measurement terminals, such as smart meters, various sensors, and data collectors distributed in different areas. The data acquisition module uses a universal data acquisition interface to uniformly access data generated by these different measurement terminals with different protocols and data formats. The data transmission module will use the distributed data management technology of the Hongmeng operating system to efficiently and securely transmit the collected data from the data acquisition end to the data processing end. For example, a distributed storage and transmission mechanism will be adopted during the transmission process to avoid single points of failure and improve transmission efficiency.

[0047] The data processing module is located on the cloud server and processes and analyzes the collected data in real time based on the distributed computing capabilities of the Hongmeng operating system. For example, it collects and analyzes the electricity data collected by smart meters in real time to determine the peak and off-peak periods of electricity usage. The system management module serves as the control center and is responsible for configuring, monitoring, and maintaining the entire system. System administrators can use the system management module to set various system parameters, monitor the system's operating status in real time, and promptly address any abnormalities to ensure stable system operation.

[0048] like Figure 2As shown, the data acquisition module consists of a protocol adapter unit, a device discovery unit, and a data cache unit. The protocol adapter unit has a built-in Modbus and DL / T 645 protocol parsing engine. When connected to smart meters from different manufacturers in the industrial park, it automatically identifies the device protocol type and converts it into a unified JSON data format. For example, for meters using the Modbus protocol, the protocol adapter unit reads data according to the Modbus protocol rules and converts it into the system's internal standard data format. The device discovery unit automatically identifies and authenticates newly deployed sensors based on the HarmonyOS distributed discovery protocol, completing device registration and establishing a communication link within one second. For example, when a new sensor is deployed in the industrial park, the device discovery unit automatically detects it and establishes a connection with it through the HarmonyOS distributed communication mechanism, eliminating the need for complex manual configuration. The data cache unit uses a dual buffer design to temporarily store collected data. Since data transmission may be affected by factors such as network conditions, to ensure data integrity and continuity, local storage mode is activated when the network is interrupted to temporarily store collected data and automatically resume transmission of the cached data when the network is restored. The module is connected to terminal devices such as smart meters and current sensors through a universal data interface to form a unified access layer for multi-protocol terminals.

[0049] like Figure 3 As shown, the data transmission module includes a data encryption unit, a data compression unit, and a data verification unit. The data encryption unit encrypts collected data using the security mechanisms of the HarmonyOS operating system. For example, it uses a symmetric encryption algorithm to encrypt power consumption data and temperature sensor data to prevent data theft or tampering during transmission. In building energy management scenarios, encryption keys are dynamically distributed through the HarmonyOS secure channel. The data compression unit compresses transmitted data to reduce network bandwidth usage. For large amounts of power data, the data compression unit uses a lossless compression algorithm to significantly reduce the data size without compromising data accuracy. For example, data that originally required 1MB of storage space can be compressed to 200KB, reducing network bandwidth requirements. The data verification unit verifies the transmitted data to ensure its accuracy and integrity. During data transmission, data errors may occur due to factors such as electromagnetic interference. The data verification unit performs verification calculations at both the sending and receiving ends, comparing the verification results to determine whether data errors occurred during transmission. If errors are detected, the data collection end is requested to resend the data. The data encryption unit, data compression unit and data verification unit are connected in series in the order of encryption → compression → verification to form an end-to-end data security transmission channel.

[0050] like Figure 4As shown, the data processing module includes a data cleaning unit, a data analysis unit, and a data storage unit. Because the measurement terminal may be subject to interference from the external environment, the collected data may contain some invalid data and noise. The data cleaning unit filters and processes the collected raw data to remove outliers and erroneous data. For example, in a commercial complex scenario, threshold filtering is applied to the data collected by the temperature sensor. If any values significantly exceed the normal range, the data cleaning unit will determine the data as invalid and remove it. The data analysis unit runs a preset peak and valley detection algorithm to analyze the processed data. For example, it generates hourly electricity consumption curves based on meter data to identify peak and valley periods of electricity consumption, providing decision-making basis for power management in the commercial complex. Furthermore, it can analyze electricity data from different regions to determine whether there is any electricity waste. The data storage unit uses a distributed time series database to store processed data in shards along the region-time dimension for subsequent query and access. For example, electricity data for different time periods can be stored on different nodes, allowing for rapid access to historical data from the database when needed. The data processing module uses the HarmonyOS distributed task scheduler to achieve parallel processing of cleaning, analysis, and storage processes.

[0051] like Figure 5 As shown, the system management module includes a configuration management unit, a monitoring and alarm unit, and a log management unit. The configuration management unit is used to configure and adjust system parameters. It provides a visual interface for setting the acquisition frequency (adjustable from 1s to 60s) and setting the highest transmission priority for key electricity meter devices. The monitoring and alarm unit monitors the performance indicators of each module in real time. By monitoring the performance indicators of each system module, such as the success rate of data acquisition and data transmission latency, it immediately issues an alarm if an anomaly is detected. For example, when the data transmission latency exceeds the preset threshold, the monitoring and alarm unit will notify the system administrator via SMS or email. The log management unit records operation logs such as device connection status and data processing results. The log content includes system startup and shutdown times, detailed information on data acquisition and processing, and supports searching historical operation records by timestamp. For example, if a system failure occurs, the system administrator can view the log information to identify the time and cause of the failure and quickly repair it. The system management module issues configuration instructions to other modules and collects status information through the HarmonyOS cross-device management interface.

[0052] In this embodiment of the present invention, the inter-module control relationship is as follows: the system management module issues protocol configuration parameters to the data acquisition module, controlling the scanning frequency of the device discovery unit; the data transmission module receives network quality indicators fed back by the processing module and dynamically adjusts the compression algorithm and encryption strength; and the data processing module transmits analysis results back to the acquisition module for optimizing the data acquisition strategy. A closed-loop control link is formed between these modules, enabling the coordinated forward data flow (acquisition → transmission → processing → management) and the reverse control flow.

[0053] The following further describes how the power data acquisition system according to an embodiment of the present invention supports seamless connection with various measurement terminals.

[0054] In a smart industrial park, the power data acquisition system connects various measurement terminals, including smart meters, current sensors, voltage sensors, and data collectors. Smart meters collect electricity consumption data from various businesses, while current and voltage sensors monitor the current and voltage of power lines in real time. Data collectors aggregate data from other measurement terminals.

[0055] The power data acquisition system seamlessly connects to these various measurement terminals through a universal data acquisition interface. Regardless of the communication protocol and data format used by the measurement terminal, all terminals can be uniformly accessed through the system's data acquisition module. For example, if a newly installed current sensor uses a unique communication protocol, the system's data acquisition module can parse the protocol through a protocol adapter unit, enabling connection and data acquisition.

[0056] As mentioned above, the power data acquisition system of the embodiment of the present invention is based on the distributed architecture of the Hongmeng operating system. In a cross-regional power data acquisition project, the system adopts the distributed architecture of the Hongmeng operating system. Each device in the power data acquisition system, including measurement terminals, data acquisition modules, data processing modules, etc., can be automatically discovered, data shared and collaborated through the distributed communication mechanism of the Hongmeng system. For example, the power data collected by smart meters in different areas can be shared to the data processing center in real time through a distributed architecture. The data processing center can conduct unified analysis and processing based on the power data of each area and formulate a reasonable power allocation plan. At the same time, when the data acquisition equipment in a certain area fails, the equipment in other areas can automatically take over part of the data collection work through the distributed architecture to ensure the normal operation of the system.

[0057] In different application scenarios, the specific implementation of the power data acquisition system of the embodiment of the present invention is as follows:

[0058] (1) Smart grid scenario

[0059] In a smart grid, the system can be connected to a large number of smart meters, sensors, and control devices. The data acquisition module collects real-time power data from each grid node, such as voltage, current, and power. The data transmission module quickly and securely transmits this data to the data processing center. The data processing module analyzes this data to achieve real-time monitoring of the grid and provide fault warnings. For example, if the voltage at a node fluctuates abnormally, the system can promptly issue an alarm, notifying grid maintenance personnel to address the situation.

[0060] (2) Industrial Park Scenario

[0061] In industrial parks, the system can connect to the power equipment and measurement terminals of each enterprise. By collecting and analyzing the company's power data, the system can help companies optimize their power usage and reduce energy consumption. For example, the system can analyze power consumption across different production processes, identify areas of energy waste, and provide recommendations for improvements.

[0062] (3) Building energy management scenarios

[0063] In building energy management, the system can connect to various energy devices within the building, such as air conditioners and lighting systems. By collecting operating data from these devices, the system can achieve intelligent management of building energy. For example, it can automatically adjust the operating status of air conditioners and lighting systems based on the distribution of people within the building and environmental parameters, thereby improving energy efficiency.

[0064] Compared with the prior art, the beneficial effect brought about by the embodiments of the present invention is that, at the device access level, the system's innovatively designed universal data acquisition interface and protocol adapter unit can dynamically parse heterogeneous protocols such as Modbus and DL / T 645, and achieve unified access to cross-brand devices without customized development, greatly improving the efficiency of system deployment. At the data processing level, relying on the distributed computing architecture of the Hongmeng operating system, the sensor noise data is filtered in real time through the data cleaning unit, and the massive power data is combined with the data analysis unit to perform millisecond-level calculations, which significantly improves energy utilization. The system as a whole adopts encrypted transmission and redundant verification mechanisms to ensure the reliability of data transmission in complex network environments. At the same time, cross-regional equipment collaboration and fault self-healing are achieved through a distributed architecture, effectively reducing operation and maintenance costs in industrial park monitoring scenarios. The present invention solves the core pain points of long-standing protocol fragmentation, lack of real-time performance, and poor transmission reliability in the field of power data acquisition, and provides highly compatible and robust data infrastructure support for scenarios such as smart grids and industrial Internet of Things.

[0065] The above disclosure is merely a preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

1. A power data acquisition system, characterized in that: include: The data acquisition module is used to dynamically parse heterogeneous data from multi-protocol measurement terminals and convert it into a standard format, automatically discover and connect to distributed measurement terminals, and cache the collected data; The data transmission module is used to encrypt and compress data for transmission, where the encryption strategy and compression algorithm are dynamically adjusted according to the network status; The data processing module is used to perform anomaly filtering and cleaning on the collected data, generate energy efficiency indicators and fault warnings based on preset algorithms, and store structured data in separate databases; System management module, used to configure acquisition parameters, monitor operating status and record logs, and dynamically adjust system operating mode according to real-time data flow; The power data acquisition system realizes inter-module collaboration based on a distributed operating system architecture and supports unified access of multi-protocol terminals through a dynamic protocol adaptation mechanism.

2. The system according to claim 1, wherein: The data acquisition module specifically includes: Protocol adapter unit, used to parse the communication protocols of various measurement terminals and convert them into a unified data format; Device discovery unit, used to automatically discover and connect to measurement terminals based on the distributed capabilities of the Hongmeng operating system; The data cache unit is used to start local storage when the network is interrupted and temporarily store the collected data.

3. The system according to claim 2, characterized in that The data acquisition module is connected to the multi-protocol measurement terminal through a universal data acquisition interface, and the universal data acquisition interface is used for mixed access of smart meters, current sensors, voltage sensors and data collectors.

4. The system according to claim 3, characterized in that The protocol adaptation unit realizes multi-protocol compatibility by dynamically loading protocol plug-ins.

5. The system according to claim 1, wherein: The data transmission module specifically includes: A data encryption unit, used to encrypt data using the security mechanism of the Hongmeng operating system; A data compression unit, used to compress the transmission data using a lossless compression algorithm; The data verification unit is used to verify the transmitted data through double-end verification at the sending end and the receiving end.

6. The system according to claim 1, wherein: The data processing module specifically includes: A data cleaning unit is used to pre-process the collected data based on a preset threshold and filter out abnormal data; A data analysis unit, configured to generate a power consumption analysis report using a peak and valley period detection algorithm; The data storage unit is used to store the processed data in a distributed database.

7. The system according to claim 1, wherein: The system management module specifically includes: Configuration management unit, used to configure and adjust system parameters; Monitoring and alarm unit, used to monitor the system operation status in real time and issue alarms in abnormal situations; The log management unit is used to record the device connection status and data processing results.

8. The system according to claim 1, wherein: The distributed operating system architecture adopts the distributed communication mechanism of the Hongmeng system to realize data sharing between cross-regional devices and automatic takeover of faulty devices.

Images