Power data transmission method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses a power data transmission method and device, electronic equipment and a storage medium. The method comprises the following steps: classifying multiple pieces of power data according to a first communication protocol and a first data format corresponding to the multiple pieces of power data to obtain multiple types of power data sets; for each type of power data set, determining a target convergence strategy from a plurality of preset power data convergence strategies according to the time granularity and the data size of the power data set, and obtaining strategy parameters of the target convergence strategy; performing aggregation processing on the power data in the power data set based on the strategy parameters by using a target aggregation strategy to obtain aggregated data; and for the obtained multiple pieces of aggregated data, converting a second data format of the multiple pieces of aggregated data according to a second communication protocol of the power terminal which is about to receive the multiple pieces of aggregated data, and transmitting a conversion result to the power terminal. According to the technical scheme, the processing efficiency of the power data can be improved.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of data processing technology, and in particular to a power data transmission method, device, electronic device, and storage medium. Background Art

[0002] With the continuous development of the power industry, the interconnectivity between power terminals is becoming increasingly higher, which makes the power data transmission process between power terminals play an increasingly significant role in the power system.

[0003] In the process of realizing the present invention, the inventors discovered that the following technical problems exist in the prior art: the currently adopted power data transmission solution will affect the efficiency of subsequent power data processing, which needs to be solved urgently. Summary of the Invention

[0004] Embodiments of the present invention provide a power data transmission method, device, electronic device, and storage medium to improve power data processing efficiency.

[0005] According to one aspect of the present invention, a method for transmitting power data is provided, which may include:

[0006] For a plurality of power data to be transmitted, classify the plurality of power data according to a first communication protocol and a first data format respectively corresponding to the plurality of power data to obtain a plurality of power data sets;

[0007] For each of the multiple power data sets, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies according to the time granularity and data volume of the power data set, and strategy parameters of the target aggregation strategy are obtained;

[0008] Using the target aggregation strategy and based on the strategy parameters, the power data in the power data set are aggregated to obtain aggregated data;

[0009] The obtained multiple aggregated data are converted into a second data format according to a second communication protocol of a power terminal to receive the multiple aggregated data, and the converted multiple aggregated data are transmitted to the power terminal.

[0010] According to another aspect of the present invention, a power data transmission device is provided, which may include:

[0011] a power data set obtaining module, configured to classify a plurality of power data to be transmitted according to a first communication protocol and a first data format respectively corresponding to the plurality of power data, so as to obtain a plurality of types of power data sets;

[0012] a strategy parameter acquisition module for determining, for each of the multiple power data sets, a target aggregation strategy from a plurality of preset power data aggregation strategies based on the time granularity and data volume of the power data set, and obtaining strategy parameters of the target aggregation strategy;

[0013] The aggregated data obtaining module is used to aggregate the power data in the power data set using the target aggregation strategy and based on the strategy parameters to obtain aggregated data;

[0014] The aggregate data transmission module is used to convert the second data format of the obtained multiple aggregate data according to the second communication protocol of the power terminal to receive the multiple aggregate data, and transmit the converted multiple aggregate data to the power terminal.

[0015] According to another aspect of the present invention, there is provided an electronic device, which may include:

[0016] at least one processor; and

[0017] a memory communicatively connected to at least one processor; wherein,

[0018] The memory stores a computer program that can be executed by at least one processor. The computer program is executed by the at least one processor so that the at least one processor implements the power data transmission method provided by any embodiment of the present invention when executing the computer program.

[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, on which computer instructions are stored. The computer instructions are used to enable a processor to implement the power data transmission method provided by any embodiment of the present invention when executed.

[0020] The technical solution of the embodiment of the present invention is to classify multiple power data by using the first communication protocol and the first data format corresponding to the multiple power data to be transmitted, so as to obtain multiple types of power data sets; for each type of power data set in the multiple types of power data sets, according to the time granularity and data volume of the power data set, determine the target aggregation strategy from the preset multiple power data aggregation strategies, and obtain the strategy parameters of the target aggregation strategy; using the target aggregation strategy, based on the strategy parameters, aggregate the power data in the power data set to obtain aggregated data; for the obtained multiple aggregated data, according to the second communication protocol of the power terminal to receive the multiple aggregated data, convert the second data format of the multiple aggregated data, and transmit the converted multiple aggregated data to the power terminal. The above technical solution reduces the amount of data by aggregating the multiple power data, and then realizes the format unification by converting the format of the aggregated multiple power data. After such power data is transmitted to the power terminal, it is convenient for the power terminal to quickly process the power data with limited data volume and unified format, thereby improving the processing efficiency of the power data.

[0021] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 is a flow chart of a power data transmission method provided according to an embodiment of the present invention;

[0024] Figure 2 is a flow chart of another power data transmission method provided according to an embodiment of the present invention;

[0025] Figure 3 is a flowchart of another power data transmission method provided according to an embodiment of the present invention;

[0026] Figure 4 is a flowchart of an optional example of another power data transmission method provided in an embodiment of the present invention;

[0027] Figure 5 This is a structural block diagram of a power data transmission device provided according to an embodiment of the present invention;

[0028] Figure 6 It is a structural diagram of an electronic device that implements the power data transmission method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. The situations of "target", "original", etc. are similar and will not be repeated here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] Figure 1 This is a flow chart of a method for transmitting power data provided by an embodiment of the present invention. This embodiment is applicable to power data transmission, and is particularly applicable to transmission after power data is aggregated and format-converted. This method can be performed by a power data transmission device provided by an embodiment of the present invention. The device can be implemented in software and / or hardware and can be integrated into an electronic device, such as various user terminals or servers.

[0032] See also Figure 1 The method of the embodiment of the present invention specifically includes the following steps:

[0033] S110. For a plurality of power data to be transmitted, classify the plurality of power data according to the first communication protocol and the first data format respectively corresponding to the plurality of power data to obtain a plurality of types of power data sets.

[0034] The multiple power data can be understood as multi-source heterogeneous data from power terminals, i.e., power data from various types of power terminals, each of which uses a different first communication protocol and first data format. Each of the multiple power data can be analyzed to extract the first communication protocol and first data format, and a feature vector can be constructed based on the extracted information.

[0035] On this basis, the feature vector can be analyzed according to preset classification rules using a K-Nearest Neighbor algorithm (KNN) to obtain the category of the power data, thereby achieving the classification of the power data. In combination with the application scenarios that may be involved in the embodiments of the present invention, three categories are optionally preset: Class A device status data, Class B user power consumption data, and Class C system log data.

[0036] On this basis, for example, the feature vector of the power data can be compared with the feature vector of the known category, the Euclidean distance is calculated, and the K nearest neighbors are selected to determine the category of the power data based on the majority voting principle. If the power data cannot be matched to an existing category, a new category (i.e., D category) is dynamically generated based on the feature vector to achieve adaptive classification.

[0037] After the plurality of power data are classified respectively, a plurality of power data sets can be obtained.

[0038] S120. For each type of power data set in the multiple types of power data sets, determine a target aggregation strategy from multiple preset power data aggregation strategies based on the time granularity and data volume of the power data set, and obtain strategy parameters of the target aggregation strategy.

[0039] Among them, through the time granularity and data volume of the power data set, the target aggregation strategy that best matches the power data set can be determined from multiple preset power data aggregation strategies, and then the strategy parameters of the target aggregation strategy can be obtained to perform power data aggregation processing on this basis.

[0040] S130 . Utilize the target aggregation strategy and, based on the strategy parameters, aggregate the power data in the power data set to obtain aggregated data.

[0041] Among them, the target aggregation strategy is used to aggregate the power data based on the strategy parameters to obtain aggregated data, thereby reducing the volume of the power data.

[0042] S140. Convert the obtained multiple aggregated data into a second data format according to a second communication protocol of the power terminal to receive the multiple aggregated data, and transmit the converted multiple aggregated data to the power terminal.

[0043] The second communication protocol may be understood as a communication protocol used by the power terminal to receive the plurality of aggregated data. According to the second communication protocol, the second data format of the plurality of aggregated data is converted so that the converted aggregated data can be directly processed by the power terminal.

[0044] Furthermore, the converted multiple aggregated data are transmitted to the power terminal.

[0045] The technical solution of the embodiment of the present invention is to classify multiple power data by using the first communication protocol and the first data format corresponding to the multiple power data to be transmitted, so as to obtain multiple types of power data sets; for each type of power data set in the multiple types of power data sets, according to the time granularity and data volume of the power data set, determine the target aggregation strategy from the preset multiple power data aggregation strategies, and obtain the strategy parameters of the target aggregation strategy; using the target aggregation strategy, based on the strategy parameters, aggregate the power data in the power data set to obtain aggregated data; for the obtained multiple aggregated data, according to the second communication protocol of the power terminal to receive the multiple aggregated data, convert the second data format of the multiple aggregated data, and transmit the converted multiple aggregated data to the power terminal. The above technical solution reduces the amount of data by aggregating the multiple power data, and then realizes the format unification by converting the format of the aggregated multiple power data. After such power data is transmitted to the power terminal, it is convenient for the power terminal to quickly process the power data with limited data volume and unified format, thereby improving the processing efficiency of the power data.

[0046] An optional technical solution, the above-mentioned power data transmission method further includes:

[0047] During the aggregation process, the power data in the power data set is subjected to standardized conversion processing to convert the unstructured power data into structured data;

[0048] The quantity and quality of the structured data are verified. If the structured data is determined to be erroneous or incomplete, the structured data is repaired according to the error type or missing type, and the repaired structured data is aggregated.

[0049] For example, power data from power terminals is unstructured data in the form of logs, containing timestamps, device identifiers, and power usage information. Customized parsing scripts can be used to convert this log data into a structured table format, where each row represents a record with clear column names and corresponding data values, thus achieving the conversion from unstructured to structured data.

[0050] If the quantity and quality verification results show that the structured data is erroneous or incomplete, the preset fault-tolerant processing mechanism is triggered, and the structured data is repaired using the corresponding error type or missing type, so as to aggregate the repaired structured data.

[0051] For example, during the data repair process, the FP-Growth association rule mining algorithm can be used to discover association rules and patterns between data from historical power data. For example, there is a strong correlation between electricity consumption and temperature in a certain area. When the temperature rises, electricity consumption will also increase accordingly. Then, using this association rule and pattern, the missing electricity data can be filled in. For example, the electricity consumption on a certain day is missing, but the corresponding electricity consumption can be inferred based on the temperature records of that day.

[0052] The above technical solution realizes the data structure conversion and data quality repair of power data.

[0053] Another optional technical solution for transmitting the converted multiple aggregated data to the power terminal includes:

[0054] Determine the transmission batches of the converted multiple aggregated data according to the data receiving capability of the power terminal and the network transmission status;

[0055] Through the asynchronous sending mechanism, multiple converted aggregated data are transmitted to the power terminal in batches based on the transmission batch.

[0056] When determining transmission batches, the data reception capabilities of power terminals and network transmission conditions must be considered. By dynamically adjusting the Transmission Control Protocol (TCP) window size and packet size, the efficiency of power data transmission can be optimized, ensuring transmission stability and efficiency.

[0057] The use of an asynchronous transmission mechanism can improve the flexibility and responsiveness of power data transmission. For example, during the power data transmission process, the asynchronous transmission mechanism can be used to send multiple converted aggregated data in batches to the power terminal, avoiding delays caused by waiting for a single transmission to be completed.

[0058] The above technical solution transmits power data to the power terminal in batches through an asynchronous sending mechanism. That is, the asynchronous sending mechanism can continuously transmit power data in the background to avoid blocking the operation of the main thread.

[0059] Figure 2It is a flowchart of another power data transmission method provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, according to the time granularity and data volume of the power data set, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies, including: according to the time granularity of the power data set, using a time series analysis algorithm to perform trend prediction and periodic analysis on each power data in the power data set to obtain time characteristics; according to the time characteristics, selecting a time window size, slicing each power data in the power data set to obtain a plurality of slice data; for each slice data, grouping each power data in the slice data according to the data volume of the slice data to obtain a plurality of data clusters; according to the characteristic vectors corresponding to all the data clusters in the power data set, determining the target aggregation strategy from a plurality of preset power data aggregation strategies. Among them, the explanations of the terms that are the same as or corresponding to the above-mentioned embodiments are not repeated here.

[0060] See also Figure 2 The method of this embodiment may specifically include the following steps:

[0061] S210. For a plurality of power data to be transmitted, classify the plurality of power data according to the first communication protocol and the first data format respectively corresponding to the plurality of power data to obtain a plurality of types of power data sets.

[0062] S220. For each type of power data set in the multiple types of power data sets, according to the time granularity of the power data set, a time series analysis algorithm is used to perform trend prediction and periodic analysis on each power data in the power data set to obtain time characteristics.

[0063] Based on the time granularity of the power data set, a time series analysis algorithm such as Prophet is used to perform trend forecasting and periodicity analysis on the power data set to obtain temporal characteristics. Depending on the application scenarios that may be involved in embodiments of the present invention, these temporal characteristics may optionally include trends, seasonality, and residuals, etc. This is related to actual circumstances and is not specifically limited here.

[0064] On this basis, Prophet was used to perform trend forecasting on the power data set as an example. It was found that electricity consumption showed an upward trend in the summer and a downward trend in the winter, and there were obvious daily periodic fluctuations, that is, electricity consumption was higher during the day than at night. Through Prophet analysis, the trend component, seasonal component and residual component of the power data set can be obtained. These time characteristics provide an important basis for subsequent power data processing.

[0065] S230. Select a time window size according to the time feature, slice each power data in the power data set, and obtain a plurality of sliced ​​data.

[0066] Here, based on the time characteristics, an appropriate time window size is selected to slice each power data in the power data set. For example, when the time characteristics are seasonal analysis results, "day" is selected as the time window, and each power data is divided into multiple 24-hour time periods.

[0067] S240 . For each slice data, group the power data in the slice data according to the data volume of the slice data to obtain multiple data clusters.

[0068] For each slice of data, that is, within each time window, the power data can be grouped according to the data volume of each power data within the time window to obtain multiple data clusters.

[0069] For example, in the electricity consumption data of a certain day, the K-means algorithm is used to divide the electricity data into the following three data clusters: peak period electricity consumption cluster, off-peak period electricity consumption cluster and normal period electricity consumption cluster, thereby completing the automatic grouping of electricity data.

[0070] S250. Determine a target aggregation strategy from a plurality of preset power data aggregation strategies based on the characteristic vectors corresponding to all data clusters in the power data set, and obtain strategy parameters of the target aggregation strategy.

[0071] Among them, it can be understood that each power data in each data cluster has a similar characteristic vector. Therefore, according to the characteristic vectors corresponding to all data clusters in the power data set, the target aggregation strategy can be determined from the preset multiple power data aggregation strategies, and the strategy parameters of the target aggregation strategy can be obtained, so that in subsequent steps, the power data aggregation process can be carried out by utilizing the target aggregation strategy and strategy parameters.

[0072] S260. Utilize the target aggregation strategy and, based on the strategy parameters, aggregate the power data in the power data set to obtain aggregated data.

[0073] Among them, the target aggregation strategy can be understood as the power data aggregation strategy that best matches the power data set. Therefore, the target aggregation strategy can be used, and based on the strategy parameters corresponding to the target aggregation strategy, the aggregation processing of each power data in the power data set can be performed to obtain aggregated data.

[0074] On this basis, for example, the policy parameters can be parsed to obtain the value range and default value of each policy parameter. Then, based on the aggregation requirements of the power data set (such as accuracy and latency), the policy parameters of the target aggregation policy can be automatically adjusted within the value range through grid search or random search methods, so that the final applied policy parameters match the aggregation requirements and improve the aggregation effect.

[0075] S270. Convert the obtained multiple aggregated data into a second data format according to the second communication protocol of the power terminal to receive the multiple aggregated data, and transmit the converted multiple aggregated data to the power terminal.

[0076] The technical solution of the embodiment of the present invention realizes the accurate determination of the power data aggregation strategy that matches the power data set, thereby ensuring the power data aggregation effect.

[0077] An optional technical solution, based on the characteristic vectors corresponding to all data clusters in the power data set, determines a target aggregation strategy from a plurality of preset power data aggregation strategies, including:

[0078] For each data cluster in the power data set, the time characteristics and numerical characteristics of the data cluster are counted, and a feature vector is generated according to the time characteristics and numerical characteristics;

[0079] Obtaining a convergence strategy prediction model, wherein the convergence strategy prediction model is pre-trained based on a plurality of preset power data convergence strategies;

[0080] The characteristic vector corresponding to each data cluster is input into the aggregation strategy prediction model, and according to the output result of the aggregation strategy prediction model, the target aggregation strategy is determined from multiple power data aggregation strategies.

[0081] For each data cluster, statistics are collected on its temporal and numerical features. In this technical solution, the numerical features can optionally be at least one of the mean, variance, maximum, and minimum values. Based on this, a feature vector is generated based on the temporal and numerical features. Furthermore, using the convergence strategy prediction model, the target convergence strategy is accurately determined based on the feature vectors corresponding to each data cluster.

[0082] Figure 3 This is a flowchart of another method for transmitting power data provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, the converted multiple aggregated data are transmitted to the power terminal, including: establishing multiple independent transmission paths according to a preset network topology; monitoring the health status of each transmission path respectively, and determining a target path from the multiple transmission paths based on the obtained health status; and using the target path to transmit the converted multiple aggregated data to the power terminal. The explanations of the terms that are the same as or corresponding to the above-mentioned embodiments are not repeated here.

[0083] See also Figure 3 The method of this embodiment may specifically include the following steps:

[0084] S310. For a plurality of power data to be transmitted, classify the plurality of power data according to the first communication protocol and the first data format respectively corresponding to the plurality of power data to obtain a plurality of types of power data sets.

[0085] S320. For each type of power data set in the multiple types of power data sets, determine a target aggregation strategy from multiple preset power data aggregation strategies based on the time granularity and data volume of the power data set, and obtain strategy parameters of the target aggregation strategy.

[0086] S330. Utilize the target aggregation strategy and, based on the strategy parameters, aggregate the power data in the power data set to obtain aggregated data.

[0087] S340. Convert the obtained plurality of aggregated data into a second data format according to a second communication protocol of the power terminal to receive the plurality of aggregated data.

[0088] S350. Establish multiple independent transmission paths according to the preset network topology, and monitor the health status of each transmission path separately.

[0089] Among them, according to the preset network topology, multiple independent transmission paths are established to obtain redundant communication links and ensure the stability of the communication links. For example, in the power system, the power data transmission of the power terminal requires extremely high reliability and stability. Therefore, a network topology structure containing three independent transmission paths is designed: transmission path A, transmission path B and transmission path C. Transmission path A is connected by optical fiber, transmission path B is connected by wireless 4G network, and transmission path C is connected by satellite communication. This multi-transmission path design ensures that when any single transmission path fails, the power system can still transmit power data through other transmission paths, thereby avoiding communication interruption.

[0090] On this basis, the health status of each transmission path is monitored separately. For example, a heartbeat detection mechanism can be used to determine whether a transmission path is abnormal. For example, a heartbeat detection module can be deployed on each transmission path, sending a heartbeat packet every 5 seconds and setting a 30-second timeout threshold. If a heartbeat response is not received from a transmission path three times in a row, the transmission path is considered abnormal.

[0091] S360. Determine a target path from multiple transmission paths based on the obtained overall health status, and use the target path to transmit the converted multiple aggregated data to the power terminal.

[0092] Based on the obtained health status, a transmission path that is not faulty and can normally transmit power data is determined from the multiple transmission paths. For ease of distinction, this transmission path is referred to as the target path. Further, the target path can be used to transmit power data.

[0093] The technical solution of the embodiment of the present invention ensures the stability of the communication link by adopting a multi-path redundant transmission implementation solution, thereby ensuring the stability of power data transmission.

[0094] An optional technical solution, the above-mentioned power data transmission method further includes:

[0095] For multiple backup paths other than the target path among the multiple transmission paths, monitoring the health status of the target path and the health status of each backup path during the process of using the target path for aggregated data transmission;

[0096] When the health status of the target path indicates that the target path has failed, a switching path is determined from the multiple backup paths according to their corresponding health statuses, so as to switch from the target path to the switching path to continue the transmission process.

[0097] The above technical solution monitors the health status of each transmission path in real time, and automatically switches to the backup path when a target path fails, ensuring the continuous transmission of power data.

[0098] On this basis, optionally, the selection of the backup path is based on a weighted polling algorithm, which adds the delay, bandwidth and packet loss rate indicators into consideration, calculates the weight of each transmission path, and selects the backup path with the highest weight as the optimal path (i.e., the switching path) for application. For example, continuing with the above example, assuming that the target path is transmission path A, the delay of transmission path B is 50ms, the bandwidth is 10Mbps and the packet loss rate is 1%, and the delay of transmission path C is 200ms, the bandwidth is 5Mbps and the packet loss rate is 0.5%. Through weighted calculation, the weight of transmission path B is higher than that of transmission path C, so transmission path B is selected as the optimal path for power data transmission, ensuring the continuous transmission of power output.

[0099] Optionally, after switching to the switching path, the recovery of the target path and the switching path is continuously monitored. If the target path is detected to have returned to normal and its quality is better than the currently used switching path, the power data transmission can be switched back to the target path. For example, after switching to transmission path B, the health status of transmission path A is checked every 1 minute. If it is found that transmission path A has returned to normal and its latency and bandwidth indicators are better than those of transmission path B, the power data transmission is switched back to transmission path A. This dynamic switching mechanism ensures that power data transmission is always carried out on the optimal path, improving transmission efficiency.

[0100] In order to better understand the above-mentioned technical solutions and related technical solutions as a whole, an example of power data transmission of power terminal interconnection is used for exemplary description below.

[0101] For example, see Figure 4 The specific implementation process is as follows:

[0102] S1. Classifying data using an adaptive recognition algorithm based on a first communication protocol and a first data format of multi-source heterogeneous data from a power terminal to obtain data sets of different categories;

[0103] S2. For each type of data set, by analyzing its time granularity and data volume, select a target aggregation strategy from a preset power data aggregation strategy library and obtain the corresponding strategy parameters;

[0104] S3. During the data aggregation process, the data is formatted and verified according to the selected target aggregation strategy. If any data errors or incompleteness are found, the predefined fault tolerance mechanism is triggered to repair or retransmit the data.

[0105] S4. The aggregated data is converted into a standard transmission format according to the second communication protocol of the power terminal, and the data is transmitted to the power terminal in batches through an asynchronous transmission mechanism.

[0106] S5. In order to ensure the stability of the communication link, a multi-path redundant transmission solution is adopted. When a transmission path fails, it automatically switches to the backup transmission path for data transmission.

[0107] In the above example, data with different communication protocols and data formats are classified through an adaptive recognition algorithm, and a target aggregation strategy is selected according to data characteristics (i.e., time granularity and data volume). In the aggregation process, the data is format converted and verified, and a fault-tolerant mechanism is provided to repair erroneous or incomplete data. The aggregated data is converted into a standard transmission format according to the communication protocol of the power terminal and transmitted to the power terminal through asynchronous multi-path. This can effectively solve the problem of intelligent aggregation and conversion of multi-source heterogeneous data at the power terminal, improve the efficiency and reliability of data processing, and thus provide strong support for data management and analysis of the power system.

[0108] Figure 5 This is a structural block diagram of a power data transmission device provided in an embodiment of the present invention, which is used to execute the power data transmission method provided in any of the above embodiments. This device and the power data transmission method of the above embodiments belong to the same inventive concept. For details not fully described in the embodiments of the power data transmission device, please refer to the embodiments of the above power data transmission method. Figure 5 The device may specifically include: a power data set acquisition module 410, a strategy parameter acquisition module 420, an aggregated data acquisition module 430, and an aggregated data transmission module 440.

[0109] The power data set obtaining module 410 is configured to classify the plurality of power data to be transmitted according to the first communication protocol and the first data format respectively corresponding to the plurality of power data, so as to obtain a plurality of types of power data sets;

[0110] a strategy parameter acquisition module 420 for determining, for each of the multiple types of power data sets, a target aggregation strategy from a plurality of preset power data aggregation strategies based on the time granularity and data volume of the power data set, and obtaining strategy parameters of the target aggregation strategy;

[0111] The aggregated data obtaining module 430 is configured to aggregate the power data in the power data set using the target aggregation strategy based on the strategy parameters to obtain aggregated data;

[0112] The aggregated data transmission module 440 can be used to convert the second data format of the multiple aggregated data obtained according to the second communication protocol of the power terminal to receive the multiple aggregated data, and transmit the converted multiple aggregated data to the power terminal.

[0113] Optionally, the policy parameter acquisition module 420 may include:

[0114] The time feature acquisition submodule is used to perform trend prediction and periodic analysis on each power data in the power data set according to the time granularity of the power data set and adopt a time series analysis algorithm to obtain the time feature;

[0115] The slice data acquisition submodule can be used to select the time window size according to the time characteristics, slice each power data in the power data set, and obtain multiple slice data;

[0116] The data cluster obtaining submodule is used to group the power data in each slice data according to the data volume of the slice data to obtain multiple data clusters;

[0117] The target aggregation strategy determination submodule is used to determine a target aggregation strategy from a plurality of preset power data aggregation strategies according to the characteristic vectors corresponding to all data clusters in the power data set.

[0118] On this basis, the target convergence strategy determination submodule may optionally include:

[0119] A feature vector generating unit may be used to collect time characteristics and numerical characteristics of each data cluster in the power data set, and generate a feature vector based on the time characteristics and numerical characteristics;

[0120] A convergence strategy prediction model acquisition unit is used to acquire a convergence strategy prediction model, wherein the convergence strategy prediction model is pre-trained based on a plurality of preset power data convergence strategies;

[0121] The target convergence strategy determination unit can be used to input the feature vector corresponding to each data cluster into the convergence strategy prediction model, and determine the target convergence strategy from multiple power data convergence strategies based on the output result of the convergence strategy prediction model.

[0122] Optionally, the above-mentioned power data transmission device further includes:

[0123] The power data conversion module can be used to perform standardized conversion processing on the power data in the power data set during the aggregation process, so as to convert the unstructured power data into structured data;

[0124] The structured data repair module can be used to verify the quantity and quality of structured data. If the structured data is determined to be erroneous or incomplete data after verification, the structured data is repaired according to the error type or missing type, and the repaired structured data is aggregated and processed.

[0125] Optionally, the converged data transmission module 440 may include:

[0126] a transmission batch determining unit, configured to determine transmission batches of the converted multiple aggregated data according to the data receiving capability of the power terminal and the network transmission status;

[0127] The first aggregate data transmission unit is used to transmit the converted multiple aggregate data to the power terminal in batches based on the transmission batch through an asynchronous sending mechanism.

[0128] Optionally, the converged data transmission module 440 may include:

[0129] A transmission path establishing unit, configured to establish multiple independent transmission paths according to a preset network topology;

[0130] a target path determination unit, configured to monitor the health status of each transmission path respectively and determine a target path from the plurality of transmission paths based on all the obtained health statuses;

[0131] The second aggregate data transmission unit is used to transmit the converted multiple aggregate data to the power terminal by using the target path.

[0132] On this basis, optionally, the above-mentioned power data transmission device may further include:

[0133] A health status monitoring module is used to monitor the health status of the target path and the health status of each backup path in the process of using the target path to transmit aggregated data, for multiple backup paths other than the target path among the multiple transmission paths;

[0134] The switching path determination module is used to determine a switching path from multiple backup paths based on the health states corresponding to the multiple backup paths when the health state of the target path indicates that the target path has failed, so as to switch from the target path to the switching path to continue the transmission process.

[0135] The power data transmission device provided by the embodiment of the present invention, through a data set acquisition module, classifies multiple power data according to the first communication protocol and the first data format corresponding to the multiple power data to be transmitted, so as to obtain multiple types of power data sets; through a strategy parameter acquisition module, for each type of power data set in the multiple types of power data sets, according to the time granularity and data volume of the power data set, determines a target aggregation strategy from multiple preset power data aggregation strategies, and obtains the strategy parameters of the target aggregation strategy; through the aggregation data acquisition module, uses the target aggregation strategy and the strategy parameters to aggregate the power data in the power data set to obtain aggregated data; then, through the aggregation data transmission module, for the obtained multiple aggregated data, according to the second communication protocol of the power terminal to receive the multiple aggregated data, the second data format of the multiple aggregated data is converted, and the converted multiple aggregated data is transmitted to the power terminal. The above device reduces the amount of data by aggregating the multiple power data, and then achieves format unification by converting the format of the aggregated multiple power data. After such power data is transmitted to the power terminal, it is convenient for the power terminal to quickly process the power data with limited data volume and unified format, thereby improving the processing efficiency of the power data.

[0136] The power data transmission device provided in the embodiment of the present invention can execute the power data transmission method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0137] It is worth noting that in the embodiment of the above-mentioned power data transmission device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0138] Figure 6 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0139] like Figure 6As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11. The memory stores a computer program that can be executed by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the RAM 13. The processor 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0140] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0141] The processor 11 may be any general-purpose and / or specialized processing component with processing and computing capabilities. Examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the power data transmission method.

[0142] In some embodiments, the power data transmission method can be implemented as a computer program that is tangibly contained in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the power data transmission method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to perform the power data transmission method in any other suitable manner (e.g., by means of firmware).

[0143] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0144] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0145] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0146] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0147] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0148] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0149] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0150] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A method for transmitting power data, characterized in that: include: For a plurality of power data to be transmitted, classify the plurality of power data according to the first communication protocol and the first data format respectively corresponding to the plurality of power data to obtain a plurality of types of power data sets; For each of the multiple types of power data sets, according to the time granularity and data volume of the power data set, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies, and a strategy parameter of the target aggregation strategy is obtained; Using the target aggregation strategy and based on the strategy parameters, each of the power data in the power data set is aggregated to obtain aggregated data; For the obtained multiple aggregated data, the second data format of the multiple aggregated data is converted according to the second communication protocol of the power terminal to receive the multiple aggregated data, and the converted multiple aggregated data is transmitted to the power terminal.

2. The method according to claim 1, characterized in that: The step of determining a target aggregation strategy from a plurality of preset power data aggregation strategies according to the time granularity and data volume of the power data set includes: According to the time granularity of the power data set, a time series analysis algorithm is used to perform trend prediction and periodic analysis on each power data in the power data set to obtain time characteristics; According to the time feature, a time window size is selected, and each of the power data in the power data set is sliced ​​to obtain a plurality of sliced ​​data; For each of the slice data, grouping the power data in the slice data according to the data amount of the slice data to obtain a plurality of data clusters; According to the characteristic vectors respectively corresponding to all the data clusters in the power data set, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies.

3. The method according to claim 2, characterized in that The step of determining a target aggregation strategy from a plurality of preset power data aggregation strategies according to the feature vectors respectively corresponding to all the data clusters in the power data set includes: For each of the data clusters in the power data set, counting the time characteristics and the numerical characteristics of the data cluster, and generating a feature vector according to the time characteristics and the numerical characteristics; Acquire a convergence strategy prediction model, wherein the convergence strategy prediction model is pre-trained based on a plurality of preset power data convergence strategies; The feature vector corresponding to each of the data clusters is input into the aggregation strategy prediction model, and a target aggregation strategy is determined from the plurality of power data aggregation strategies according to an output result of the aggregation strategy prediction model.

4. The method according to claim 1, characterized in that: Also includes: During the aggregation process, the power data in the power data set is subjected to a standardized conversion process to convert the unstructured power data into structured data; The quantity and quality of the structured data are verified. If the structured data is determined to be erroneous data or incomplete data after verification, the structured data is repaired according to the error type or missing type, so as to perform aggregation processing on the repaired structured data.

5. The method according to claim 1, characterized in that The step of transmitting the converted plurality of aggregated data to the power terminal comprises: Determining a transmission batch of the converted plurality of aggregated data according to the data receiving capability of the power terminal and the network transmission status; Through an asynchronous transmission mechanism, the converted multiple aggregated data are transmitted to the power terminal in batches based on the transmission batches.

6. The method according to claim 1, characterized in that The step of transmitting the converted plurality of aggregated data to the power terminal comprises: Establish multiple independent transmission paths according to the preset network topology; respectively monitoring the health status of each of the transmission paths, and determining a target path from the plurality of transmission paths according to all the obtained health statuses; The converted plurality of aggregated data are transmitted to the power terminal by using the target path.

7. The method according to claim 6, characterized in that Also includes: For a plurality of backup paths other than the target path among the plurality of transmission paths, during the process of performing the converged data transmission by using the target path, monitoring the health status of the target path and the health status of each of the backup paths; When the health status of the target path indicates that the target path fails, a switching path is determined from the plurality of backup paths according to the health statuses corresponding to the plurality of backup paths, so as to switch from the target path to the switching path to continue the transmission process.

8. A power data transmission device, characterized in that: include: A power data set obtaining module, for classifying a plurality of power data to be transmitted according to a first communication protocol and a first data format respectively corresponding to the plurality of power data, so as to obtain a plurality of types of power data sets; a strategy parameter acquisition module, configured to determine, for each of the plurality of power data sets, a target aggregation strategy from a plurality of preset power data aggregation strategies according to the time granularity and data volume of the power data set, and acquire strategy parameters of the target aggregation strategy; An aggregated data obtaining module, configured to perform aggregation processing on each of the power data in the power data set by utilizing the target aggregation strategy and based on the strategy parameters to obtain aggregated data; The converged data transmission module is used to convert the second data format of the multiple aggregated data obtained according to the second communication protocol of the power terminal to be received by the multiple aggregated data, and transmit the converted multiple aggregated data to the power terminal.

9. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor performs the power data transmission method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the power data transmission method as described in any one of claims 1 to 7 when executed.

Images