A power data transmission method and device, electronic equipment and storage medium

Abstract

Embodiments of the present application disclose a power data transmission method and device, electronic equipment and storage medium. The method can comprise: according to a plurality of power data respectively corresponding first communication protocol and first data format, classifying a plurality of power data to obtain a plurality of power data set; for each power data set, according to the time granularity and data volume of the power data set, determining the target aggregation strategy from the plurality of preset power data aggregation strategies, and obtaining the strategy parameters of the target aggregation strategy; using the target aggregation strategy, based on the strategy parameters, the power data in the power data set is aggregated to obtain the aggregated data; for the obtained plurality of aggregated data, according to the second communication protocol of the power terminal to be received, the second data format of the plurality of aggregated data is converted, and the conversion result is transmitted to the power terminal. The technical scheme of the embodiments of the present application can improve the processing efficiency of power data.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of data processing, and in particular to a power data transmission method and device, electronic equipment and storage medium. BACKGROUND

[0002] With the continuous development of the power industry, the interconnectivity between power terminals is increasingly high, which makes the power data transmission process between power terminals play a more and more significant role in the power system.

[0003] In the process of implementing the present application, the inventors found that the existing power data transmission scheme has the following technical problems: the current power data transmission scheme affects the subsequent power data processing efficiency and needs to be solved urgently. SUMMARY

[0004] Embodiments of the present application provide a power data transmission method and device, electronic equipment and storage medium to improve the processing efficiency of power data.

[0005] According to an aspect of the present application, a power data transmission method can include:

[0006] For a plurality of power data to be transmitted, according to the first communication protocol and the first data format corresponding to each of the plurality of power data, the plurality of power data is classified to obtain a plurality of power data sets of different categories;

[0007] For each power data set of different categories in the plurality of power data sets of different categories, according to the time granularity and the data volume of the power data set, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies, and the strategy parameters of the target aggregation strategy are obtained;

[0008] Using the target aggregation strategy, based on the strategy parameters, each power data in the power data set is aggregated and processed to obtain aggregated data;

[0009] For the obtained plurality of aggregated data, according to the second communication protocol of the power terminal to be received, the second data format of the plurality of aggregated data is converted, and the converted plurality of aggregated data is transmitted to the power terminal.

[0010] According to another aspect of the present application, a power data transmission device can include:

[0011] The power data set obtaining module is configured to, for a plurality of power data to be transmitted, according to the first communication protocol and the first data format corresponding to each of the plurality of power data, classify the plurality of power data to obtain a plurality of power data sets of different categories;

[0012] The policy parameter acquisition module is configured to, for each power data set in the plurality of power data sets, determine a target aggregation policy from a plurality of preset power data aggregation policies according to a time granularity and a data volume of the power data set, and acquire a policy parameter of the target aggregation policy.

[0013] The aggregated data obtaining module is configured to perform aggregation processing on each power data in the power data set based on the policy parameter by using the target aggregation policy, and obtain aggregated data.

[0014] The aggregated data transmission module is configured to, for the obtained plurality of aggregated data, convert a second data format of the plurality of aggregated data according to a second communication protocol of a power terminal to be received, and transmit the converted plurality of aggregated data to the power terminal.

[0015] According to another aspect of the present application, an electronic device can include:

[0016] at least one processor; and

[0017] a memory connected to the at least one processor in communication; wherein

[0018] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to cause the at least one processor to implement the power data transmission method provided by any of the embodiments of the present application when executed.

[0019] According to another aspect of the present application, a computer readable storage medium is provided, and the computer readable storage medium stores computer instructions for causing a processor to implement the power data transmission method provided by any of the embodiments of the present application when executed.

[0020] The technical scheme of the embodiment of the application is as follows: the plurality of power data to be transmitted correspond to a first communication protocol and a first data format respectively, and the plurality of power data are classified to obtain a plurality of power data sets; for each power data set in the plurality of power data sets, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies according to the time granularity and the data volume of the power data set, and a strategy parameter of the target aggregation strategy is obtained; each power data in the power data set is aggregated by using the target aggregation strategy based on the strategy parameter, and aggregated data is obtained; for the obtained plurality of aggregated data, the second data format of the plurality of aggregated data is converted according to the second communication protocol of the power terminal receiving the plurality of aggregated data, and the converted plurality of aggregated data is transmitted to the power terminal. The above technical scheme aggregates the plurality of power data, thereby reducing the data volume, and then converts the plurality of aggregated power data, thereby realizing format unification. After the power data is transmitted to the power terminal, the power terminal can quickly process the power data with limited data volume and unified format, thereby improving the processing efficiency of the power data.

[0021] It should be understood that the content described in this part is not intended to identify key or important features of the embodiments of the application, nor is it intended to limit the scope of the application. Other features of the application will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the application, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the application, and other drawings can also be obtained by those skilled in the art without creative labor.

[0023] Figure 1 is a flowchart of a power data transmission method according to an embodiment of the application;

[0024] Figure 2 is a flowchart of another power data transmission method according to an embodiment of the application;

[0025] Figure 3 is a flowchart of another power data transmission method according to an embodiment of the application;

[0026] Figure 4 is a flowchart of an optional example in another power data transmission method according to an embodiment of the application;

[0027] Figure 5 is a structural block diagram of a power data transmission device according to an embodiment of the application;

[0028] Figure 6 is a structural schematic diagram of an electronic device for implementing a power data transmission method according to an embodiment of the present application. DETAILED DESCRIPTION

[0029] In order to make the technical personnel in the art better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, not all. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor should fall within the scope of protection of the present application.

[0030] It should be noted that the terms "first", "second", and the like in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein. The case of "target", "original" and the like is similar, which will not be repeated here. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not necessarily limit to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0031] Figure 1 is a flowchart of a power data transmission method provided by an embodiment of the present application. The present embodiment can be applied to the case of power data transmission, especially to the case of transmission after the power data is aggregated and format-converted. The method can be executed by a power data transmission device provided by an embodiment of the present application, which can be realized by software and / or hardware, and can be integrated on an electronic device, which can be various user terminals or servers.

[0032] Referring to Figure 1 , the method of the present embodiment specifically includes the following steps:

[0033] S110. For a plurality of power data to be transmitted, according to the first communication protocol and the first data format corresponding to each of the plurality of power data, the plurality of power data is classified to obtain a plurality of power data sets.

[0034] The plurality of power data can be understood as power terminal multi-source heterogeneous data, i.e., power data from various types of power terminals, each power terminal using different first communication protocols and first data formats. For each power data in the plurality of power data, the first communication protocol and the first data format can be extracted by analyzing the power data, and a feature vector can be constructed accordingly.

[0035] On this basis, the feature vector can be analyzed according to a preset classification rule using a K-Nearest Neighbor (KNN) algorithm to obtain the classification of the power data, thereby realizing the classification of the power data. In combination with the application scenarios that can be involved in the embodiments of the present application, three categories can be optionally preset: A device state data, B user power consumption data, and C system log data.

[0036] On this basis, the feature vector of the power data can be compared with the feature vectors of known categories, the Euclidean distance can be calculated, the nearest K neighbors can be selected, and the category of the power data can be determined according to the majority voting principle. If the power data cannot be matched to an existing category, a new category (i.e., category D) can be dynamically generated according to the feature vector, thereby realizing adaptive classification.

[0037] After the plurality of power data is classified respectively, a plurality of power data sets can be obtained.

[0038] S120. For each power data set in the plurality of power data sets, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies according to the time granularity and the data volume of the power data set, and a strategy parameter of the target aggregation strategy is obtained.

[0039] The target aggregation strategy that best matches the power data set can be determined from the plurality of preset power data aggregation strategies according to the time granularity and the data volume of the power data set, and the strategy parameter of the target aggregation strategy can be obtained, thereby realizing the aggregation of the power data.

[0040] S130. The target aggregation strategy is used to aggregate each power data in the power data set based on the strategy parameter, thereby obtaining aggregated data.

[0041] The target aggregation strategy is used to aggregate each power data based on the strategy parameter, thereby obtaining aggregated data, which reduces the size of each power data.

[0042] S140. For the plurality of aggregated data obtained, the second data format of the plurality of aggregated data is converted according to the second communication protocol of the power terminal to be received, and the converted plurality of aggregated data is transmitted to the power terminal.

[0043] The second communication protocol can be understood as a communication protocol adopted by the power terminal to be received by the plurality of aggregated data. According to the second communication protocol, the second data format of the plurality of aggregated data is converted, so that the converted aggregated data can be directly processed by the power terminal.

[0044] Further, the converted plurality of aggregated data is transmitted to the power terminal.

[0045] The technical scheme of the embodiment of the present application classifies a plurality of power data corresponding to the first communication protocol and the first data format of the plurality of power data to be transmitted, to obtain a plurality of power data sets; for each power data set in the plurality of power data sets, according to the time granularity and the data volume of the power data set, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies, and the strategy parameters of the target aggregation strategy are obtained; using the target aggregation strategy, based on the strategy parameters, each power data in the power data set is aggregated to obtain aggregated data; for the obtained plurality of aggregated data, according to the second communication protocol of the power terminal to be received by the plurality of aggregated data, the second data format of the plurality of aggregated data is converted, and the converted plurality of aggregated data is transmitted to the power terminal. The above technical scheme reduces the data volume by aggregating the plurality of power data, and then converts the plurality of aggregated power data to achieve format unification. After transmitting such power data to the power terminal, the power terminal can quickly process the power data with limited data volume and unified format, thereby improving the processing efficiency of the power data.

[0046] An optional technical scheme, the above power data transmission method further comprises:

[0047] In the aggregation process, the power data in the power data set is standardized and converted to convert unstructured power data into structured data;

[0048] The quantity and quality of the structured data are checked, and if it is determined that the structured data is incorrect data or incomplete data, the structured data is repaired according to the error type or the missing type, and the repaired structured data is aggregated.

[0049] For example, the power data of the power terminal is unstructured data in the form of a log, which includes a timestamp, a device identifier, and power consumption information. These log data can be converted into a structured table form by a self-defined analysis script, each row representing a record, including explicit column names and corresponding data values, thereby realizing the conversion from unstructured to structured.

[0050] If the quantity and quality check result shows that the structured data has errors or is incomplete, a preset fault-tolerant processing mechanism is triggered to repair the structured data according to the corresponding error type or missing type, and the repaired structured data is aggregated.

[0051] For example, in the data repair process, the FP-Growth association rule mining algorithm can be used to discover the association rules and patterns between data from historical power data, such as the strong correlation between power consumption and temperature in a certain area. When the temperature rises, the power consumption will also increase accordingly. Then, using this association rule and pattern, the missing power data can be filled, for example, the power consumption of a certain day is missing, but according to the temperature record of that day, the corresponding power consumption can be inferred.

[0052] The above technical solution realizes the data structure conversion and data quality repair of power data.

[0053] Another optional technical solution transmits the converted multiple aggregated data to the power terminal, including:

[0054] According to the data receiving capacity of the power terminal and the network transmission condition, the transmission batch of the converted multiple aggregated data is determined;

[0055] Through the asynchronous sending mechanism, the converted multiple aggregated data is transmitted to the power terminal in batches based on the transmission batch.

[0056] In determining the transmission batch, the data receiving capacity of the power terminal and the network transmission condition need to be considered. By dynamically adjusting the Transmission Control Protocol (TCP) window size and data packet size, the power data transmission efficiency can be optimized to ensure transmission stability and efficiency.

[0057] The asynchronous sending mechanism can improve the flexibility and responsiveness of power data transmission. For example, during power data transmission, the asynchronous sending mechanism can be used to send the converted multiple aggregated data to the power terminal in batches, avoiding delays caused by waiting for single transmission to complete.

[0058] The above technical solution transmits power data to the power terminal in batches through the asynchronous sending mechanism, that is, through the asynchronous sending mechanism, power data can be continuously transmitted in the background, avoiding blocking the operation of the main thread.

[0059] Figure 2is a flowchart of another power data transmission method provided in the embodiments of the present application. The present embodiment is optimized on the basis of the above technical solutions. In the present embodiment, optionally, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies according to the time granularity and the data volume of the power data set, including: according to the time granularity of the power data set, using a time series analysis algorithm to perform trend prediction and periodicity analysis on each power data in the power data set to obtain time characteristics; according to the time characteristics, selecting a time window size to slice each power data in the power data set to obtain a plurality of sliced data; for each sliced data, according to the data volume of the sliced data, grouping each power data in the sliced data to obtain a plurality of data clusters; and according to the feature vectors respectively corresponding to all data clusters in the power data set, determining the target aggregation strategy from the plurality of preset power data aggregation strategies. Wherein, the same or corresponding terms as in the above embodiments are not repeated here.

[0060] Referring to Figure 2 The method of the present embodiment can specifically include the following steps:

[0061] S210. For a plurality of power data to be transmitted, the plurality of power data is classified according to the first communication protocol and the first data format respectively corresponding to the plurality of power data to obtain a plurality of power data sets.

[0062] S220. For each power data set in the plurality of power data sets, according to the time granularity of the power data set, a time series analysis algorithm is used to perform trend prediction and periodicity analysis on each power data in the power data set to obtain time characteristics.

[0063] Wherein, according to the time granularity of the power data set, a Prophet or other time series analysis algorithm is used to perform trend prediction and periodicity analysis on the power data set to obtain time characteristics. In combination with the application scenarios that the embodiments of the present application can involve, optionally, the time characteristics can include trend, seasonality and residual error, etc., which is related to the actual situation and is not limited here.

[0064] On this basis, for example, the Prophet is used to perform trend prediction on the power data set, and it is found that the electricity consumption presents an upward trend in summer and a downward trend in winter, and there is obvious daily periodic fluctuation, i.e. the electricity consumption in daytime is higher than that at night; through the analysis of the Prophet, the trend component, the seasonal component and the residual component of the power data set can be obtained, and these time characteristics provide an important basis for subsequent power data processing.

[0065] S230. According to the time characteristics, a time window size is selected to slice each power data in the power data set to obtain a plurality of sliced data.

[0066] According to the time characteristics, a suitable time window size is selected, and each power data in the power data set is sliced. For example, when the time characteristics are seasonal analysis results, a time window of "day" is selected, and each power data is divided into multiple 24-hour time periods.

[0067] S240. For each sliced data, according to the data amount of the sliced data, each power data in the sliced data is grouped to obtain multiple data clusters.

[0068] For each sliced data, that is, in each time window, each power data in the time window can be grouped according to the data amount of the power data to obtain multiple data clusters.

[0069] For example, in the power consumption data of a day, the K-means algorithm is used to divide each power data into three data clusters: peak period power consumption cluster, valley period power consumption cluster, and normal period power consumption cluster, thereby completing the automatic grouping of the power data.

[0070] S250. According to the feature vectors corresponding to all data clusters in the power data set, a target aggregation strategy is determined from the plurality of preset power data aggregation strategies, and the strategy parameters of the target aggregation strategy are obtained.

[0071] It can be understood that each power data in each data cluster has a similar feature vector, so the target aggregation strategy can be determined from the plurality of preset power data aggregation strategies according to the feature vectors corresponding to all data clusters in the power data set, and the strategy parameters of the target aggregation strategy are obtained, so that the power data aggregation process is performed by using the target aggregation strategy and the strategy parameters in the subsequent steps.

[0072] S260. Using the target aggregation strategy, the power data in the power data set is aggregated based on the strategy parameters to obtain aggregated data.

[0073] The target aggregation strategy can be understood as the power data aggregation strategy that best matches the power data set, so the target aggregation strategy can be used to aggregate the power data in the power data set based on the strategy parameters corresponding to the target aggregation strategy to obtain aggregated data.

[0074] On this basis, for example, the value range and default value of each strategy parameter can be obtained by analyzing the strategy parameters. Then, according to the aggregation requirements (such as precision and delay) of the power data set, the strategy parameters in the target aggregation strategy can be automatically adjusted within the value range by using the grid search or random search method, so that the finally applied strategy parameters match the aggregation requirements and improve the aggregation effect.

[0075] S270. For the obtained plurality of converged data, the second data format of the plurality of converged data is converted according to the second communication protocol of the power terminal to be received, and the converted plurality of converged data is transmitted to the power terminal.

[0076] The technical scheme of the embodiment of the present application realizes accurate determination of the power data convergence strategy matched with the power data set, thereby guaranteeing the power data convergence effect.

[0077] An optional technical scheme determines the target convergence strategy from the plurality of preset power data convergence strategies according to the feature vector corresponding to each data cluster in the power data set.

[0078] For each data cluster in the power data set, the time feature and the numerical feature of the data cluster are counted, and the feature vector is generated according to the time feature and the numerical feature.

[0079] The convergence strategy prediction model is obtained, wherein the convergence strategy prediction model is obtained by pre-training based on the plurality of preset power data convergence strategies.

[0080] The feature vector corresponding to each data cluster is input into the convergence strategy prediction model, and the target convergence strategy is determined from the plurality of power data convergence strategies according to the output result of the convergence strategy prediction model.

[0081] For each data cluster, the time feature and the numerical feature are counted. In this technical scheme, the numerical feature can be at least one of the mean, the variance, the maximum value, and the minimum value. On this basis, the feature vector is generated according to the time feature and the numerical feature. Further, the convergence strategy prediction model is used to accurately determine the target convergence strategy according to the feature vector corresponding to each data cluster.

[0082] Figure 3 is a flowchart of another power data transmission method provided in the embodiment of the present application. The present embodiment is optimized based on the above technical schemes. In the present embodiment, the converted plurality of converged data transmitted to the power terminal includes: establishing a plurality of independent transmission paths according to the preset network topology; monitoring the health state of each transmission path, and determining the target path from the plurality of transmission paths according to the obtained overall health state; and transmitting the converted plurality of converged data to the power terminal by using the target path. Wherein, the explanation of the same or corresponding terms as in the above embodiments is not repeated here.

[0083] Referring to Figure 3 , the method of the present embodiment can specifically include the following steps:

[0084] S310. For the plurality of power data to be transmitted, the plurality of power data is classified according to the first communication protocol and the first data format corresponding to each of the plurality of power data, to obtain a plurality of power data sets.

[0085] S320. For each of the plurality of power data sets, a target aggregation strategy is determined from a plurality of preset power data aggregation strategies according to the time granularity and the data volume of the power data set, and a strategy parameter of the target aggregation strategy is obtained.

[0086] S330. Using the target aggregation strategy, each power data in the power data set is aggregated based on the strategy parameter to obtain aggregated data.

[0087] S340. For the plurality of aggregated data obtained, the second data format of the plurality of aggregated data is converted according to the second communication protocol of the power terminal to be received.

[0088] S350. According to the preset network topology, a plurality of independent transmission paths are established, and the health status of each transmission path is monitored.

[0089] Among them, according to the preset network topology, a plurality of independent transmission paths are established to obtain redundant communication links to ensure the stability of the communication link. For example, in the power system, the power data transmission of the power terminal requires very high reliability and stability, so a network topology including three independent transmission paths is designed: transmission path A, transmission path B and transmission path C. Transmission path A is connected by optical fiber, transmission path B is connected by wireless 4G network, and transmission path C is connected by satellite communication. This multi-transmission path design ensures that when any single transmission path fails, the power system can still transmit power data through other transmission paths, thereby avoiding communication interruption.

[0090] On this basis, the health status of each transmission path is monitored. For example, a heartbeat detection mechanism can be used to determine whether the transmission path is abnormal. For example, a heartbeat detection module can be deployed on each transmission path, a heartbeat packet is sent every 5 seconds, and a timeout threshold of 30 seconds is set. If the heartbeat response of a transmission path is not received for three consecutive times, it is determined that the transmission path is abnormal.

[0091] S360. According to the obtained overall health status, a target path is determined from the plurality of transmission paths, and the converted plurality of aggregated data is transmitted to the power terminal using the target path.

[0092] Wherein, according to the obtained health states, a transmission path that has not failed and can normally transmit power data is determined from the plurality of transmission paths, and for the convenience of distinction, the transmission path is referred to as a target path here. Further, the transmission path can be used for power data transmission.

[0093] The technical scheme of the embodiment of the application guarantees the stability of the communication link, thereby guaranteeing the stability of the power data transmission, by using the multi-path redundant transmission implementation scheme.

[0094] An optional technical scheme, the power data transmission method further comprises:

[0095] For the plurality of standby paths other than the target path in the plurality of transmission paths, the health state of the target path and the health state of each standby path are monitored during the converged data transmission process using the target path.

[0096] In the case where the health state of the target path indicates that the target path has failed, a switching path is determined from the plurality of standby paths according to the health states corresponding to the plurality of standby paths, so as to continue the transmission process by switching from the target path to the switching path.

[0097] The technical scheme described above guarantees the continuous transmission of power data by monitoring the health state of each transmission path in real time, thereby automatically switching to a standby path in the case where the target path fails.

[0098] On this basis, optionally, the selection of the standby path is based on a weighted round-robin algorithm, the time delay, bandwidth and packet loss rate indicators are added to the consideration factors, the weight of each transmission path is calculated, and the standby path with the highest weight is selected as the optimal path (i.e. the switching path) for application. For example, continue with the above example, assuming that the target path is transmission path A, the time delay of transmission path B is 50 ms, the bandwidth is 10 Mbps and the packet loss rate is 1%, the time delay of transmission path C is 200 ms, the bandwidth is 5 Mbps and the packet loss rate is 0.5%. Through weighted calculation, the weight of transmission path B is higher than that of transmission path C, therefore transmission path B is selected as the optimal path for power data transmission, thereby guaranteeing the continuous transmission of power output.

[0099] Optionally, after switching to the switching path, the recovery of the target path and the switching path is continuously monitored, and when it is detected that the target path recovers normally and its quality is better than the currently used switching path, the power data transmission can be switched back to the target path. For example, after switching to transmission path B, the health status of transmission path A is detected every 1 minute, and if it is found that transmission path A recovers normally and its time delay and bandwidth indicators are better than those of transmission path B, transmission path A is switched back to transmit power data. This dynamic switching mechanism ensures that power data transmission is always carried out on the optimal path, improving transmission efficiency.

[0100] In order to better understand the above-mentioned various technical solutions and related technical solutions, the following will be exemplarily described in conjunction with an example of power terminal interconnected power data transmission.

[0101] For example, referring to Figure 4 The specific implementation process is as follows:

[0102] S1, according to the first communication protocol and the first data format of the power terminal multi-source heterogeneous data, an adaptive recognition algorithm is used for data classification, and different categories of data sets are obtained;

[0103] S2, for each data set, by analyzing its time granularity and data volume, a target aggregation strategy is selected from a preset power data aggregation strategy library, and corresponding strategy parameters are obtained;

[0104] S3, in the data aggregation process, the data is format-converted and checked according to the selected target aggregation strategy, and if data errors or incompleteness are found, a predefined fault-tolerant mechanism is triggered for data repair or retransmission;

[0105] S4, the aggregated data is converted into a standard transmission format according to the second communication protocol of the power terminal, and is transmitted to the power terminal in batches through an asynchronous sending mechanism;

[0106] S5, for the stability of the communication link, a multi-path redundant transmission scheme is adopted, when a transmission path fails, the data transmission is automatically switched to a backup transmission path.

[0107] The above examples, by adaptive identification algorithm, classify data of different communication protocols and data formats, select a target aggregation strategy according to data characteristics (i.e. time granularity and data volume), and in the aggregation process, format conversion and checking processing are performed on the data, and a fault tolerance mechanism is provided to repair errors or incomplete data. The aggregated data is converted into a standard transmission format according to the communication protocol of the power terminal, and is transmitted to the power terminal in an asynchronous multi-path manner. Thus, the intelligent aggregation and conversion of multi-source heterogeneous data of the power terminal can be effectively solved, the efficiency and reliability of data processing are improved, and thus strong support is provided for data management and analysis of the power system.

[0108] Figure 5 The power data transmission device provided by the embodiment of the present application is a structure block diagram of the device for executing the power data transmission method provided by any of the above embodiments. The device and the power data transmission method of each embodiment belong to the same inventive concept. Details not described in the embodiment of the power data transmission device can be referred to the embodiment of the power data transmission method. Referring to Figure 5 The device can specifically include: a power data set obtaining module 410, a strategy parameter obtaining module 420, an aggregated data obtaining module 430, and an aggregated data transmission module 440. Among them,

[0109] The power data set obtaining module 410 is configured to classify the plurality of power data according to the first communication protocol and the first data format corresponding to each of the plurality of power data, so as to obtain a plurality of power data sets of different categories.

[0110] The strategy parameter obtaining module 420 is configured to determine a target aggregation strategy from a plurality of preset power data aggregation strategies according to the time granularity and the data volume of the power data set, and obtain the strategy parameters of the target aggregation strategy.

[0111] The aggregated data obtaining module 430 is configured to aggregate each power data in the power data set based on the strategy parameters by using the target aggregation strategy, so as to obtain aggregated data.

[0112] The aggregated data transmission module 440 is configured to convert the second data format of the plurality of aggregated data according to the second communication protocol of the power terminal to be received, and transmit the converted plurality of aggregated data to the power terminal.

[0113] Optionally, the strategy parameter obtaining module 420 can include:

[0114] The time feature obtaining submodule is configured to perform trend prediction and periodicity analysis on each power data in the power data set according to a time series analysis algorithm based on a time granularity of the power data set, and obtain time features;

[0115] The slice data obtaining submodule is configured to select a time window size according to the time features, and slice each power data in the power data set to obtain a plurality of slice data;

[0116] The data cluster obtaining submodule is configured to group each power data in the slice data according to a data volume of the slice data to obtain a plurality of data clusters for each slice data.

[0117] The target aggregation strategy determining submodule is configured to determine a target aggregation strategy from a plurality of preset power data aggregation strategies according to a feature vector corresponding to each data cluster in the power data set.

[0118] Optionally, the target aggregation strategy determining submodule can include:

[0119] The feature vector generating unit is configured to count time features and numerical features of each data cluster in the power data set, and generate a feature vector according to the time features and the numerical features;

[0120] The aggregation strategy prediction model obtaining unit is configured to obtain an aggregation strategy prediction model, wherein the aggregation strategy prediction model is obtained by pre-training based on the plurality of preset power data aggregation strategies;

[0121] The target aggregation strategy determining unit is configured to input the feature vector corresponding to each data cluster into the aggregation strategy prediction model, and determine the target aggregation strategy from the plurality of power data aggregation strategies according to an output result of the aggregation strategy prediction model.

[0122] Optionally, the power data transmission device can further include:

[0123] The power data conversion module is configured to perform standardization conversion processing on the power data in the power data set during the aggregation processing, so as to convert the unstructured power data into structured data;

[0124] The structured data repairing module is configured to check a quantity and quality of the structured data, and if the structured data is determined to be incorrect data or incomplete data after the checking, repair the structured data according to an error type or a missing type, so as to perform the aggregation processing on the repaired structured data.

[0125] Optionally, the aggregated data transmission module 440 can include:

[0126] The transmission batch determining unit is configured to determine a transmission batch of the converted plurality of aggregated data according to a data receiving capability of the power terminal and a network transmission condition.

[0127] The aggregated data first transmission unit is configured to transmit the converted plurality of aggregated data to the power terminal in batches based on the transmission batch through an asynchronous sending mechanism.

[0128] Optionally, the aggregated data transmission module 440 can include:

[0129] The transmission path establishing unit is configured to establish a plurality of independent transmission paths according to a preset network topology structure.

[0130] The target path determining unit is configured to monitor a health state of each transmission path respectively, and determine a target path from the plurality of transmission paths according to all the obtained health states.

[0131] The aggregated data second transmission unit is configured to transmit the converted plurality of aggregated data to the power terminal by using the target path.

[0132] On this basis, optionally, the power data transmission device can further include:

[0133] The health state monitoring module is configured to monitor the health state of the target path and the health state of each standby path in the plurality of standby paths in addition to the target path in the process of transmitting the aggregated data by using the target path.

[0134] The switching path determining module is configured to determine a switching path from the plurality of standby paths according to the respective health states of the plurality of standby paths in the case that the health state of the target path indicates that the target path has failed, so as to switch from the target path to the switching path to continue the transmission process.

[0135] The power data transmission device provided by the embodiment of the present application comprises a data set obtaining module, a strategy parameter obtaining module, a converged data obtaining module and a converged data transmission module.

[0136] The power data transmission device provided by the embodiment of the present application can execute the power data transmission method provided by any embodiment of the present application, and has the function modules and beneficial effects corresponding to the execution method.

[0137] It is worth noting that, in the embodiments of the power data transmission device, each unit and module included is only divided according to the function logic, but is not limited to the above division, as long as the corresponding function can be realized; in addition, the specific name of each functional unit is only for the convenience of mutual differentiation, and does not limit the protection scope of the present application.

[0138] Figure 6 A structural schematic diagram of an electronic device 10 that can be used to implement embodiments of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptops, desktops, tablets, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular telephones, smart phones, wearable devices (such as helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not intended to limit the implementations of the present application described and / or claimed in this document.

[0139] As Figure 6As shown, the electronic device 10 includes at least one processor 11, and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., communicatively connected to the at least one processor 11, where the memory stores a computer program executable by the at least one processor. The processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or loaded into the random access memory (RAM) 13 from the storage unit 18. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0140] Various components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc., an output unit 17, such as various types of displays, a speaker, etc., a storage unit 18, such as a magnetic disk, an optical disk, etc., and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks.

[0141] The processor 11 can be various general and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs various methods and processes described above, such as the power data transmission method.

[0142] In some embodiments, the power data transmission method can be implemented as a computer program tangibly embodied in a computer readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded onto the RAM 13 and executed by the processor 11, one or more steps of the power data transmission method described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to perform the power data transmission method by any other appropriate means, such as by means of firmware.

[0143] The various embodiments of the systems and techniques described above can be implemented in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a load programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0144] Computer programs used to implement the processes of the application can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer program

[0145] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium will include one or more lines of a program of instructions in a transitory signal, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0146] To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the electronic device. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0147] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0148] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service.

[0149] It should be understood that the various forms of flow shown above can be re-ordered, added to, or deleted from without departing from the scope of the present disclosure. For example, the steps recited in the present disclosure can be executed in parallel, executed in sequence, or executed in a different order, as long as the desired results of the present disclosure are achieved, and the present disclosure is not limited herein.

[0150] The specific embodiments described above are not intended to be limiting, and persons skilled in the art will appreciate that various modifications, combinations, sub-combinations and alternatives can be made to the specific embodiments without departing from the spirit and principles of the disclosure. Accordingly, the disclosure is not limited to the specific embodiments described above, but only by the scope of the appended claims.

Claims

1. A method for transmitting power data, characterized in that, include: For multiple power data to be transmitted, the multiple power data are classified according to the first communication protocol and the first data format corresponding to each power data, so as to obtain a set of multiple types of power data; For each of the multiple types of power data sets, a target aggregation strategy is determined from a set of preset power data aggregation strategies based on the time granularity and data volume of the power data set, and the strategy parameters of the target aggregation strategy are obtained. Using the target aggregation strategy and based on the strategy parameters, the power data in the power data set are aggregated to obtain aggregated data; For the multiple aggregated data obtained, according to the second communication protocol of the power terminal to receive the multiple aggregated data, the second data format of the multiple aggregated data is converted, and the converted multiple aggregated data are transmitted to the power terminal.

2. The method according to claim 1, characterized in that, The step of determining a target aggregation strategy from a set of preset power data aggregation strategies based on the time granularity and data volume of the power data set includes: Based on the time granularity of the power data set, a time series analysis algorithm is used to perform trend prediction and periodic analysis on each power data in the power data set to obtain time characteristics; Based on the time characteristics, select the time window size, and slice each of the power data in the power data set to obtain multiple slice data; For each slice of data, the power data in the slice of data are grouped according to the data volume of the slice of data to obtain multiple data clusters; Based on the feature vectors corresponding to all the data clusters in the power data set, a target aggregation strategy is determined from a set of preset power data aggregation strategies.

3. The method according to claim 2, characterized in that, The step of determining a target aggregation strategy from a set of preset power data aggregation strategies based on the feature vectors corresponding to all data clusters in the power data set includes: For each data cluster in the power data set, the time characteristics and numerical characteristics of the data cluster are statistically analyzed, and a feature vector is generated based on the time characteristics and the numerical characteristics; Obtain a convergence strategy prediction model, wherein the convergence strategy prediction model is pre-trained based on multiple preset power data convergence strategies; The feature vector corresponding to each data cluster is input into the aggregation strategy prediction model, and the target aggregation strategy is determined from multiple power data aggregation strategies based on the output of the aggregation strategy prediction model.

4. The method according to claim 1, characterized in that, Also includes: During the aggregation process, the power data in the power data set is standardized and transformed to convert the unstructured power data into structured data. The quantity and quality of the structured data are verified. If the verification determines that the structured data is erroneous or incomplete, the structured data is repaired according to the error type or missing type, and then the repaired structured data is aggregated.

5. The method according to claim 1, characterized in that, The step of transmitting the converted aggregated data to the power terminal includes: Based on the data receiving capability of the power terminal and the network transmission status, determine the transmission batches of the converted aggregated data; Through an asynchronous transmission mechanism, multiple converted aggregated data are transmitted to the power terminal in batches based on the transmission batch.

6. The method according to claim 1, characterized in that, The step of transmitting the converted aggregated data to the power terminal includes: Based on the preset network topology, establish multiple independent transmission paths; The health status of each of the transmission paths is monitored, and the target path is determined from the multiple transmission paths based on all the obtained health statuses. Using the target path, the converted aggregated data is transmitted to the power terminal.

7. The method according to claim 6, characterized in that, Also includes: For multiple backup paths other than the target path among the multiple transmission paths, during the process of using the target path for the converged data transmission, the health status of the target path and the health status of each of the backup paths are monitored. If the health status of the target path indicates that the target path has failed, a switching path is determined from the multiple backup paths according to the health status of each backup path, so that the transmission process can be continued by switching from the target path to the switching path.

8. A power data transmission device, characterized in that, include: The power data set acquisition module is used to classify multiple power data sets to be transmitted according to a first communication protocol and a first data format corresponding to each power data set, so as to obtain multiple power data sets. The strategy parameter acquisition module is used to determine a target aggregation strategy from a set of preset power data aggregation strategies for each of the multiple power data sets, based on the time granularity and data volume of the power data set, and to acquire the strategy parameters of the target aggregation strategy. The data aggregation module is used to aggregate each power data in the power data set based on the target aggregation strategy and the strategy parameters to obtain aggregated data. The data aggregation module is used to convert the second data format of the multiple aggregated data according to the second communication protocol of the power terminal to receive the multiple aggregated data, and then transmit the converted multiple aggregated data to the power terminal.

9. An electronic device, characterized in that, include: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor to cause the at least one processor to perform the power data transmission method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute and implement the power data transmission method as described in any one of claims 1-7.

Images