Real-time data aggregation method and system

Abstract

The embodiment of the invention provides a real-time data aggregation method and system. The method comprises the steps of receiving a convergence strategy sent by a superior convergence node, takingthe to-be-converged data corresponding to the current moment as target data; if the real-time requirement exists in the target data and the redundancy removal identifier in the convergence strategy isredundancy removal, determining a data compression algorithm and a redundancy elimination algorithm corresponding to the target data according to the shortest time principle; carrying out redundancyelimination and compression on the target data by utilizing a redundancy elimination algorithm and a data compression algorithm corresponding to the target data when a convergence opportunity is reached; and packaging the compressed target data and the data compression algorithm identifier corresponding to the target data, and sending the packaged target data and the data compression algorithm identifier to a superior aggregation node, so that the superior aggregation node decompresses the compressed target data. According to the method and the system, the current aggregation node can transmitthe to-be-aggregated data to the superior aggregation node within the specified time delay, so that the real-time requirement of the to-be-aggregated data can be met, and the aggregation capability of the whole aggregation system can be improved.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of communications, and more specifically, to a method and system for real-time data aggregation. Background technique [0002] Data aggregation is the process of converging the data of the data source upwards to the data aggregation center through the aggregation node. In the existing data aggregation methods, each aggregation node transmits the data from the data source to the data aggregation center in a uniform manner when aggregating data (for example, before data transmission, either compress all the transmitted data, or All transmitted data is not compressed), this method does not consider the characteristics of the data to be transmitted, cannot effectively guarantee the real-time requirements of data transmission, and is not suitable for scenarios with limited computing resources, network resources, and storage resources. However, in some specific networks, there are high r...

AI Technical Summary

Problems solved by technology

[0004] The embodiments of the present invention overcome that the existing data aggregation methods cannot be applied to scenarios with high requirements for real-time data, nor can they be applied to the limited computing resources and / or network resources and / or storage resources required for data aggregation. For the problem of the scene, provide a real-time data aggregation method and system

Images