Method for judging self-given delay repeatability of streaming data in real time

Abstract

The autocorrelation of a given delay may be used to determine the repeatability of the time series or streaming data's own given delay. The invention discloses a method, a system and a computing system program product which can judge repeatability of time series or streaming data self-given delay in real time by iteratively computing self-correlation of appointed delay of a computing window of a given scale. Embodiments of the present invention include iteratively calculating two or more components of an autocorrelation of a specified delay of a post-adjustment calculation window based on thetwo or more components of the autocorrelation of the specified delay of the pre-adjustment calculation window, and then generating the autocorrelation of the specified delay of the post-adjustment calculation window based on the two or more components that need to be iteratively calculated. Iterative computation autocorrelation avoids accessing all data elements in the adjusted computation windowand executing repeated computation, so that the computation efficiency is improved, computation resources are saved, and the energy consumption of a computation system is reduced; therefore, the real-time judgment of the self-given delay repeatability of the streaming data is efficient and low in consumption, and some scenes of real-time judgment of the self-given delay repeatability of the streaming data become possible.

Description

technical field [0001] Big data or streaming data analytics. Background technique [0002] The Internet, mobile communications, navigation, online games, sensor technology and large-scale computing infrastructure generate massive amounts of data every day. Big data is data that exceeds the processing capability of traditional database systems and the analysis capabilities of traditional analysis methods due to its huge scale, rapid change and growth rate. [0003] Streaming data is data that is continuously sent and received continuously by a provider. Streaming data can be real-time data collected from sensors and continuously transmitted to computing devices or electronic devices. Typically this involves receiving data elements in the same format successively divided by time intervals. Streaming data can also be data that is continuously read from storage devices, that is, large data sets stored on one or more storage devices. [0004] Autocorrelation, also known as de...

AI Technical Summary

Problems solved by technology

Using traditional methods to recalculate autocorrelation on stream data after some data changes cannot achieve real-time processing and takes up and wastes a lot of computing resources, which also makes some real-time judgments on the repeatability of the given delay of stream data itself unable to meet the requirements.

Images