Time series data completion method, device and electronic equipment

Abstract

The invention discloses a time series data complement method, device and electronic equipment. The method includes: constructing a data set according to a set format for the collected data, and the data set contains at least one series of data; The time point to be completed is inserted into the data set; the data set at the inserted time point is repartitioned according to the series, and the data of the same series are put into the same partition; the data in the partition is sorted to obtain the data list; Traverse the data in the partition and complete the data. Under the distributed computing framework, this method completes the missing time series data forward or backward. When performing data completion, only a small number of variables need to be traversed once to complete the data completion.

Description

technical field [0001] The present invention relates to the field of computer technology, and more specifically, to a time series data completion method, device and electronic equipment. Background technique [0002] With the rapid development of computer science technology, Internet technology, and Internet of Things technology, the amount of information has exploded, and it is becoming more and more difficult to find useful information, and it is becoming more and more difficult to process all the required data in one server. It is getting more and more difficult, and the emergence of distributed computing framework just solves this problem, so that data can be distributed in different servers and processed in parallel, thus solving the performance bottleneck of a single server. [0003] Time series refers to the sequence of the values ​​of the same indicator arranged in chronological order, which exists in large quantities in human society and nature, such as financial da...

AI Technical Summary

Problems solved by technology

[0004] The current time series similarity method is mainly aimed at the situation where there is no missing data, but in the application of actual scenarios, it is impossible to ensure that there is data at every moment

For example, in the application of the Internet of Things, there may be multiple devices, and the sampling time of each device cannot be guaranteed to be exactly the same. If the sampling time of one of the devices is used as the benchmark to analyze other devices, there will be a large number of time series missing value

Images