Automatic pre-processing method for time series

Abstract

The invention discloses an automatic pre-processing method for time series. The method comprises the following steps: performing rank scanning on to-be-processed time series; extracting data pattern characteristics from the processed time series; performing pre-processing element combination establishment according different pattern characteristics and states obtained by processing; and performing evaluation on data quality of data cleaning according to the result of the preprocessing element combination. The technical problems of complicated automatic preprocessing process, influence on later-period data mining by the preprocessing parameter regulations and unpredictable prediction results caused by time-space granularity selections in the existing method can be solved by the automatic pre-processing method for the time series.

Description

technical field [0001] The invention belongs to the technical field of big data, and more specifically relates to a time series automatic preprocessing method. Background technique [0002] The development of information technology and the Internet has produced massive amounts of data, providing a basis for intelligent decision-making in various industries. Since the time series reflects the patterns, anomalies and trends of data changes over time, users can discover system anomalies, mine behavior patterns, and predict future states. The single time series itself is time-sensitive, the data format and value standard have great changes, and there are also missing, abnormal and inconsistent situations. Therefore, the preprocessing of time series data is extremely important. The existing time series preprocessing is basically done manually, and the workload in big data analysis and processing reaches or even exceeds 80%. In fact, with the development of the Internet, time-s...

AI Technical Summary

Problems solved by technology

[0008] In view of the above defects or improvement needs of the prior art, the present invention provides a time series automatic preprocessing method, the purpose of which is to solve the complex automatic preprocessing process existing in the existing method, and the adjustment of preprocessing parameters will affect the later data mining. , the technical problem that the selection of spatio-temporal granularity produces unpredictable results

Images