Automatic pre-processing method for time series

A time series and preprocessing technology, applied in the field of big data, can solve the problems of automatic preprocessing process, complex preprocessing parameter adjustment, data mining time and space granularity selection, etc.

Active Publication Date: 2016-03-23
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In view of the above defects or improvement needs of the prior art, the present invention provides a time series automatic preprocessing method, the purpose of which is to solve the complex automatic preprocessing ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic pre-processing method for time series
  • Automatic pre-processing method for time series
  • Automatic pre-processing method for time series

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0072] The present invention mainly comprises four processes:

[0073] Data cleaning: Data cleaning is mainly to find and solve obvious errors such as missing data, data noise, field misalignment, and format errors, and remove overly sparse attributes to provide pure and error-free raw data for the next step of preprocessing.

[0074] Pattern extraction: pattern extraction is to apply statistic...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automatic pre-processing method for time series. The method comprises the following steps: performing rank scanning on to-be-processed time series; extracting data pattern characteristics from the processed time series; performing pre-processing element combination establishment according different pattern characteristics and states obtained by processing; and performing evaluation on data quality of data cleaning according to the result of the preprocessing element combination. The technical problems of complicated automatic preprocessing process, influence on later-period data mining by the preprocessing parameter regulations and unpredictable prediction results caused by time-space granularity selections in the existing method can be solved by the automatic pre-processing method for the time series.

Description

technical field [0001] The invention belongs to the technical field of big data, and more specifically relates to a time series automatic preprocessing method. Background technique [0002] The development of information technology and the Internet has produced massive amounts of data, providing a basis for intelligent decision-making in various industries. Since the time series reflects the patterns, anomalies and trends of data changes over time, users can discover system anomalies, mine behavior patterns, and predict future states. The single time series itself is time-sensitive, the data format and value standard have great changes, and there are also missing, abnormal and inconsistent situations. Therefore, the preprocessing of time series data is extremely important. The existing time series preprocessing is basically done manually, and the workload in big data analysis and processing reaches or even exceeds 80%. In fact, with the development of the Internet, time-s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/215G06F2216/03
Inventor 莫益军
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products