Time series data processing method and device

Abstract

The embodiment of the invention discloses a time series data processing method and device. The method comprises the steps of obtaining time series data; extracting time information from the time sequence data, and converting an original time format corresponding to the time information into a preset time format; extracting application program information carried by the time sequence data; judgingwhether a user-defined analysis rule matched with the program information is stored or not; if so, extracting a key field and a field value corresponding to the key field from the time series data according to a self-defined analysis rule to obtain a field value pair; if not, extracting a key field and a field value corresponding to the key field from the time series data according to a built-in regular expression rule to obtain a field value pair; and associatively storing the time information converted into the preset time format and the field value pair. The fields in the unstructured dataare extracted and converted into the unified format, subsequent query statistics is facilitated, and the purpose of saving calculation space and query time is achieved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method and device for processing time series data. Background technique [0002] With the rapid development of information technology, people's social activities and various economic activities are more closely related to big data, such as the large amount of data generated by enterprises in Internet Technology (IT) monitoring, system operation and maintenance, temperature, industrial sensor Data, massive transaction data generated by various trading systems (such as securities trading systems, e-commerce trading systems, etc.), these big data often have high commercial value and need to be used for analysis. However, due to the different data formats of the data However, it is difficult to be directly used for analysis and utilization. [0003] Time series data is a common data form in big data. It is an unstructured data that contains timestamp information. The data ...

AI Technical Summary

Problems solved by technology

At present, the more common methods on the market to convert unstructured data into structured data are often aimed at a certain data format, and it is difficult to convert time series data with diverse data formats into structured data in a unified data format

It can be seen that the existing data format conversion methods are difficult to convert time series data into structured data in a unified data format

Images