Data processing method and device

Abstract

The embodiment of the invention provides a data processing method and device. The data processing method comprises the steps: obtaining to-be-processed time series data, and dividing the time series data into first time series data and second time series data; coding the first time sequence data based on a dictionary coding algorithm to generate a first coded value; coding the second time sequence data based on a column compression algorithm to generate a second coded value; and generating processed time sequence data according to the first coded value and the second coded value. According to the data processing method, the time sequence data is divided into two parts according to the data type, and the compression coding method corresponding to each part of time sequence data is adopted to perform compression coding on the time sequence data, so that the size of the time sequence data is greatly reduced, the occupation of the time sequence data on the storage space of the database is reduced, and the data volume of the time sequence data written into the database is increased.

Description

technical field [0001] The embodiments of this specification relate to the technical field of data processing, and in particular, to a data processing method. One or more embodiments of this specification also relate to a data processing apparatus, a computing device, and a computer-readable storage medium. Background technique [0002] Time series data (English full name: Time Series Data) is defined as a series of data indexed by time dimension, and can also be understood as detection data based on a series of indicators continuously generated at a stable frequency, for example, when detecting the air quality of a city , a series of data generated by collecting a value of sulfur dioxide concentration per second; in various applications, it is necessary to store such time-series data persistently in the database for querying. The way of storing time-series data in the prior art usually uses The collected original time-series data is stored in the database. This storage met...

AI Technical Summary

Problems solved by technology

[0002] Time series data (English full name: Time Series Data) is defined as a series of data indexed by time dimension, and can also be understood as detection data based on a series of indicators continuously generated at a stable frequency, for example, when detecting the air quality of a city , a series of data generated by collecting a value of sulfur dioxide concentration per second; in various applications, it is necessary to store such time-series data persistently in the database for querying. The way of storing time-series data in the prior art usually uses The collected original time-series data is stored in the database. This storage method will make the time-series data occupy a large storage space. When storing massive time-series data for a long time, directly storing the original time-series data will also cause waste of storage space.

Images