Saving method and system for time series data based on key value database

Abstract

The invention provides a saving method and system for time series data based on a key value database. The method comprises the steps that S1, original time series data collected by a sensor is obtained, the original time series data comprises a plurality of attributes, and the attributes comprise an equipment number, a sensor number, a sampling time, a receiving time and a measuring value; S2, according to the sampling time, the original time series data is divided into a corresponding time partition, and time partition information of the original time series data is obtained; S3, the multipleattributes and the time partition information are combined to generate target time series data; S4, the equipment number, the sensor number and the time partition information are taken as first levelindexes, the sampling time is taken as a second level index, and the target time series data is saved in the key value database. According to the saving method and system for the time series data based on the key value database, the time partition information is introduced, the method and the system can adapt to different data sizes, data reading of non-query target is reduced, and a better timeseries data query performance is obtained on the basis of assurance of high-performance data writing.

Description

technical field [0001] The present invention relates to the technical field of computer data management, and more specifically, to a method and system for storing time series data based on a key-value database. Background technique [0002] The data that needs to be processed in the industrial field usually has multiple attributes, such as the data observed by the sensors in the field of vehicle equipment. Each piece of data generated by the GPS sensor in the mobile device includes attributes such as sampling time, device number, latitude and longitude, and altitude. Users will query these data, such as querying the data of certain devices, certain sensors, and certain time periods. The time series data storage system needs to quickly find the required data according to the user's query request. [0003] Time-series data in the industrial field generally has the characteristics of fast collection frequency and large data volume. Taking the field of vehicle equipment as an...

AI Technical Summary

Problems solved by technology

[0007] The present invention provides a method and system for storing time-series data based on a key-value database, which overcomes the problem of being unable to effectively store and query massive time-series data in the prior art

Images