A loading method of time series big data

Abstract

The invention discloses a time series big data loading method. The method comprises the following steps of: S1, obtaining a table scanning request command so as to obtain table information and a query condition; S2, analyzing the table information and the query condition so as to obtain measure points involved by table scanning, obtaining address information of machines where the measure points involved by the table scanning is located through querying metadata of a time series database, dividing the measure points of the same machine into a measure point group according to the address information of the machine where each measure point is located, and establishing a table scanning request sub-command for each measure point group; and S3, executing all the table scanning request sub-commands so as to obtain time series data. According to the time series big data loading method disclosed by the invention, the network bandwidth consumption and data transmission time consumption required by the query of the time series data are reduced, so that the bottleneck of network transmission is eliminated and the performance of querying the time series data is enhanced on the whole.

Description

technical field [0001] The invention relates to the field of big data, in particular to a loading method of time series big data. Background technique [0002] With the continuous development of industrialization and informatization, large-scale process industry enterprises will generate more and more massive historical time series data in the process of production informatization. Taking the power system as an example, on the one hand, the scale of measuring points is getting bigger and bigger, and it is expected to reach tens of millions or even more than one hundred million; This puts forward higher requirements on the processing scale and processing speed of the time series database. [0003] In recent years, application systems in the electric power industry use big data technology to realize data storage, data analysis and data mining. As one of the important data in the power industry, time series data must be accessible in a big data environment to ensure the busin...

AI Technical Summary

Problems solved by technology

[0004] The present invention aims at the problem that when the time-series database connector does not support localized calculations, when the time-series database connector reads time-series data, the network transmission will easily become a bottleneck and affect the query performance of time-series data, and proposes a time-series big data solution. loading method

Images