Data quality detection method and device based on time series data and storage device

Abstract

The invention provides a data quality detection method and device based on time series data and a storage device. The data quality detection method comprises the steps of receiving to-be-detected timeseries data at a current moment; judging whether the number of periods contained in the to-be-detected time series data is smaller than or equal to a threshold value or not; if so, detecting the to-be-detected time series data by using a short-period detection method; and otherwise, detecting the to-be-detected time series data by using a long-period detection method. In this way, the proper detection method can be selected according to the number of periods of the to-be-detected time series data.

Description

technical field [0001] The present application relates to the technical field of data detection, in particular to a data quality detection method, detection device and storage device based on time series data. Background technique [0002] Data quality refers to the extent to which data meets user needs and the degree of perfection in terms of completeness, validity, and consistency in a business environment. At present, in the big data computing platform, some data quality detection methods can be adopted to monitor the real-time data quality (for example, missing data, data outliers, etc.) of the data collected on the platform. However, some existing data quality detection methods only consider short-period data quality detection, and do not involve abnormalities in long-period and large-volume data. Contents of the invention [0003] The technical problem mainly solved by this application is to provide a data quality detection method based on time series data, a detect...

AI Technical Summary

Problems solved by technology

However, some existing data quality detection methods only consider short-term data quality detection, and do not deal with abnormalities in long-term and large-scale data.

Images