Data filling method and system

Abstract

The invention discloses a data filling method. The data filling method includes determining missing data of database according to existing data in the database and setting up data dependence relation among all data in the database; repeating the following steps until all the missing data of the database is filled up, determining deducible data and at least one group non-deducible data in the missing data of the database according to the existing data of the database and the data dependence relation, determining a group of data to be retrieved from the non-deducible data according to the preset rules, deducing and filling the deducible data according to the existing data of the database and the data dependence relation, and retrieving the external resource of the database and filling the data to be retrieved. Thus, by alternating executing deduction and retrieval, the missing data of the database can be filled up in high efficiency and high quality, and high data filling accuracy can be obtained under low system cost.

Description

technical field [0001] The present application relates to the technical field of database processing, in particular to a data filling method and system. Background technique [0002] Usually, in the data sources of various databases, there are often some vacant information, some are caused by the lack of original data, and some are caused by operational errors. The vacant information in these databases will cause data incompleteness, which is a relatively common problem in various databases. The data filling technology is proposed to estimate, predict, or retrieve the vacant information in the data source through some technical means. [0003] Existing data filling methods for string data can generally be divided into two categories: data filling methods based on reasoning and data filling methods based on retrieval. [0004] Inference-based data filling methods mainly combine some given data quality rules (such as Functional Dependencies attribute dependencies) to infer th...

AI Technical Summary

Problems solved by technology

[0006] However, the main disadvantage of the inference-based data filling method is reflected in the filling of the only vacant information, that is, if the information corresponding to the vacant information does not appear in the complete part of the data set, then it is impossible to infer and fill accurately. This vacancy information leads to a low accuracy rate of data filling; while the retrieval-based data filling method can accurately fill vacancy information and improve the accuracy rate of data filling, but it needs a large number of external resources when retrieving vacancy information. The retrieval query, which will generate a large number of retrieval query operations, correspondingly will cause a large system overhead

Images