Data cleaning method and related apparatus

Abstract

A data cleaning method, applied to a data cleaning process in the technical field of artificial intelligence (AI). In the data cleaning method, for a dataset requiring cleaning, the type of a task for which the dataset is used upon cleaning is first determined, and then a cleaning operation for the dataset is determined on the basis of the type of the task. On the basis of the specific cleaning mode corresponding to the cleaning operation, the dataset can be analyzed, so as to determine a cleaning condition for the dataset on the basis of the analysis result of the dataset, thereby achieving cleaning of the dataset. In this way, cleaning conditions for data are defined on the basis of the characteristics of the task to which the dataset is applied and the analysis result of the data in the dataset, so that targeted data cleaning can be achieved on the basis of the most fundamental data cleaning objective and the inherent characteristics of the data, thereby improving the accuracy of data cleaning, ensuring that data cleaning can be completed in a single pass, and thus improving data cleaning efficiency.

Images