Data cleaning method and cleaning engine

A data cleaning and data technology, applied in the field of data processing, can solve problems such as dirty data and large data, and achieve the effects of low redundancy, guaranteed repeatability, and high accuracy

Inactive Publication Date: 2017-01-04
ZICT TECH CO LTD
View PDF4 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In view of this, the embodiment of the present invention expects to provide a data cleaning method and a cleaning engine, which at least partially solve the problem of a large amount of dirty data in the data stored from the business system to the master data system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data cleaning method and cleaning engine
  • Data cleaning method and cleaning engine
  • Data cleaning method and cleaning engine

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] The technical solutions of the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0065] Method example:

[0066] Such as figure 1 As shown, this embodiment provides a data cleaning method, the method is applied to a cleaning engine, and the method includes:

[0067] Step S110: receiving the data to be cleaned submitted by each business system;

[0068] Step S120: Using cleaning rules to clean the data to be cleaned, and determine the cleaned data that meets the cleaning conditions;

[0069] Step S130: Send the cleaning data to the master data system.

[0070] The business system may include business systems such as an enterprise resource planning system (Enterprise Resource Planning, ERP), an automatic office system (Office Automatic, OA), a human resource system (Human Resource, HR), a financial management system FOL, a procurement business system, and Cargo clearance record system, e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data cleaning method and a cleaning engine. The method is applied to the cleaning engine and comprises the steps that data to be cleaned submitted by all service systems is received; the data to be cleaned is cleaned with cleaning rules, and clean data meeting cleaning conditions is determined; the clean data is sent to a main data system.

Description

technical field [0001] The invention relates to the field of data processing, in particular to a data cleaning method and a cleaning engine. Background technique [0002] With the development of information technology and electronic technology, organizations such as enterprises or non-enterprise groups adopt digital office, which will form a large data system. These data systems usually have a database. If the data formed during various uses are directly stored in the database, it will usually result in high data redundancy, low accuracy, and indistinguishable authenticity and false data in the database. Contains various dirty data and other issues. Contents of the invention [0003] In view of this, the embodiment of the present invention expects to provide a data cleaning method and a cleaning engine, which at least partially solve the problem of a large amount of dirty data in data stored from a business system to a master data system. [0004] In order to achieve the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/215
Inventor 贺毅刚韩小军陈亚李韬
Owner ZICT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products