Database conversion and cleaning information processing method

An information processing method and database technology, which is applied in the field of database conversion and cleaning information processing, can solve problems such as high cost and complicated use, and achieve the effect of ensuring consistency and integrity and avoiding data duplication and omission
CN102411569AInactive Publication Date: 2012-04-11上海众融信息技术有限公司
6 Cites 12 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
上海众融信息技术有限公司
Publication Date
2012-04-11
Estimated Expiration
Not applicable · inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention relates to a database conversion and cleaning information processing method, which comprises the following steps of: 1) connecting a target database to a data source; 2) selecting a target data table to be cleaned in the target database; 3) selecting an update mode, executing the fourth step if the incremental update is adopted, and executing the tenth step if the total update is adopted; 4) obtaining the maximum update time last_update in the target data table, and defaulting the last_update as the set time if the target data table is null; 5) screening all records with the update time greater than the last_update in the data source to a temporary table temp_table; 6) deleting repeated records in the temp_table by restraining fields in the target data table; 7) comparing the target data table and the temp_table and obtaining the records of the temp_table in the target data table, and the like. Compared with the prior art, the method has the advantages that the problems of data repetitiveness and omission in the data cleaning process are effectively avoided, the data consistency and the completeness are ensured, and the like.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to a database-related technology, in particular to a database conversion and cleaning information processing method. Background technique

[0002] Data cleaning and transformation, also known as ETL (Extract, Transform, Load), is a problem that often needs to be solved in the field of databases, especially in the field of data warehouses. ETL is responsible for extracting data from distributed and heterogeneous data sources such as relational data, flat data files, etc. to the temporary middle layer for cleaning, conversion, integration, and finally loading into the target database (data warehouse, data mart, etc.), Become the foundation of online analytical processing and data mining.

[0003] Although there are many professional tools for data cleaning on the market, such as Datastage of Ascential, Powercenter of Informatica, ETL Automation of NCR Teradata, etc., most of these tools are powerful, but their use is also relativel...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More