Unlock instant, AI-driven research and patent intelligence for your innovation.

Improvement on data extraction method

A data extraction and database technology, applied in the field of synchronizing data between different databases, can solve the problems of source table structure data extraction failure, cumbersome manual processing, etc.

Inactive Publication Date: 2020-02-04
南京我爱我家信息科技有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing technology, during the process of data ETL processing, the structure of the source table often changes, and there are special types of fields in the source table structure, which lead to the failure of data extraction. However, the current mainstream ETL tools require cumbersome manual processing to solve the problem. Such problems, so it is necessary to improve the ETL method for synchronizing data between different databases

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Improvement on data extraction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] The present invention will be further described below in conjunction with specific examples, but the present invention is not limited to these specific implementations. Those skilled in the art will realize that the present invention covers all alternatives, modifications and equivalents as may be included within the scope of the claims.

[0022] An improvement on data extraction methods such as figure 1 The following steps are shown:

[0023] Step 1: Obtain the table structure of the source database. Query the dictionary table of the source database to obtain the table structure of the source database; the table structure of the source database includes information such as user name, table name, field name, field type, field length, and field order.

[0024] Step 2: Compare the table structure of the target database to obtain whether there is any difference. Query the dictionary table of the target database to obtain the table structure of the target database. The t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an improvement on a data extraction method. The improvement on the data extraction method comprises the following steps of 1, obtaining a source database table structure; 2, comparing the table structure of a target database, and obtaining whether there is difference or not; 3, updating a target database table structure; 4, judging whether type shielding exists or not; 5, loading a shielding type; 6, extracting data and 7, completing the extraction task. By improving the data extraction method, synchronous updating of different source data table structures is achieved, the data type of the source system can be shielded in a user-defined mode, and all fields involved in the BLOB type of the source system can be shielded automatically.

Description

technical field [0001] The invention relates to a method for synchronizing data between different databases, in particular to the optimization of an ETL method for synchronizing data between different databases. Background technique [0002] In the environment where databases are widely used, data synchronization technology between databases is an important method to maintain data consistency between database nodes. Among them, it includes the need for data synchronization between a large number of heterogeneous databases. Therefore, it often involves processing a large amount of heterogeneous data, and the process of data extraction, transformation, and loading (Extract-Transform-Load, ETL) is an important link. [0003] In the existing technology, during the process of data ETL processing, the structure of the source table often changes, and there are special types of fields in the source table structure, which lead to the failure of data extraction. However, the current ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/27
CPCG06F16/254G06F16/27
Inventor 李东升
Owner 南京我爱我家信息科技有限公司
PatSnap Eureka logo

PatSnap Eureka turns technology decisions into work you can execute. Powered by our Innovation Knowledge Graph, it runs expert workflows across engineering, life sciences, materials and intellectual property. Get your review-ready output in minutes.

X (Twitter)LinkedInYouTubeSubstack

© 2026 PatSnap. All rights reserved. 

Terms of Service

 | 

Privacy policy

 | 

Modern Slavery Act Transparency Statement