Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Visual multi-database ETL integration method and system

An integration method and integrated system technology, applied in the field of database integration development and database operation optimization, can solve the problems of client diversity affecting integration efficiency, lower database operation efficiency, and low database query efficiency, and achieve fast data query and transfer , reduce complexity, and reduce risk

Inactive Publication Date: 2015-09-16
SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
View PDF4 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, although database integration methods exist, on the one hand, the degree of integration of such methods is not high, and the efficiency of database query after integration is low; When the data tables and fields are more complex and numerous, it not only takes a lot of time to configure, but also is prone to errors
[0003] At present, the main difficulties are the integration of multiple databases, the optimization of data migration process, and the efficiency of integration of different databases.
Due to different architectures, multi-database integration requires a variety of technical support; the data migration process is affected by the magnitude of the data, and a large amount of data migration will reduce the operating efficiency of the database and affect the use of the database; the diversity of clients will affect the integration efficiency. There are multi-channel transmission between clients, client and database, which will cause low transmission efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual multi-database ETL integration method and system
  • Visual multi-database ETL integration method and system
  • Visual multi-database ETL integration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0038] ETL (Extract, Transform, Load) includes data extraction, transformation and loading. This method uses a graphical human-computer interaction interface to configure multiple data sources, and then obtains data from these source databases according to a certain ETL logic method, and after conversion, loads them into the target data for processing. The operating efficiency of ETL logic method will be optimized and decomposed according to the characteristics of SQL language of different types of databases.

[0039] The present invention completes the configuration of multiple data sources through a graphical human-computer interaction interface, obtains data from a source database by configuring ETL rules, loads data into a target database for processing after conversion, and completes data integration. Specific steps are as follows:

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a visual multi-database ETL integration method and system. The visual multi-database ETL integration method includes the following steps that source databases and target databases are connected; the SQL statements of source lists of the source databases are obtained through ETL matching of the source databases and the target databases; the SQL statements are optimized and executed, and the ETL data of the multiple source databases are obtained and introduced into target lists of the target databases. The visual multi-database ETL integration system comprises a database management system layer and a semantic layer, the database management system layer connects the source databases with the target databases, and the SQL statements of the source lists of the source databases are obtained through ETL matching of the source databases and the target databases; the semantic layer optimizes and executes the SQL statements, obtains the ETL data of the multiple source databases and introduces the ETL data to the target lists of the target databases. The visual multi-database ETL integration method and system reduce the complexity degree of integration of the multiple databases, improve the integration efficiency of the multiple databases, and reduce the risk of integration of the multiple databases.

Description

technical field [0001] The invention relates to the fields of database integration development and database operation optimization, and is an integration method and system for realizing various database integration, data extraction and injection through graphical interface configuration. Background technique [0002] With the rapid development of information technology, database applications are becoming more and more extensive. Due to the different business and functional affiliations of departments, different database environments are used in the development of application systems, which brings great difficulties to practical applications. The integrated application technology of multiple databases It has always been a difficult problem. Multi-data application technology includes the application of software system integration, database visualization, and data analysis algorithms. At present, although database integration methods exist, on the one hand, the degree of integr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 王巍宋宏吕希胜刘昶原文斌姚丽丽
Owner SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products