Visual multi-database ETL integration method and system

Abstract

The invention provides a visual multi-database ETL integration method and system. The visual multi-database ETL integration method includes the following steps that source databases and target databases are connected; the SQL statements of source lists of the source databases are obtained through ETL matching of the source databases and the target databases; the SQL statements are optimized and executed, and the ETL data of the multiple source databases are obtained and introduced into target lists of the target databases. The visual multi-database ETL integration system comprises a database management system layer and a semantic layer, the database management system layer connects the source databases with the target databases, and the SQL statements of the source lists of the source databases are obtained through ETL matching of the source databases and the target databases; the semantic layer optimizes and executes the SQL statements, obtains the ETL data of the multiple source databases and introduces the ETL data to the target lists of the target databases. The visual multi-database ETL integration method and system reduce the complexity degree of integration of the multiple databases, improve the integration efficiency of the multiple databases, and reduce the risk of integration of the multiple databases.

Description

technical field [0001] The invention relates to the fields of database integration development and database operation optimization, and is an integration method and system for realizing various database integration, data extraction and injection through graphical interface configuration. Background technique [0002] With the rapid development of information technology, database applications are becoming more and more extensive. Due to the different business and functional affiliations of departments, different database environments are used in the development of application systems, which brings great difficulties to practical applications. The integrated application technology of multiple databases It has always been a difficult problem. Multi-data application technology includes the application of software system integration, database visualization, and data analysis algorithms. At present, although database integration methods exist, on the one hand, the degree of integr...

AI Technical Summary

Problems solved by technology

At present, although database integration methods exist, on the one hand, the degree of integration of such methods is not high, and the efficiency of database query after integration is low; When the data tables and fields are more complex and numerous, it not only takes a lot of time to configure, but also is prone to errors

[0003] At present, the main difficulties are the integration of multiple databases, the optimization of data migration process, and the efficiency of integration of different databases.

Due to different architectures, multi-database integration requires a variety of technical support; the data migration process is affected by the magnitude of the data, and a large amount of data migration will reduce the operating efficiency of the database and affect the use of the database; the diversity of clients will affect the integration efficiency. There are multi-channel transmission between clients, client and database, which will cause low transmission efficiency

Images