Distributed data source data integration system and method

Abstract

The invention discloses a data integrating system and method for distributed data source, dynamically managing data integration application by a manager, analyzing external data integration application into internal data integration task and returning the final result set of the data integration task to the external data integration application by an application analyzer, managing the distributed data source in the system by a data source manager to allocate data integration task, converting the isomerous data source-oriented inquiry instruction form and function in the data integration task by an inquiry converter, and implementing communication between the system and a data source-side collector by a communication interphone. The invention provides the low-cost, high-efficiency and flexible application of data integration, also determines the feasibility in the data applications, such as network data exchange, data integration, etc., and has an important social and economic benefits.

Description

technical field [0001] The invention relates to the technical field of data integration related to distributed data storage technology and network computing technology, and more particularly to a data integration system and method applied to distributed data sources. Background technique [0002] With the rapid development of informatization work in all walks of life in my country, most industries and enterprises have built internal information systems and accumulated a large amount of data in the process of development. Because enterprises often have many branches, which are distributed in different regions, use different systems, use different operating platforms, store data information in different databases, each database adopts different structural designs, and there are differences in the definitions of data tables and fields. This leads to many problems when sharing information. Since each data source is scattered in various places, data integration cannot be realize...

AI Technical Summary

Problems solved by technology

[0004] 1. To build a central database, you need to pay a high database software fee;

[0005] 2. All data is stored in the central database. With the rapid expansion of data volume, the corresponding storage hardware costs are huge;

[0006] 3. The central database needs to consume a lot of system resources to achieve data synchronization with distributed data sources;

[0007] 4. The application of data facing the central database is unpredictable, resulting in a low utilization rate of data stored in the central database;

[0009] 6. The maintenance of distributed data sources is cumbersome. When the number and physical location of data sources change, the central database needs to perform a large number of operations;

[0010] 7. Data integration application calculations are concentrated in the central database, which puts a lot of pressure on the data center hardware

Images