Distributed data source data integration system and method

Abstract

The invention discloses a data integrating system and method for distributed data source, dynamically managing data integration application by a manager, analyzing external data integration application into internal data integration task and returning the final result set of the data integration task to the external data integration application by an application analyzer, managing the distributed data source in the system by a data source manager to allocate data integration task, converting the isomerous data source-oriented inquiry instruction form and function in the data integration task by an inquiry converter, and implementing communication between the system and a data source-side collector by a communication interphone. The invention provides the low-cost, high-efficiency and flexible application of data integration, also determines the feasibility in the data applications, such as network data exchange, data integration, etc., and has an important social and economic benefits.

Description

technical field [0001] The present invention relates to a field of data integration technology related to distributed data storage technology and network computing technology, and more particularly to a distributed data source data integration system and method. Background technique [0002] With the rapid development of informatization work in various industries in our country, most industries and enterprises have built internal information systems and accumulated a large amount of data in the process of development. Because enterprises often have many branches, distributed in different regions, using different systems, using different operating platforms, data information is stored in different databases, each database adopts different structural designs, and there are differences in data tables and field definitions. This leads to many problems in sharing information. Since each data source is scattered in various places, data integration cannot be realized through a loc...

AI Technical Summary

Problems solved by technology

[0004] 1. To build a central database, you need to pay a high database software fee;

[0005] 2. All data is stored in the central database. With the rapid expansion of data volume, the corresponding storage hardware costs are huge;

[0006] 3. The central database needs to consume a lot of system resources to achieve data synchronization with distributed data sources;

[0007] 4. The application of data facing the central database is unpredictable, resulting in a low utilization rate of data stored in the central database;

[0009] 6. The maintenance of distributed data sources is cumbersome. When the number and physical location of data sources change, the central database needs to perform a large number of operations;

[0010] 7. Data integration application calculations are concentrated in the central database, which puts a lot of pressure on the data center hardware

Images