Data integration system and method

Abstract

The invention provides a data integration system and method. The data integration system comprises an initialization module, an adaption module, a verifying module, a persistence module and a monitoring module, wherein the initialization module obtains data from different data sources; the adaption module receives data from the initialization module and provides data with a standard data format; the verifying module receives the data with standard data format from the adaption module, verifies the integrity and correctness of the data with standard data format and filters the data not meeting the requirement out; the persistence module performs the persistence of the verified data on a database; and the monitoring module monitors the integration condition of each datum in the data integration system. The system provided by the invention does not adopt any of two data integration modes simply, namely data file integration and data real integration, but organically integrates the two modes; and the system can adapt to the data integration demands of various conditions flexibly and provide flexible horizontal and vertical expansion functions as possible.

Description

technical field [0001] The present invention relates to a data integration system and method, in particular to a data integration system and method capable of providing data in a standard data format. Background technique [0002] As we all know, information in today's enterprises is developing rapidly, and technology is changing with each passing day. However, although various information construction and natural continuation have achieved considerable benefits, they have also created information islands, hindering further information use and greater integration benefits. In order to block information separatism and improve the operating efficiency of information systems, data integration technology has become a technology of concern to various enterprises. Data integration technology can communicate the data of various information islands, integrate the isolated information together, and form the information that the final enterprise needs. [0003] In the data integrati...

AI Technical Summary

Problems solved by technology

[0011] 1. The two data integration methods have their own disadvantages: for the data file integration method, after an error occurs during the integration process, it can only be processed again; for the timely data integration method, the processing capacity of the processing program is limited by the machine itself, and the processing capacity is limited ;

[0012] 2. The two data integration methods have no monitoring function: Since the two data integration methods themselves do not provide monitoring functions, it is difficult to monitor the operation and execution of data integration, which makes it difficult for both the data receiver and the data sender to know The specific data integration situation is not easy to grasp the operation situation;

[0013] 3. High maintenance cost: The data format in the data file integration method is complicated. Once a data format is added or modified, the data integration program needs to be modified

[0014] 4. Expansion is not convenient enough: Due to the adoption of two schemes, it is very difficult to expand horizontally (data synchronization between multiple databases) or vertically (multiple data sources provide data)

Images