Method and system for data synchronization of relational heterogeneous databases

Abstract

The invention provides a method and system for data synchronization of relational heterogeneous databases. The method includes the steps that a synchronization table file, a key word information table and a statement calling table configured by a user in advance are acquired; an archive log file generated by a source database is acquired in real time; the archive log file is analyzed and converted into standard SQL statements; a subsequent log file generated by the source database is acquired in real time; the standard SQL statements are transmitted to a target database according to the subsequent log file. According to the method and system for data synchronization of the relational heterogeneous databases, an independent server is used for connecting the source database and the target database, the archive log file generated by reading the source database is adopted and converted to the standard SQL statements to be transmitted to the target database after being analyzed, and finally the SQL statements are made to run on the target database to achieve data synchronization. A synchronization mechanism is provided for data of the heterogeneous databases, system overhead and program maintenance work are reduced, and meanwhile timeliness of data synchronization is greatly improved.

Description

technical field [0001] The present invention relates to the technical field of data processing of large databases, in particular to the data synchronization technology between large database systems, specifically a method and system for data synchronization of relational heterogeneous databases. Background technique [0002] In the large-scale IT system in the prior art, there is generally a large amount of information that needs to be synchronized among different applications. Data synchronization processing methods include the following categories: [0003] (1) Use end-of-day batch processing. This method has the following disadvantages: However, the timeliness of data synchronization is first sacrificed by adopting the method of end-of-day batches. The latest data maintained by the upstream application cannot be synchronized to the downstream at the first time, thus causing upstream and downstream data to be lost in a long period of time. The inconsistency; every time a...

AI Technical Summary

Problems solved by technology

This method has the following disadvantages: However, the timeliness of data synchronization is first sacrificed by adopting the method of end-of-day batches. The latest data maintained by the upstream application cannot be synchronized to the downstream at the first time, thus causing upstream and downstream data to be lost in a long period of time. Inconsistency; each time a new table is added for upstream and downstream synchronization, a set of batch synchronization programs must be developed at the same time, and the maintainability is poor

This method has the following obvious disadvantages: it is only applicable to databases of the same type, and cannot be used between heterogeneous databases; distributed transaction locks brought by distributed transactions occupy certain system resources and increase system overhead; complete data The synchronization process needs to modify transactions synchronously, and the amount of program maintenance is relatively large

Images