System and method for data synchronization between heterogeneous databases and storage medium

Abstract

The invention provides a system and method for data synchronization between heterogeneous databases and a storage medium. The method is applied to a data synchronization process between heterogeneousdatabases. The system comprises an acquisition plug-in unit, a write-in plug-in unit and a data processing center, the plurality of databases are connected with the data processing center in a star mode through the acquisition plug-in unit and the write-in plug-in unit; the data processing center comprises a plurality of synchronous execution nodes; the plurality of synchronous execution nodes carry out data synchronization in a distributed execution mode; the adapter is adopted to adapt to collection and writing of various heterogeneous databases; a unified intermediate data format is adoptedfor transmission; connection between different source ends and target ends is simplified, the data collection efficiency is improved, the expansibility is very high, receiving, distribution, receiving and load balancing of synchronous tasks are achieved through a unified synchronous task controller, data synchronization operation is executed in parallel in a multi-channel mode, and therefore theexecution efficiency is further improved.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a system, method and storage medium for synchronizing data between heterogeneous databases. Background technique [0002] At present, big data technology is developing rapidly, and more and more data are generated by all walks of life. With the expansion of data scale, the diversity of data types and structures increases. In order to enhance the efficiency of data use, various data structure types The database has also penetrated into different applications and industries, and the joint use of these heterogeneous databases has become the norm. [0003] For those cross-regional companies or units with geographically dispersed but relatively centralized management, in order to increase the value of data, it is necessary to conduct centralized integration and analysis of data, which promotes the construction of data centers or data platforms. At present, there are m...

AI Technical Summary

Problems solved by technology

The synchronization tools used for these commonly used relational databases cannot effectively support other types of databases except relational databases, and have certain requirements for data forms, lacking centralized synchronization management

[0007] Moreover, in the existing technology, the data task process lacks unified system management, the horizontal expansion capability is limited, the efficiency is low and the performance is poor, and it cannot adapt to the synchronization of large-scale data

Images