Method and system for synchronizing data and related database

Abstract

The invention provides a method and system for synchronizing data and a related database. The synchronizing method is applied to databases with a principal and subordinate structure, and at least two transmission interfaces of the subordinate database are activated to receive data transmitted by the principal database. The method comprises the steps that data to be synchronized are obtained from the principal database, multiple synchronization tasks are generated according to the data to be synchronized, at least two concurrent threads are called, the multiple synchronization tasks are allocated to the at least two concurrent threads according to preset rues, and the multiple synchronization tasks are sent to the subordinate database through the at least two concurrent threads for the subordinate database to achieve data synchronization with the principal database according to the multiple synchronization tasks. According to the technical scheme, the problem of synchronization time delay of the principal database and the subordinate database is solved, real-time synchronization can be achieved, and therefore the demand of providing subsequent data services is met.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method, system and related database for synchronizing data. Background technique [0002] MySQL is a relational database management system, and its master-slave architecture is currently one of the most used database architectures, especially for websites with relatively large loads. In MySQL's master-slave architecture, the master database performs operations such as writing, updating, and deleting, and executes these operations in the slave database through a predetermined synchronization strategy, so as to achieve data consistency in the master-slave database. [0003] In related technologies, the synchronization process of the MySQL master-slave database is: after operations such as writing, updating, and deleting have been performed on the MySQL master database, it will record these operations in the binary log (binary log), such as figure 1 As shown, in order to ensure...

AI Technical Summary

Problems solved by technology

[0004] However, when there are many operations such as writing, updating, and deleting on the master database, especially when the master database is triggered by a large number of businesses, there will be a large number of write requirements when synchronizing the slave database, but only one thread is running when the slave database is synchronizing. Playback and write operations are performed according to the recording order of the binary log. The single-thread processing speed of data is limited, and data exceeding its processing speed needs to be queued. Further increase the queue time

Therefore, when the master database writes a lot, the slave database synchronization will be delayed due to the limitation of single-thread processing speed, and the delay may become larger and larger due to the increase in the amount of data, which will lead to the inability to meet the subsequent data service requirements. needs

Images