MySQL database increment synchronization implementation method based on binary log analysis

Abstract

The invention discloses a MySQL database increment synchronization implementation method based on binary log analysis, and belongs to the technical field of database data acquisition. The MySQL database increment synchronization implementation method based on binary log analysis comprises the following steps of: reading and analyzing a binary log file of MySQL; obtaining and recovering incrementaldata of a MySQL database source library; and temporarily storing the analyzed incremental data in a CMSP message queue in a character string form, and analyzing the encrypted and compressed transmitted message queue transmitted by the CMSP at a storage end by means of encrypted and compressed transmission of the CMSP, thereby realizing data synchronization of the MySQL database from a source library to a target library of the MySQL database. The MySQL database increment synchronization realization method based on binary log analysis is efficient and safe, can realize data addition, deletion,modification and increment synchronization of whether the database has a primary key, and has good popularization and application values.

Description

technical field [0001] The invention relates to the technical field of database data acquisition, and specifically provides a method for implementing MySQL database incremental synchronization based on binary log analysis. Background technique [0002] With the rapid development of the information age and the rise of big data and artificial intelligence, data, as a resource, is increasingly valued by some enterprises and units, and the economic and social value of data output is becoming more and more obvious. In today's society, enterprise data is becoming more and more large and complex, showing the characteristics of huge data volume, various types of data including structured data and unstructured data, and single data storage, which will inevitably bring hidden dangers to data security and unreliability. Therefore, Data synchronization and backup are becoming more and more important. [0003] The commonly used synchronization methods for MySQL databases are as follows:...

AI Technical Summary

Problems solved by technology

[0013] However, each of the above methods has certain disadvantages: the trigger method requires the business table to create a trigger, which has a certain impact on the business, and at the same time, it cannot implement update and delete operations for tables without primary keys

Full table delete insertion method, high network load, high performance cost, unable to reflect the historical state of the data

Images