Data synchronization system and data synchronization method used for MySQL database
A data synchronization and database technology, applied in the field of data security, can solve problems such as synchronization to another server, inability to achieve zero loss, inability to persist data, etc., and achieve high performance
Active Publication Date: 2014-03-05
HANGZHOU WOQU NETWORK TECH
View PDF5 Cites 8 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
In order to avoid the occurrence of the above situation, the data is generally synchronized to another server asynchronously by setting up MySQL replication. This method can ensure that the data is not completely lost to a certain extent, but its disadvantage is that due to redo log or binary log data Still in memory, when the MySQL database crashes, the data cannot be persisted. Asynchronous replication cannot guarantee that all MySQL data is completely synchronized to another server, and zero loss cannot be achieved.
The defect of this method is: since the data block size of MySQL is 16K, the data block synchronization software is based on the synchronization of the file system, which cannot guarantee that the 16K database is completely synchronized to another server, causing MySQL block damage and data loss
[0004] In addition, the synchronous write method requires data blocks to be written successfully on both servers before they can be returned. Correspondingly, two IOs and one network transmission are required, which greatly increases the underlying IO response time and affects the response time of the MySQL database. It is intolerable for applications that provide fast real-time access, and this solution cannot achieve high performance requirements
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0035] see Image 6 In this embodiment, the MySQL database main library submits a write operation of page data with a size of PAGE_SIZE bytes, and the data synchronization process is as follows:
[0036] The file system will initiate an atomic write operation for this write operation. First, the file system initializes some variables and marks the beginning of the atomic write. Then the file system writes the pages of PAGE_SIZE size according to the block size of the underlying disk system, and writes a block of BLOCK_SIZE bytes each time until all the page data of PAGE_SIZE bytes are written into the underlying storage system . Note that every write to the file system will be synchronized to the server storage system of the MySQL standby database. In case of any abnormality during data writing or synchronization, the file system will roll back any previous operations. If at any time during this period, the database or the host goes down, it will not cause data inconsisten...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a data synchronization system used for a MySQL database. The data synchronization system comprises a MySQL database master library used for data storage and a MySQL database standby library connected with the MySQL database master library through a high-speed internet network and used for data backup. The data synchronization system is characterized by further comprising storage systems supportive of atomic writing of data blocks, each storage system comprises data block synchronization software and a high-speed IO storage system, the storage systems are arranged in the MySQL database master library and the MySQL database standby library respectively, and the data block synchronization software in the MySQL database master library is used for synchronizing data of the MySQL database master library into the high-speed IO storage system of the MySQL database standby library.
Description
technical field [0001] The invention relates to the field of data security, in particular to a data synchronization system and method for a MySQL database. Background technique [0002] It is well known that in the event of a disk failure, the data in the MySQL database will be lost. In order to avoid the occurrence of the above situation, the data is generally synchronized to another server asynchronously by setting up MySQL replication. This method can ensure that the data is not completely lost to a certain extent, but its disadvantage is that due to redo log or binary log data Still in memory, when the MySQL database crashes, the data cannot be persisted. Asynchronous replication cannot guarantee that all MySQL data is fully synchronized to another server, and zero loss cannot be achieved. [0003] Another way is to synchronize the MySQL data blocks to another server through the data block synchronization software. The disadvantage of this method is that: since the dat...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/275
Inventor 李春李建辉熊中哲罗春陈栋
Owner HANGZHOU WOQU NETWORK TECH