Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method for deduplicating master-slave synchronization data of a MySQL database

A technology for synchronizing data and data synchronization, applied in the field of database applications, can solve the problems of only providing single-threaded access and high performance overhead, and achieve the effect of simple and clear processing logic, low overhead, and performance improvement

Inactive Publication Date: 2018-12-11
GLOBAL TONE COMM TECH
View PDF11 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] In order to solve the existing MySQL database master-slave synchronous data deduplication method, which has a large performance overhead and can only provide single-threaded access, the present invention provides a MySQL database master-slave synchronous data deduplication method. The method adopts distributed operations , after each data synchronization, scan the synchronized data, detect duplicate data from the library and delete it
The method does not need to perform locking operations on database tables, does not affect the parallel service function provided by the database, and does not introduce excessive performance overhead, so it is superior to existing solutions in terms of database operation parallelism and performance overhead

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for deduplicating master-slave synchronization data of a MySQL database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] See attached figure 1 .

[0029] A MySQL database master-slave synchronous data deduplication method is executed according to the following steps:

[0030] 1) Save the data in the master database to be synchronized in the temporary file of the server;

[0031] 2) Execute the data synchronization operation between the master database and the slave database;

[0032] 3) Call the MySQL trigger to record the log information of the completion of the synchronization operation in the master-slave synchronization log table, but the "deduplication table-level field" in the record is recorded as "not deduplication";

[0033] 4) The SAAS architecture program scans the master-slave synchronization log table every 5 seconds;

[0034] 5) The scan does not find any new batch data that has been synchronized but has not been deduplicated, and deletes the temporary files stored in step 1).

Embodiment 2

[0036] See attached figure 1 .

[0037] A MySQL database master-slave synchronous data deduplication method is executed according to the following steps:

[0038] 1) Save the data in the master database to be synchronized in the temporary file of the server;

[0039] 2) Execute the data synchronization operation between the master database and the slave database;

[0040] 3) Call the MySQL trigger to record the log information of the completion of the synchronization operation in the master-slave synchronization log table, but the "deduplication table-level field" in the record is recorded as "not deduplication";

[0041] 4) The SAAS architecture program scans the master-slave synchronization log table every 5 seconds;

[0042] 5) If there are new batches of data that have been synchronized but not deduplicated, compare the data that has been synchronized but not deduplicated with the data in the temporary file stored in step 1);

[0043] 6) After the comparison, no duplic...

Embodiment 3

[0045] See attached figure 1 .

[0046] A MySQL database master-slave synchronous data deduplication method is executed according to the following steps:

[0047] 1) Save the data in the master database to be synchronized in the temporary file of the server;

[0048] 2) Execute the data synchronization operation between the master database and the slave database;

[0049] 3) Call the MySQL trigger to record the log information of the completion of the synchronization operation in the master-slave synchronization log table, but the "deduplication table-level field" in the record is recorded as "not deduplication";

[0050] 4) The SAAS architecture program scans the master-slave synchronization log table every 5 seconds;

[0051] 5) If there are new batches of data that have been synchronized but not deduplicated, compare the data that has been synchronized but not deduplicated with the data in the temporary file stored in step 1);

[0052] 6) After comparison, duplicate dat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for deduplicating master-slave synchronous data of a MySQL database. The method distinguishes the MySQL database synchronization operation from the data deduplicationoperation, and is executed as two continuous operation steps, namely, after the data synchronization operation is completed, duplicate data is found by comparing the synchronized data with the data inthe synchronization log, and the duplicate data is deleted from the library. The method of the invention does not need to perform locking operation on the database table, does not affect the parallelservice function provided by the database, and does not introduce excessive performance overhead, so the method is superior to the existing solution in the aspects of database operation parallelism and performance overhead.

Description

technical field [0001] The invention belongs to the technical field of database applications, and in particular relates to a method for deduplicating MySQL database master-slave synchronization data. Background technique [0002] The SaaS architecture directly strips out the application and keeps the platform. Those who do the platform always do the platform, and those who do cloud computing resources concentrate on their own scheduling and services. This way allows people who do SaaS to focus on the business they are familiar with and provide software and service applications for others. [0003] The MySQL database is a very popular open source database management system with a wide range of applications. The synchronization technology of the master database and the slave database of the MySQL database management system is used very frequently at home and abroad. However, the MySQL database is prone to data duplication when implementing master-slave synchronization. This ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 詹咏松程国艮
Owner GLOBAL TONE COMM TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com