A distributed data synchronization method and system

A distributed data and database technology, applied in structured data retrieval, electronic digital data processing, database distribution/replication, etc., can solve problems such as low synchronization delay, increased synchronization delay, system crash, etc., and achieve low performance loss, The effect of low sync delay and performance improvement

Active Publication Date: 2022-08-05
京信数据科技有限公司
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

While satisfying the low synchronization delay, frequent queries bring a large performance loss to the source database and synchronization middleware. On the contrary, if the query density is reduced, the synchronization delay will be increased, and it is difficult to meet both requirements at the same time.
[0004] (2) Traditional data extraction has no way to take advantage of the multi-core advantages of modern computers, and the extraction efficiency is relatively low
[0005] (3) Traditional data extraction middleware cannot handle a large number of synchronization tasks at the same time. When there are too many data tables to be synchronized, the synchronization delay will increase and even the system will crash.
[0006] (4) Traditional data extraction middleware has no way to roll back the transmission content of this synchronization task when an exception occurs when writing to the target data table, resulting in dirty data in the target data table

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed data synchronization method and system
  • A distributed data synchronization method and system
  • A distributed data synchronization method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments, however, can be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated descriptions will be omitted.

[0025] Furthermore, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided in order to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention involves a distributed data synchronization method and system.The method includes steps: the scheduler needs to perform synchronous tasks to the source database, and adjust the interval time according to the elasticity of the query results; the scheduler selects one of the synchronous components in the synchronous component cluster to perform the task;Use multiple parallel thread processing; synchronous components read the synchronous dataset from the source database and perform data processing; synchronous components generate temporary unique logo to replace the original unique logo of synchronous dataset, and then write the quantity of the synchronous data set to the target databaseThere are updated old data records in the target database, and finally restore the original unique logo of the synchronous data set in batches.The present invention has greatly improved the performance of the entire data synchronization.

Description

technical field [0001] The present invention relates to data synchronization technology, in particular to a distributed data synchronization method and system. Background technique [0002] Data synchronization is a means of maintaining data consistency among multiple data sources and is widely used in various computer systems. There are several common application scenarios for data synchronization: 1. Computer system realizes disaster recovery backup through data synchronization to avoid single point of failure; 2. Computer system realizes system load balancing through data synchronization and improves system performance; 3. Multiple systems Data sharing is achieved by means of data synchronization. There are generally two ways to realize data synchronization. One is to read the BinLog file of the database, obtain the modification operation statement in it, and send it to the database to be synchronized for execution to realize data synchronization. The second method is t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/27G06F16/2455G06F9/48
CPCG06F16/27G06F16/2455G06F9/4881
Inventor 王济平黎刚刘继华周健雄汤克云谢晓锋
Owner 京信数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap