Supercharge Your Innovation With Domain-Expert AI Agents!

Data synchronization method, device, system and non-volatile storage medium

A data synchronization and source data technology, applied in transmission systems, electrical components, etc., can solve the problems of lack of horizontal expansion, inability to meet real-time business, and inability to expand cluster scale and synchronization real-time performance, so as to achieve low delay and fast synchronization Effect

Active Publication Date: 2021-12-10
UCLOUD TECH CO LTD
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The above-mentioned data synchronization systems, methods, and devices are still publish-subscribe systems in essence, and their systems are passive and need to be triggered by a message system, and the synchronization operation of data by downstream systems is still performed by a single node
Moreover, it does not have the ability to expand horizontally, and it is impossible to expand the cluster size according to the number to ensure real-time synchronization
In other words, these methods are only suitable for offline processing of small batches of data, and cannot perform real-time synchronization of large-scale data, and cannot meet the requirements of real-time business

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method, device, system and non-volatile storage medium
  • Data synchronization method, device, system and non-volatile storage medium
  • Data synchronization method, device, system and non-volatile storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0038] figure 1 is a structural diagram of a data synchronization system 10 according to an embodiment of the present invention, such as figure 1 As shown, the data synchronization system 10 includes a source data party 11 , a data synchronization device 12 and a target data party 13 . The source data party 11 and the target data party 13 are, for example, different data systems or databases and the like.

[0039] figure 2 is a structural diagram of a data synchronization device 12 according to an embodiment of the present invention, such as figure 2 As shown, the data synchronization device 12 includes a node 1 , a node 2 , a node 3 , a receiving unit 121 , a registration and listening unit 122 , and a hash calculation unit 123 . In this embodiment, there are three nodes, but the number of nodes is not limited, it can be any number, and any numb...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a data synchronization method, device, system and storage medium. The method includes: receiving step, receiving data from a source data party; registering and monitoring step, receiving registration of multiple nodes, and monitoring registered nodes, To determine the node cluster, and according to the registration result, determine the master node in the node cluster; the time event sending step, the master node sends a time event according to a predetermined time interval; the hash calculation step, obtain the node cluster Each node in the data and the data corresponding to the time event in the data are used as synchronization data, and the synchronization data is divided into each node by using a consistent hash algorithm. The synchronization step is the Each node synchronizes its own synchronization data to the target data party at the same time.

Description

technical field [0001] The invention relates to a data synchronization method, device, system and non-volatile storage medium. Background technique [0002] Data synchronization for data migration between multiple data systems. Different business needs have different real-time requirements. After the source data is generated, the data synchronization device can perceive it through a certain mechanism, and then synchronize it to the downstream data system. [0003] Currently there is a data synchronization system (CN107995302A), in which the server sends a data update notification instruction to the client agent component, and then the client agent component performs an update operation. There is also a data synchronization method (CN108197263A), which connects upstream and downstream systems through a publish-subscribe system. The upstream system publishes the data update information to the subscription system, triggering the downstream system to perform the update operat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1095H04L67/563
Inventor 郑健宋翔范融
Owner UCLOUD TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More