Unlock instant, AI-driven research and patent intelligence for your innovation.

A data synchronization method, system, device and readable storage medium

A data synchronization and current data technology, applied in digital transmission systems, transmission systems, data exchange networks, etc., can solve problems affecting cluster performance and stability, consumption of master nodes, and difficulty in data consistency, so as to ensure cluster stability , Guaranteed processing performance, and improved cluster performance

Active Publication Date: 2022-08-02
北京浪潮数据技术有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] With the increasing scale of distributed cluster nodes, in order to ensure data consistency, the load pressure on the master node is increasing. On the one hand, it is becoming more and more difficult for the master node to ensure data consistency; on the other hand, the consumption of multi-node cluster Too many resources of the master node are more and more affecting the performance of the master node and increasing the instability of the cluster
Especially when the scale of nodes in the cluster is large, the pressure on the master node is increasing day by day. It has become very difficult to ensure the data consistency of all nodes in the cluster only through the master node, which seriously affects the performance and stability of the cluster.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data synchronization method, system, device and readable storage medium
  • A data synchronization method, system, device and readable storage medium
  • A data synchronization method, system, device and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] Please refer to figure 1 , figure 1 It is a flowchart of a data synchronization method in an embodiment of the present invention. The method can be applied to a distributed cluster, and the method includes the following steps:

[0045] S101. The slave node receives a synchronization notification message sent by the master node.

[0046] In a distributed cluster, it usually includes one master node and multiple slave nodes. The node that receives the synchronization notification message sent by the master node is one of the multiple slave nodes. That is to say, in this embodiment, the slave node that receives the synchronization notification message is any one of multiple slave nodes, rather than two or more slave nodes all receiving the synchronization notification message at the same time.

[0047] Specifically, a scheduling module can be configured to be deployed on each slave node, and when the scheduling module is started, the synchronization notification message...

Embodiment 2

[0073] Corresponding to the above method embodiments, the embodiments of the present invention further provide a data synchronization system, and the data synchronization system described below and the data synchronization method described above may refer to each other correspondingly.

[0074] see figure 2 As shown, the system includes the following modules:

[0075] The master node 100 on which the monitoring module 10 is deployed, and the slave nodes 200-20N on which the scheduling module 20 is deployed are multiple, wherein only one of the multiple scheduling modules is activated at the same time (such as figure 2 As shown, the scheduling module corresponding to the slave node 202 can be regarded as an activated state, while other slave nodes are in an inactivated state);

[0076] The monitoring module 10 is used to monitor each slave node and send synchronization notification information to the scheduling module;

[0077] The scheduling module 20 is configured to pars...

Embodiment 3

[0094] Corresponding to the above method embodiments, the embodiments of the present invention further provide a data synchronization device, and a data synchronization device described below and a data synchronization method described above may refer to each other correspondingly.

[0095] see Figure 4 As shown, the data synchronization device includes:

[0096] a memory D1 for storing computer programs;

[0097] The processor D2 is configured to implement the steps of the data synchronization method of the above method embodiments when executing the computer program.

[0098] For details, please refer to Figure 5 , a schematic diagram of a specific structure of a data synchronization device provided in this embodiment. The data synchronization device may have relatively large differences due to different configurations or performances, and may include one or more processors (central processing units, CPU) 322 (eg, one or more processors) and memory 332, one or more stor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data synchronization method, system, equipment and readable storage medium. The method includes the following steps: receiving a synchronization notification message sent by a master node from a node; parsing the synchronization notification message to obtain a target node to be synchronized with data, and The target slave node with the latest version data; copy the latest version data from the target slave node to the target node. In this method, the data copying work is transferred from the original master node to the slave node, which can greatly reduce the pressure on the master node, ensure the processing performance of the master node, further ensure the stability of the cluster and improve the cluster performance.

Description

technical field [0001] The present invention relates to the technical field of computer applications, and in particular, to a data synchronization method, system, device and readable storage medium. Background technique [0002] In a distributed cluster, the data is usually concentrated on the master node, and all rely on the master node to compare and copy the data to ensure data consistency. [0003] As the scale of distributed cluster nodes continues to increase, in order to ensure data consistency, the load pressure on the master node is increasing. On the one hand, it has become more and more difficult for the master node to ensure data consistency; on the other hand, multi-node clusters consume Too many resources of the master node are used, which increasingly affects the performance of the master node and increases the instability of the cluster. Especially when the scale of nodes in the cluster is large, the pressure on the master node is increasing day by day. It h...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L67/1095H04L67/1042H04L12/18
CPCH04L67/1095H04L67/1044H04L12/1895
Inventor 杨建阁
Owner 北京浪潮数据技术有限公司