Unlock instant, AI-driven research and patent intelligence for your innovation.

Data synchronization method, apparatus and system

A data synchronization and data technology, applied in the storage field, can solve the problems of ineffective recovery of synchronized data and excessive use of synchronized data.

Active Publication Date: 2016-07-06
HUAWEI TECH CO LTD
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Embodiments of the present invention provide a data synchronization method, device and system, which solves the problem in the prior art that the synchronization data cannot be effectively restored or that too many IO resources are occupied when accessing the synchronization data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method, apparatus and system
  • Data synchronization method, apparatus and system
  • Data synchronization method, apparatus and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] An embodiment of the present invention provides a data synchronization method, the method is applied to each node in the memory database, and each node is equipped with a replication entry for storing synchronization data. In this embodiment, the first node and The second node is taken as an example to elaborate, such as figure 1 shown, including:

[0057] 101. The first node receives a data modification instruction initiated by a user, where the data modification instruction includes at least an entry identifier of the data to be modified.

[0058] 102. The first node determines the entry type of the data modification instruction according to the entry identifier and the preset correspondence between the entry identifier and the entry type.

[0059] 103. If the entry type of the data modification instruction is a copy entry, the first node generates a first redo log according to the data modification instruction, and the first redo log carries a copy entry tag used to...

Embodiment 2

[0076] An embodiment of the present invention provides a data synchronization method, the method is applied to each node in the memory database, and each node is equipped with a replication entry for storing synchronization data. In this embodiment, the first node and The second node is taken as an example to elaborate, such as figure 2 shown, including:

[0077] 201. The first node receives a data modification instruction initiated by a user, where the data modification instruction includes at least an entry identifier of the data to be modified.

[0078] 202. The first node determines the entry type of the data modification instruction according to the entry identifier and the preset correspondence between the entry identifier and the entry type.

[0079] 203a. If the entry type of the data modification instruction is a copy entry, the first node generates a first redo log according to the data modification instruction and stores it in the log buffer.

[0080] 203b. If th...

Embodiment 3

[0109] Such as Figure 5 As shown, a hardware schematic diagram of a node is provided for an embodiment of the present invention.

[0110] The node can be any one of the nodes of the memory database (assuming that the node is the first node), each node is provided with a replication entry for storing synchronization data, and the synchronization data needs to be synchronized with the second node and does not Data that needs to be written to the disk of the first node. In addition, each node is also provided with an ordinary table entry for storing ordinary data, and the ordinary data is data that needs to be synchronized with the second node and needs to be written into the disk of the first node.

[0111] Such as Figure 5 , the first node includes a processor 11 , a transceiver 12 , a cache 13 , a disk 14 and a bus 15 .

[0112] Wherein, the processor 11 , the transceiver 12 , the cache 13 and the disk 14 are communicatively connected through the bus 15 .

[0113] The pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Embodiments of the invention provide a data synchronization method, apparatus and system, relates to the field of storage, and solves the problem that synchronous data cannot be effectively recovered or excessive IO resources are occupied during synchronous data access in the prior art. According to the scheme, the method comprises the steps that a first node receives a data modification instruction initiated by a user, wherein the data modification instruction at least comprises a table item identifier of to-be-modified data; the first node determines a table item type of the data modification instruction according to the table item identifier and a preset corresponding relationship between the table item identifier and the table item type; if the table item type of the data modification instruction is a copying table item, the first node generates a first redo log according to the data modification instruction, wherein the first redo log carries a copying table item label used for indicating the table item type; the first node sends the first redo log to a second node for enabling the second node to synchronize synchronous data of a copying table item in the second node according to the copying table item label and the first redo log.

Description

technical field [0001] The invention relates to the storage field, in particular to a data synchronization method, device and system. Background technique [0002] Structured query language (structured query language, SQL) is a memory database (memory database, MDB) query and programming language, mainly used for accessing data and querying, updating and managing data in the memory database. [0003] Specifically, SQL statements can be used to create temporary tables and ordinary tables in each node of the memory database. Among them, the temporary table can be used to store data of some temporary tasks (such as the current billing time of the user, etc.), and the storage space of the temporary table Insufficient or after the temporary task is over, the node will clear the data in the temporary table, and the ordinary table is used to store some important and stable data (such as user balance data, etc., this application refers to this type of data as ordinary data) , in or...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 覃超立彭蕾芳侯冰剑
Owner HUAWEI TECH CO LTD