Data synchronization method and relevant device

A data synchronization and data technology, applied in the database field, can solve problems such as data shortage of storage nodes, complex writing mechanism, and affecting reading services

Inactive Publication Date: 2018-05-25
HANGZHOU HUAWEI DIGITAL TECH
View PDF0 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, since most of the mechanisms are used to fill holes with other storage nodes, there is a shortage of data in some storage nodes, and it is necessary to coordinate with other nodes to obtain
However, the writing mechanism of the above scheme is too complicated, and the log storage node that receives the redo log needs to cooperate with other storage nodes to maintain a consistent state. As a result, it takes too long to fill the vacancy, which affects the read service
Moreover, transferring redo logs between the master computing node and the slave computing nodes, and a large number of filling vacancies of the storage nodes will occupy a large amount of network resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data synchronization method and relevant device
  • Data synchronization method and relevant device
  • Data synchronization method and relevant device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0030] Please refer to image 3 , image 3 It is a structural diagram of a database proposed by the embodiment of the present invention. The database decouples the original one-stop (direct connection between the host and the disk) method of the traditional database into computing nodes and storage nodes. The computing nodes include master nodes and slave nodes, and the computing nodes and storage nodes are connected through the network. Nodes are re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data synchronization method and a relevant device. The method comprises the steps that a main node acquires redoing logs of a changed page during transaction submission, and a page identifier of the changed page, a current transaction snapshot and log serial numbers are recorded; the main node writes the redoing logs into a storage node, and the redoinglogs are used for the storage node to fix data in the changed page; and the main node sends an invalidity instruction message to a slave node, wherein the invalidity instruction message contains the page identifier, the current transaction snapshot and the log serial numbers and is used for instructing a data page corresponding to an invalid page identifier of the slave node, determining version information of a data page visible to the message according to the current transaction snapshot and acquiring a data page successfully fixed through a target redoing log from the storage node, and theserial number of the target redoing log is greater than or equal to the log serial number corresponding to the version information. By the adoption of the embodiment, data synchronization efficiency and accuracy are improved.

Description

technical field [0001] The invention relates to the field of databases, in particular to a data synchronization method and related equipment. Background technique [0002] At present, the application of cloud computing is becoming more and more common. "Cloud" can be used for storage and computing. "Cloud" is a group of computers. Each group includes hundreds of thousands or even millions of computers. The computer can be updated at any time, ensuring that the "cloud" is immortal. Using cloud computing technology, users don't need to care about which "cloud" the storage or calculation takes place on, and they can quickly calculate and find data at any place using any device (such as a computer, mobile phone, etc.), and don't need to worry about data loss . Among them, the database, as the core basic component of cloud computing, provides users with reliable cloud database services. The "cloud" environment has the following characteristics: (1) computing and storage are se...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/273
Inventor 李海丰于帅鹏熊亮春
Owner HANGZHOU HUAWEI DIGITAL TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products