Method and device for synchronizing meta information between data nodes

A data node and meta-information technology, applied in the computer field, can solve the problems of low meta-information transmission rate, time-consuming, meaningless meta-information outgoing, etc., to control transmission time, improve synchronization efficiency, and reduce network overhead.

Active Publication Date: 2019-03-05
BEIJING QIHOO TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the prior art solution, each data node in the distributed data storage system establishes a network connection with other data nodes. For example, the distributed data storage system has 5 data nodes, numbered respectively: 1, 2, 3, 4, 5, that is to say, data node 1 needs to establish network connections with data nodes 2, 3, 4, and 5 respectively, and data node 2 needs to establish connections with data nodes 1, 3, 4, and 5 respectively. For data nodes 3, 4, and 5 Similarly, when the meta-information of any data node is updated, the updated meta-information is transmitted to other data nodes through the established network connection, that is, when the meta-information of data node 1 is updated, it passes The network connection established with data nodes 2, 3, 4, and 5 transmits the updated meta information to data nodes 2, 3, 4, and 5, but data node 2 and data nodes 3, 4, and 5 also perform meta information transmission, resulting in meaningless meta-information being sent out, causing additional network overhead, and it will also cause additional network overhead for data nodes 3, 4, and 5, and because the updated meta-information is transmitted to all other data nodes at the same time, The transmission rate of meta-information is low and takes a lot of time

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for synchronizing meta information between data nodes
  • Method and device for synchronizing meta information between data nodes
  • Method and device for synchronizing meta information between data nodes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0074] In one embodiment of the present invention:

[0075] The judgment module 530 is adapted to judge whether the meta-information of the target data node is consistent with the received meta-information from the source data node.

[0076] The updating module 540 is adapted to update the meta-information of the target node to the received meta-information when the judging module determines that the meta-information of the target data node is inconsistent with the received meta-information from the source data node.

[0077] Optionally, the synchronization module 520 is further adapted to: for the source data node to push the meta information to the target data node every preset time period.

[0078] Optionally, the synchronization module 520 is further adapted to: through a network connection established with the source data node, for the target data node to pull meta information from the source data node to update the meta information of the target data node.

[0079] In a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for synchronizing meta information among digital nodes applied in a data storage system comprising multiple digital nodes. The method comprises: with respect to every data node, configuring a target data node which is in network connection with the data node and is used for synchronizing the meta information of the data node, wherein the all configured data nodes have network communication; detecting whether the metal information of the data node is updated, if so, taking the data node as a source data node, synchronizing the meta information of the source data node to the target data node, thus updating the meta information of the target data node. In adoption of the solution, the defects in the prior art that the meta information of all data nodes is needed to be synchronized, therefore the data transmission is frequent, the network cost is great and the expended time is long are overcome; the network cost is reduced; the transmission time is controlled; and the synchronizing efficiency is promoted.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for synchronizing meta information between data nodes. Background technique [0002] The distributed data storage system is to disperse and store data on multiple independent devices. It is a cluster system with many data nodes. In the distributed data storage system, each data node needs to maintain its own metadata, and all data The meta information of nodes is required to be consistent. [0003] In the prior art solution, each data node in the distributed data storage system establishes a network connection with other data nodes. For example, the distributed data storage system has 5 data nodes, numbered respectively: 1, 2, 3, 4, 5, that is to say, data node 1 needs to establish network connections with data nodes 2, 3, 4, and 5 respectively, and data node 2 needs to establish connections with data nodes 1, 3, 4, and 5 respectively. For data nodes 3, 4, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1095H04L67/1097
Inventor 陈宗志
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products