Unlock instant, AI-driven research and patent intelligence for your innovation.

Data recovery method, data node and distributed file system

A technology of data nodes and metadata nodes, which is applied in the field of data recovery technology and can solve problems such as the heavy burden of metadata nodes

Active Publication Date: 2009-09-23
CHENGDU HUAWEI TECH
View PDF0 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The inventors of the present invention found in the process of implementing the present invention that: if the data node in failure stores a large amount of data, then the metadata node needs to restore a large amount of data. In this case, the metadata node needs to make a lot of The data recovery can only be completed by the work, which leads to the overload of the metadata node

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data recovery method, data node and distributed file system
  • Data recovery method, data node and distributed file system
  • Data recovery method, data node and distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0024] First of all, it should be noted that all the embodiments described below are applied to a distributed file system. A distributed file system includes metadata nodes and data nodes.

[0025] Each data node has backup information for the data it stores. For example, suppose a data node stores 5 data, and the first data is stored in two other data nodes in addition to this data node, then in this data node, it is necessary to record the first data or Informa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data recovery method which comprises the steps as follows: a first data node obtains a notification that a second data node is failed; the first data node stores appointed data in a third data node, simultaneously records the information of the appointed data stored in the third data node in backup information stored in the first data node, and provides the information of the appointed data stored in the third data node to a metadata node and other data nodes stored with the appointed data simultaneously, wherein the appointed data is the data stored by both the first data node and the second data node. In the invention, the data recovery is carried out between nodes, the metadata node does not need great amount of work, thereby reducing the burden of the metadata node.

Description

technical field [0001] The invention relates to a distributed file system, in particular to the data recovery technology in the distributed file system. Background technique [0002] Whether it is a single disk or a complex storage device, there is always the danger of failure. Therefore, in a distributed file system, the same data is generally stored in multiple data nodes at the same time, so that when one of the data nodes fails, the entire distributed file system can still provide the failed data node externally. stored data. Among them, the data node is a device for storing data in the distributed file system. In a distributed file system, the number of backups is generally set for data, which is used to indicate the number of the same data that needs to be backed up in the entire distributed file system. [0003] When a data node fails, the number of data backups stored by this data node will decrease. At this time, it is necessary to re-increase data backups on oth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/14G06F17/30
CPCG06F11/2094G06F11/1662G06F11/1469
Inventor 封欢
Owner CHENGDU HUAWEI TECH