Unlock instant, AI-driven research and patent intelligence for your innovation.

A metadata recovery method and related device

A recovery method and metadata technology, applied in the field of communication, can solve problems such as unrecoverable metadata and unrecoverable metadata

Active Publication Date: 2017-11-24
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, in the above technical solution, because the metadata in NN is stored regularly, for example, metadata is stored every ten minutes, so when the time point when NN is abnormal has not reached the storage time point every ten minutes, then NN The metadata in the event of an exception will not be stored, so this part of the metadata cannot be recovered
It can be seen that the metadata when the NN is abnormal cannot be recovered in the above technical solution

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A metadata recovery method and related device
  • A metadata recovery method and related device
  • A metadata recovery method and related device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0103] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0104] In the embodiment of the present invention, the metadata can be data used to represent the data structure of the file, wherein the metadata of the file can specifically represent the version information of the HDFS system where the file is located and the attribute information of the file, for example: the metadata of the file The version information of the included HDFS system can include one or more of the following:

[0105] Version information of HDFS sy...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present invention discloses a metadata recovery method and a related device. The method may include: receiving a write operation request for a target file, wherein the target file is stored on multiple data nodes; The metadata of the target file, the metadata of the target file includes the information of the multiple data nodes; generate metadata recovery information according to the metadata of the target file; send data to at least one of the multiple data nodes The node sends the metadata recovery information, the metadata recovery information is used to be saved by the at least one data node, and is sent to the metadata node to perform the metadata recovery after the metadata node is abnormal. recovery. The embodiment of the present invention can restore the metadata when the NN is abnormal.

Description

technical field [0001] The present invention relates to the communication field, in particular to a method for recovering metadata and related devices. Background technique [0002] Hadoop is a widely used distributed system architecture in the field of communication. Hadoop includes a very important storage component, that is, Hadoop Distributed File System (Hadoop Distributed File System, HDFS for short). Among them, HDFS includes a metadata node (NameNode, NN for short) and a data node (DataNode, DN for short). NN is mainly used to provide metadata services for files. In this service, NN will generate metadata of the file in memory, metadata It can represent the data structure of the file, and DN is mainly used to store the actual data of the file. In practical applications, when an abnormality occurs in a NN, the metadata loss problem of the NN will occur, which will cause the NN to fail. [0003] Among them, the above problems are mainly solved by the following techno...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L65/40
Inventor 刘洋张克星
Owner HUAWEI CLOUD COMPUTING TECH CO LTD