Metadata management method and device of distributed file system

A distributed file and management equipment technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as performance limitations, single point failures, memory limitations, etc., to achieve overcoming single point failures and high scalability Effects of metadata management

Active Publication Date: 2014-03-12
TAOBAO CHINA SOFTWARE
View PDF4 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The main purpose of this application is to provide a loosely coupled, highly available, and highly scalable metadata management method and device to solve problems such as single point of failure, capacity limitation, memory limitation, and performance limitation in the prior art, among which:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata management method and device of distributed file system
  • Metadata management method and device of distributed file system
  • Metadata management method and device of distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The main idea of ​​this application is to use the existing file metadata of the operating system itself at the bottom layer to construct a virtual and dynamic metadata management server at the upper layer. That is, this application proposes a new implementation method for metadata management of a distributed file system. It does not maintain huge file metadata storage and management, but utilizes the file metadata information of the operating system itself. Based on this Build a loosely coupled, highly available, and highly scalable metadata management device on top of it.

[0028] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0029] refer to figure 1 , figure 1 is a block diagram showing the structure of the metadata management device involved in the embodiment of the present ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a metadata management method and device of a distributed file system. The metadata management device of the distributed file system comprises a computer cluster, a cluster management unit and an information browsing unit, wherein the computer cluster comprises a plurality of computer nodes used for obtaining metadata information of a storage file in an operating system of a computer where the nodes are located; the cluster management unit is used for registering the registration information of the computer nodes and detecting and keeping the on-line state of the computer nodes; the information browsing unit is used for accessing associated computer nodes at the on-line state in the computer cluster to obtain metadata information according to the registration information of the computer nodes and based on metadata access requests from a client-side, converting the metadata information into metadata, and returning the metadata to the client-side.

Description

technical field [0001] The present application relates to a distributed file system, in particular to a metadata management method and device for a distributed file system. Background technique [0002] At present, the existing distributed file system implementation methods on the market mainly include the GFS paper theory proposed by Google and Hadoop's HDFS (Hadoop Distributed File System) distributed file system implemented according to this paper. In the HDFS file system, Namenode (name node) is the central server for distributed file metadata management, responsible for managing directory naming of the file system and client access to files. [0003] In the HDFS distributed file system, when the client stores a file, it splits the file content into multiple blocks, and these block data are scattered and stored on different computer nodes, and the metadata such as the path directory name of the file and the The block location information of the file being split is store...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/164G06F16/182G06F16/183
Inventor 彭渊
Owner TAOBAO CHINA SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap