Method and system for dynamically managing metadata of distributed file system

A distributed file and system dynamic technology, applied in the direction of electronic digital data processing, special data processing applications, transmission systems, etc., can solve the problem of not being able to smoothly expand the metadata server, not being able to handle single hot file access, and not being able to handle hot directory access and other issues to achieve efficient access strategies and good consistency

Inactive Publication Date: 2010-04-21
UNIV OF SCI & TECH OF CHINA
View PDF0 Cites 87 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The present invention provides a dynamic metadata management method and system of a distributed file system to solve the problem that in the existing metadata management method, the distribution of metadata c

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for dynamically managing metadata of distributed file system
  • Method and system for dynamically managing metadata of distributed file system
  • Method and system for dynamically managing metadata of distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] A specific embodiment of the present invention provides a dynamic metadata management method for a distributed file system, including the metadata server dynamically dividing the distribution of metadata on each metadata server according to the metadata access situation and the metadata server according to the client Terminal operation requests, and metadata management.

[0035] Further, the dynamic division of metadata also includes the step of periodically updating and reporting the overall load information of the current metadata server to the squad leader metadata server through the metadata server; according to the received load information, the squad leader metadata server sends a load greater than The step of sending a transfer request from the overloaded metadata server of the global average load; the step of sending a predetermined amount of load to the light-loaded metadata server through the overloaded metadata server according to the transfer request; receivi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a system for dynamically managing metadata of a distributed file system in order to solve the problems that a metadata management method cannot dynamically adjust the distribution of the metadata according to the load change, smoothly extend a metadata server, process the access to a hot content and well deal with the access to a single hot file. The method comprises that: the metadata server dynamically divides the distribution of the metadata on each metadata server according to the access condition of the metadata and manages the dynamically divided metadata according to the operation request of a client. The method and the system solve the problems of extensibility and load balance of the metadata server through dynamic division and the problem of consistency of the metadata through the management of the dynamically divided metadata.

Description

technical field [0001] The invention relates to a distributed file system dynamic metadata management method and system, belonging to the technical field of distributed storage system architecture. Background technique [0002] Existing distributed file systems usually include two parts: metadata server and intelligent storage nodes. The metadata server is responsible for processing metadata-related requests and rights management. The design of metadata server can be divided into two categories from the system architecture: centralized and distributed. For multi-data server architecture, the organization and division of metadata on these servers is an important factor in determining the performance and scalability of metadata services. Existing multi-data servers generally adopt three ways to organize metadata. [0003] Static subtree division: This method divides different directory subtrees fixedly to different metadata servers for processing. Since the directory subtr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30H04L29/08
Inventor 朱明冯幼乐
Owner UNIV OF SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products