Packet-based metadata server cluster management method

A metadata server and cluster management technology, which is applied in electrical digital data processing, special data processing applications, instruments, etc., and can solve the problems of unbalanced MDS cluster load, fixed metadata mapping relationship, and low metadata positioning efficiency.

Active Publication Date: 2013-09-11
HUAZHONG UNIV OF SCI & TECH
View PDF5 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the above defects or improvement needs of the prior art, the present invention provides a group-based metadata server cluster management method,

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Packet-based metadata server cluster management method
  • Packet-based metadata server cluster management method
  • Packet-based metadata server cluster management method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0059] Such as figure 1 As shown, the grouping-based metadata server cluster management method of the present invention includes the following steps:

[0060] (1) Divide N MDSs in the Metadata Server (MDS for short) cluster into M groups. The number of the first group is 1, and the number of MDSs in the group is N 1 , the MDS numbers in the group are 1, 2, ..., N 1 ;The number of the second ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a packet-based metadata server cluster management method. The packet-based metadata server cluster management method includes that N MDSs (metadata servers) in an MDS cluster are divided into M packets, each packet contains only one primary MDS, the others are secondary MDSs; a Hash value range of an MD5 Hash algorithm is evenly divided into S subsections which are evenly distributed to N MDSs management in M packets; each MDS adopts one subsection positioning table inside a packet and one subsection positioning table outside the packet to store distribution records of the subsections; one optional MDS receives a metadata object location request, the corresponding subsection is calculated and located according to a metadata object path name; a subsection heat degree table is stored in each MDS, when one MDS returns query hit information of one subsection, the MDS calculates and updates heat degree corresponding to the subsection heat degree table thereof. By the method, the problems that metadata mapping relations are fixed, metadata targeting efficiency is low and MDS cluster load is unbalanced in an existing method can be solved.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more specifically relates to a group-based metadata server cluster management method. Background technique [0002] With the rapid development of the Internet, the scale of data is growing exponentially. Large-scale data storage and processing has become an urgent problem to be solved. Cloud computing is one of the popular solutions to meet this need. Cloud storage is a key issue in cloud computing, and metadata management plays an important role in cloud storage. Although the amount of metadata for managing data is relatively small relative to the data capacity of the entire storage system, usually less than 10%, statistics show that among all accesses to the file system, access to metadata accounts for about all 50% to 80% of the access times; therefore, the performance of the file system is mainly limited by the I / O performance of metadata, especially for data I / O-intensive app...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 谭支鹏崔捷冯丹杜立周炜陈俭喜
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap