Distributed-type metadata management method with dynamic equilibrium load

A technology of dynamic balancing and management methods, applied in the field of distributed file storage management, can solve problems such as heterogeneous performance differences, metadata server single point of failure, load balancing, etc., and achieve the effect of improving performance and storage quality

Active Publication Date: 2016-11-23
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF4 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a distributed metadata management method with dynamic load balancing to solve the problem of a single point of failure of a metadata server and the heterogeneous performance difference of metadata servers caused by metadata distributed in a metadata server cluster load balancing problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed-type metadata management method with dynamic equilibrium load
  • Distributed-type metadata management method with dynamic equilibrium load
  • Distributed-type metadata management method with dynamic equilibrium load

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Such as figure 1 As shown in the distributed metadata management method of the present invention that dynamically balances the load, the steps include:

[0026] a. Determine the weight of the relevant load parameters:

[0027] a1. Compare the importance of related parameters pair by pair, and construct a judgment matrix.

[0028] Define r1, r2, r3, and r4 as the weights of the four related parameters of the metadata server's CPU load, memory usage, IO bandwidth usage, and disk remaining space. The values ​​of the four weights are between 0 and 1. , and the sum is 1. The above four weights are represented by the scale of "1-9 value method", as shown in Table 1:

[0029] Table 1:

[0030]

[0031]

[0032] Use the "1-9 value method" to compare the importance factors of the indicators in the criterion layer to obtain the parameter judgment matrix, as shown in Table 2:

[0033] Table 2:

[0034]

r1

r2

r3

r4

r1

1

1 / 3

7

7

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a distributed-type metadata management method with dynamic equilibrium load. The distributed-type metadata management method includes a), determination of weight of related load parameters, namely determining degree of importance among the related load parameters to acquire a judgment matrix, and judging the matrix to perform calculation to acquire optimal solution of the load parameters; b), dividing of metadata, namely calculating distance between the metadata and metadata servers on a hash ring through hash function with consistency of the weight and according to current calculation capability of the metadata servers, and storing the metadata in the metadata servers with the shortest distance corresponding to the metadata. With the method, the metadata can be uniformly distributed in a cluster of the metadata servers according to the current state of the metadata servers, dynamic equilibrium load of the cluster of the metadata servers can be performed when load is in dynamic change, and performance and storage quality of the cluster of the metadata servers are greatly improved.

Description

technical field [0001] The invention relates to a management method for distributed file storage, in particular to a distributed metadata management method capable of dynamically balancing loads. Background technique [0002] With the rapid development of computer science and technology, the data generated, used, and stored by people is increasing at an alarming rate. In order to adapt to the scale effect brought by a large amount of data, a distributed file system came into being. [0003] The HDFS system is a typical representative of open source implementations in distributed file systems. It has powerful storage capabilities, can be expanded horizontally, and has high fault tolerance. However, the HDFS system also has corresponding defects. For example, the metadata server in HDFS has a single-point structure, which has defects in vertical expansion, availability and isolation. In order to improve the search speed of metadata, metadata is stored in HDFS memory. Althoug...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/24H04L29/08
CPCH04L41/0654H04L67/1004H04L67/1025H04L67/1034H04L67/1097
Inventor 卢国明罗光春田玲陈爱国
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap