Metadata server cluster load balancing method based on weight

A metadata server and cluster load balancing technology, applied in data exchange networks, electrical components, digital transmission systems, etc., can solve the problem that the inherent performance of the server is difficult to quantify without considering the heterogeneous situation of MDS cluster equipment, and achieves low overhead and high cost. The effect of overall throughput

Inactive Publication Date: 2014-07-09
HANGZHOU DIANZI UNIV
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The purpose of the present invention is to solve the problem that the existing technology does not consider the heterogeneous situation of equipment in the MDS cluster and the inherent performance of the server is difficult to quantify, the present invention proposes a weight-based metadata server cluster load balancing method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata server cluster load balancing method based on weight
  • Metadata server cluster load balancing method based on weight
  • Metadata server cluster load balancing method based on weight

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The method of the present invention is applied in an object storage system, and the object storage system is mainly composed of three parts, namely a client, an MDS cluster and an OSD cluster, see figure 2 . The OSD cluster stores data and metadata as objects; the client provides an access interface for users; the metadata server manages the file system name space (see image 3 ), control user access and map the physical storage location of files, and periodically share their respective load levels. When the load of a certain MDS exceeds a certain threshold of the cluster average value, it will start subtree migration, and select the appropriate one according to the overloaded load. The directory subtrees are migrated to nodes with lighter loads to balance the system load.

[0045] The general logic flow of the present invention is as follows, see Figure 4 :

[0046] 1 When the metadata server is under no load, the average operation delay of each metadata server un...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a metadata server cluster load balancing method based on weight. A metadata server is an important component of an object storage system and plays a role of managing a name space of a file system, controlling the user access and mapping the physical storage position of files. The metadata server cluster load balancing method based on weight comprises the steps of: collecting the service request quantity and the average operation delay of the parallel processing of metadata service; utilizing a least square method to perform linear fitting for the mapping relation curves of the service request quantity and the average operation delay; using the reciprocal of a curve slope of the fitted curve as inherent property of the metadata server; and proportionally allocating the work load by using the inherent property of the metadata server as weight, thereby supporting heterogeneous metadata server cluster. The method of the invention achieves low cost, dynamically regulates the work load, and keeps load balance of the metadata server cluster under heterogeneous condition of the equipment.

Description

technical field [0001] The invention belongs to the technical field of metadata server (MDS, MetaData Server) in network storage, and in particular relates to a weight-based method for dynamic load balancing of MDS clusters. Background technique [0002] Object-based Storage (OBS, Object-based Storage) technology stores file data and metadata separately, combines the advantages of traditional NAS and SAN, and has the advantages of fast access of SAN and cross-platform data sharing of NAS. Meanwhile, an object storage device (OSD, Object-based Device) itself has an intelligent management function. Therefore, the OBS system has the characteristics of high performance, scalability, high availability and strong security. The OBS system is mainly composed of three parts, namely the client, MDS cluster and OSD cluster. Among them, MDS plays the role of name space in the object storage system, controlling user access and mapping the physical storage location of files. Although t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L12/803H04L29/08
Inventor 徐向华钱伟张纪林万健殷昱煜蒋从锋任永坚
Owner HANGZHOU DIANZI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap