Method and system for load balancing of metadata service under cloud storage

A load balancing and data service technology, applied in the field of computer communication

Inactive Publication Date: 2014-04-30
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF4 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] For the MDS cluster, it only provides file metadata request services for users. The size of the file metadata is small and the request rate is high. However, there is no reliable solution in the prior art for how to achieve load balancing of the MDS cluster. Program

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for load balancing of metadata service under cloud storage
  • Method and system for load balancing of metadata service under cloud storage
  • Method and system for load balancing of metadata service under cloud storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Hereinafter, the present invention will be described in detail with reference to the drawings and examples. It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other.

[0022] The present invention provides a load balancing method for metadata services under cloud storage, comprising the following steps:

[0023] Evenly distribute file metadata in the system to different MDSs through static mapping strategy;

[0024] Obtaining the difference between the request response time of each MDS in the MDS cluster and the average response time of the entire MDS cluster and comparing the difference with a preset value;

[0025] If the difference is greater than or equal to the preset value, file metadata migration is performed according to a dynamic load balancing strategy.

[0026] Among them, the process of evenly distributing the file metadata in the system to different ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and system for load balancing of a metadata service under cloud storage. The method and system are applied to the field of computer communication. The method includes the following steps: evenly distributing file metadata in a system to different MDSs through the static mapping strategy, obtaining difference values of request response time of the MDSs in an MDS cluster and the average response time of the whole MDS cluster, comparing the difference values with a preset value, and conducting migration on the file metadata according to the dynamic load balancing strategy if the difference values are larger than or equal to the preset value. By means of the technical scheme, Hash operation is carried out on filenames, the file metadata are evenly distributed to the different MDSs, and therefore static load balancing between the MDSs in the MDS cluster is achieved; as the differences of the access frequencies of the file metadata are large, overweight loads on one certain MDS can be caused, dynamic load balancing is started at the time, and part of file metadata on the MDS with the overweight loads can be migrated to the MDSs with light loads.

Description

technical field [0001] The invention relates to the field of computer communication, in particular to a load balancing method and system for metadata services under cloud storage. Background technique [0002] With the development of computer technology and popularization of applications, information storage capacity has grown explosively, and the existing network storage system can no longer meet people's needs for storage; object storage (Object-Based Storage, OBS) technology came into being, it uses Existing processing technology, network technology and storage components can obtain unprecedented scalability and high throughput in a simple and convenient way, becoming the mainstream of next-generation network storage. [0003] In order to obtain high performance and high scalability of the object storage system, it is very important to avoid bottlenecks. Although the size of the file metadata occupies only a small space compared to the object data, because the file metada...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 闫冬冬颜秉珩张俊董青常建忠罗登亮栗丽霞
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products