Method and system for load balancing of metadata management in distributed file system

A distributed file and load balancing technology, which is applied in the field of computer networks, can solve problems such as the inability to achieve smooth expansion of the metadata service system, dynamic adjustment of metadata without hotspots, etc., and achieve the effect of improving utilization

Inactive Publication Date: 2010-04-21
UNIV OF SCI & TECH OF CHINA
View PDF0 Cites 81 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, traditional metadata management only provides metadata services by simply backing up metadata service node

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for load balancing of metadata management in distributed file system
  • Method and system for load balancing of metadata management in distributed file system
  • Method and system for load balancing of metadata management in distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] Specific embodiments of the load balancing method and system for metadata management in a distributed file system according to the present invention will be described in more detail below with reference to the accompanying drawings.

[0040] figure 1 A system configuration diagram of load balancing for metadata management in a distributed file system according to the present invention is shown. Such as figure 1 As shown, the system includes an information communication module, which is used for information interaction between metadata service nodes during operation; a metadata operation module, which is used to complete operations on metadata objects according to user metadata requests; metadata service node management Module, used for node management of metadata service nodes; metadata management module, used for decision-making of dynamic load balancing strategy; metadata policy execution module, used for execution of metadata replication or migration strategy; workl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a system for load balancing of metadata management in a distributed file system. When the data structure of metadata, i.e. a directory tree, becomes hotspot metadata, the access heat degree of the directory tree is updated through adopting a mode of copying the metadata; when the load balancing degrees of service nodes of the metadata exceeds a preset value, partial working loads are transferred to underload nodes from overload nodes through adopting a mode of transferring the metadata; and the loading balancing among a plurality of the metadata service nodes is realized through the two modes. The system comprises an information communication module, a metadata operation module, a metadata service node management module, a metadata management module, a metadata strategy implementation nodule and a working load acquisition module. The invention improves the utilization rate of metadata service resources through the two modes of copying and transferring the metadata so as to achieve the purpose of load balancing, thus a metadata service system can be smoothly expanded.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular to a load balancing method and system for metadata management in a distributed file system. Background technique [0002] With the further development of information technology and the large-scale application of the network, the explosive growth of data has been brought, and the network storage has also brought great development. Among them, the large-scale distributed file system built on the basis of the object storage structure has strong scalability, high reliability, and can provide strong concurrent data processing capabilities. Therefore, metadata service management is very important in large-scale distributed file systems. important. Based on the study of cluster load balancing, designing and implementing a load balancing scheme that combines static load distribution and dynamic feedback redistribution of metadata management clusters has become an important topic ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/56H04L29/08
Inventor 朱明肖培棕
Owner UNIV OF SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap