Unlock instant, AI-driven research and patent intelligence for your innovation.

A directory migration method and metadata load balancing method

A metadata and directory technology, applied in the field of directory migration method and metadata load balancing, can solve the problem of long waiting time of the client, and achieve the effect of improving experience and reducing waiting time

Active Publication Date: 2019-11-12
NEW H3C TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the purpose of this application is to provide a directory migration method and a metadata load balancing method, which are used to solve the problem in the prior art that the client waits too long due to a large amount of data migration during MDS load balancing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A directory migration method and metadata load balancing method
  • A directory migration method and metadata load balancing method
  • A directory migration method and metadata load balancing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043]For a distributed file system, each MDS node needs to periodically ensure its own load balancing, that is, each MDS node performs a heartbeat interaction every 10s, and the heartbeat information contains the load information of each MDS node (such as metadata popularity), When the MDS node finds that its own load exceeds a certain range of the average cluster load for a period of time, it needs to initiate subtree migration to balance the cluster load.

[0044] For example, if figure 1 As shown, there are currently 6 MDS nodes in the distributed file system. The MDS nodes are MDS0, MDS1, MDS2, MDS3, MDS4, and MDS5. After a heartbeat interaction, each MDS node obtains the load information of other MDS nodes. For the load information of each MDS in the cluster, the average metadata popularity of the cluster (hereinafter referred to as the average load) is 20,000. Therefore, the MDS2 and MDS5 nodes will perform load balancing. The load balancing process of MDS2 and MDS5 is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a directory migration method. The method is applied to the directory migration of metadata in a distributed file system. The method is characterized by comprising the steps of obtaining a current file quantity comprised in a to-be-migrated directory; when the current file quantity comprised in the to-be-migrated directory is greater than a set threshold, dividing the to-be-migrated directory into multiple sub-directories, wherein the current file quantity comprised in each sub-directory is smaller than or equal to the set threshold; and migrating each sub-directory to atarget node, and until the current file quantity comprised in the to-be-migrated directory is smaller than or equal to the set threshold, migrating the to-be-migrated directory to the target node.

Description

technical field [0001] The present application relates to the technical field of communication, and in particular, relates to a directory migration method and a metadata load balancing method. Background technique [0002] As a distributed file system, Ceph meets the requirements of large-scale applications by organizing the resources of multiple devices to provide unified, large-capacity, high-performance, and highly reliable file services. Usually distributed file systems mostly manage data and metadata separately (separation of data flow and control flow) to obtain higher performance and system scalability. Therefore, the metadata management model is crucial and directly affects the performance, scalability and reliability of the system. [0003] Ceph's metadata management methods are mainly divided into two types: centralized storage and distributed processing and distributed storage and distributed processing. Centralized storage and distributed processing save metada...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50G06F16/182G06F16/13G06F16/11
CPCG06F9/5083
Inventor 豆文明
Owner NEW H3C TECH CO LTD