Method and system for load transfer in metadata cluster

Abstract

The invention discloses a load transfer method and system in a metadata cluster, and relates to a metadata load transfer method among a plurality of servers in a metadata cluster. The method includes the steps that at least two metadata servers are established and used for establishing a load balancing module, a remote subdirectory pre-application module, a remote subdirectory establishing module, a remote subdirectory initialization module, a remote subdirectory deleting module, a remote subdirectory asynchronous releasing module and a remote subdirectory object recycling module; a client is established, a directory establishing request is sent to a metadata server where a parent directory is located, and a remote subdirectory object identifier is obtained and added into the directory entry of the parent directory; a directory deleting request is sent to the metadata server where the parent directory is located, and the remote subdirectory object identifier is deleted from the directory entry of the parent directory. The load transfer method and system in the metadata cluster only need a local consistency guarantee mechanism, do not need a distributed consistency guarantee mechanism, and effectively improve the remote subdirectory establishing and deleting performance.

Description

technical field [0001] The invention relates to a metadata load distribution technology of a cluster file system, in particular to a metadata load transfer method among multiple servers in a metadata cluster. Background technique [0002] In large-scale cluster file systems, the separation of metadata and data services has become a trend. On the one hand, data access does not need to go through the metadata server, but directly accesses the storage device in an out-of-band manner, so as to obtain high data access performance; on the other hand, the metadata server specifically provides metadata services, offloading the data access load, Therefore, a single metadata server can support higher client access performance, manage more storage devices, and support larger system scale expansion. However, with the continuous expansion of the system scale, a single metadata server has gradually become the bottleneck restricting the expansion of the system. In order to further improv...

AI Technical Summary

Problems solved by technology

[0016] The technical problem to be solved by the present invention is that in the prior art, the load distribution mechanism of the cluster file system among multiple metadata servers is highly complex and the cost of consistency maintenance is large. A new metadata load transfer method is provided. Distributed transactions are not used to ensure consistency during deletion and deletion, and disk synchronization is not required, which greatly improves system performance and reduces system implementation complexity

Images