Distributed file system management method, device and corresponding file system

Abstract

The embodiment of the invention discloses a distributed file system management method, a device and a corresponding file system. The distributed file system management method comprises the following steps of: receiving a file storage request sent by a client; searching a target distributed file system corresponding to a target file according to preset classification rule information, wherein the target file is a file requested by the file storage request; sending the file storage request to the target distributed file system according to a preset file storage protocol; and responding the file storage request of the client. The invention can solve the problem that the number of files stored by the distributed file system is restricted by the memory size of a metadata server, and ensure that when the memory of the metadata server can not be increased any more, the distributed file system can still be expanded through the mode of adding the metadata server. Meanwhile, the invention has the advantages of good expandability, easy realization and low cost.

Description

technical field [0001] The present invention relates to the field of computer electronics, in particular to a distributed file system management method, device and corresponding file system. Background technique [0002] Distributed File System (DFS, Distributed File System) means that the physical storage resources managed by the file system are not necessarily directly connected to the local node, but are connected to the node through a computer network. As the name suggests, it is a distributed + file system. It contains the connotations of these two aspects. From the perspective of file system customers, it is a standard file system that provides a series of APIs to create, move, delete files or directories, and modify files. read and write operations. From the perspective of internal implementation, the distributed system is no longer responsible for managing the local disk like the ordinary file system. Its file content and directory structure are not stored on the l...

AI Technical Summary

Problems solved by technology

[0004] As the functions of large-scale websites / systems increase, the demand for file storage will also increase. If all files are stored in a distributed file system, it will inevitably cause confusion in file management; in addition, the types and functions of various files The requirements for distributed systems are different. Some store small files and some store large files. If they are all put together, it will not be possible to optimize the distributed file system according to its functional characteristics.

[0005] In addition, the metadata servers of the current mainstream distributed file systems store metadata in memory, so the number of files that can be stored in the distributed file system is limited by the memory size of the metadata server, and the current hardware development speed has far exceeded Can't wait for storage files to grow faster

Therefore, the memory of the distributed file system metadata server has become a bottleneck restricting the development of the distributed file system

Images