Distributed file storage device and method

Abstract

The invention provides a distributed file storage device. The distributed file storage device comprises a client side for managing and applying all requests and requesting for related files, storage nodes for obtaining service request messages to perform various operations relevant to the files and making feedback, resource management nodes for saving a network topological graph of clusters and the states of the storage nodes, adjusting the service emphasis of the clusters and performing periodical scanning, distributed message queues for establishing corresponding FIFO queues according to request categories, and a metadata storage subsystem for storing metadata of the files involved with the requests and the correspondence relation of the nodes where the files and replica sets are located. The invention further provides a distributed file storage method. By means of the technical scheme, the single-object type can be fully utilized to complete storage of multiple-object type of files based on an existing file storage mode, and multiple-object type involved and distributed file oriented universal and unified storage thought is established.

Description

[0001] technical field [0002] The present invention relates to the field of computer technology, in particular to a distributed file storage device and a distributed file storage method. [0003] Background technique [0004] At present, the demand for mass file storage is increasing. In addition to high-priced dedicated storage solutions, more and more IT companies, especially Internet companies, choose to use cheap and unreliable hardware. Through good architecture design, To build a reliable distributed file storage system in this way to reduce costs. Such as Taobao's TFS, Jingdong's JINGDONG FS, and open source FastDFS. However, most of these solutions are aimed at specific businesses and environments, and are difficult to operate and maintain. In the face of diverse production environments, a large amount of manual intervention is often required, which invisibly reduces hardware costs and increases labor costs. It eliminates the possibility of problems due to untim...

AI Technical Summary

Problems solved by technology

However, most of these solutions are aimed at specific businesses and environments, and are difficult to operate and maintain. In the face of diverse production environments, a large amount of manual intervention is often required, which invisibly reduces hardware costs and increases labor costs. The possibility of problems arising from untimely manual intervention

In addition, most of the current distributed file systems use synchronous storage, and the client and server must keep pace. That is to say, when one party operates, the other party needs to wait, which undoubtedly wastes a lot of precious system resources. resource

Finally, in the current distributed file system, most of the resources in the cluster are managed and allocated by a master node, and all addition, deletion, modification, and query operations must be decided with the master node, which increases the pressure on the master node and output possibility of problem

Images