Collaborative type log system facing to distribution-type file system

Abstract

The invention discloses a collaborative type log system facing to a distribution-type file system, and belongs to a distribution type file system. According to the collaborative type log system facing to the distribution-type file system, the problem that the system recovery operation can not be carried out caused by that a log record is lost due to equipment faults can be solved, and the write performance and the recovery performance of the distribution-type file system are improved. The collaborative type log system facing to the distribution-type file system comprises a log request module, a distribution module, N transmission modules, N consistency guaranteeing modules, N record adding modules, N record recovery modules and N restoring modules, wherein the log request module and the distribution module are operated on a metadata management node or a data storage node; and the transmission module, the consistency guaranteeing module, the record adding module, the record recovery module and the restoring module are all operated on each data storage node. According to the collaborative type log system facing to the distribution-type file system, which is disclosed by the invention, on the premise that the log reliability is guaranteed and the normal log action is performed, the write performance and the recovery performance of the distribution-type file system are improved by the characteristics that the network transmission efficiency in the distribution file system is higher than the low-speed transmission efficiency of storage equipment.

Description

technical field [0001] The invention belongs to a distributed file system, and in particular relates to a cooperative log system oriented to a distributed file system, so as to improve the writing performance and recovery performance of the distributed file system. Background technique [0002] The Internet and multimedia applications have led to an explosive growth trend of digital information, and the demand for storage in terms of both quality and quantity is also increasing. Faced with such a massive data storage demand, running on hundreds or even thousands of storage A large-scale distributed file system for devices came into being and was quickly applied in various fields. The distributed file system includes multiple metadata management nodes and multiple client nodes, each client node is connected to each metadata management node, and each metadata management node is connected to multiple data storage nodes. With the increase of storage devices used by the distribu...

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a distributed file system-oriented cooperative log system, which solves the problem that the system recovery operation cannot be performed due to the loss of log records due to equipment failure, and improves the writing performance and recovery performance of the distributed file system.