Organization method of client directory cache in distributed file system

Abstract

The invention discloses an organization method of a client directory cache in a distributed file system, wherein the distributed file system adopts a multi-metadata server framework, i.e. contents of a single directory are distributed on a plurality of metadata servers. The reason why the multi-metadata framework is adopted is mainly that the pressure of metadata access can be decentralized and the concurrency can be improved. According to the method, aiming at the characteristic that people write less but read more in network application, contents of a directory item and corresponding index nodes are remained in the cache of a client side, thereby avoiding the client side from communicating with the servers for multiple times when reading repeatedly; meanwhile when a directory is accessed for the first time, the directory items of the directory distributed on different metadata servers are pre-read, and the file index nodes and the file contents are pre-read according to a default pre-reading strategy or a pre-reading strategy issued by an application program. Consequently when the application program needs to access a certain file under the directory items, the metadata and data of the file are pre-read into the local cache of the client side already, so that the execution speed of the application program is accelerated greatly.

Description

technical field [0001] The invention relates to directory item management in a distributed file system, in particular to a method for organizing client directory cache in a distributed file system. Background technique [0002] With the rapid development of computer technology, various applications have an increasing demand for storage, among which network applications are the most typical. The storage requirements of network applications are roughly divided into two types. One is the storage requirements mainly for large files, such as video and audio network applications. This type of application is characterized by a small number of files, but the size of a single file is usually at the GB or even TB level. ;Another type of storage demand mainly for small files, such as online shopping malls, portals, etc., is characterized by a single file is not large, but the number of files is huge, usually tens of millions of files are stored in a single directory, and this Class fi...

AI Technical Summary

Problems solved by technology

[0005] The present invention aims at disclosing a method for organizing the cache of client directory items in a distributed file system, which can effectively solve the problem of low access efficiency of a large number of small files under a single directory in network applications