Distributed file system access method and platform

Abstract

The invention discloses a distributed file system access method and a platform. The method comprises the steps of obtaining a write-in request of a client; judging whether the file size of a file to be written in corresponding to the write-in request is smaller than a threshold value of a preset file or not; if yes, determining the file type of the file to be written in as a small file, caching the file to be written in into a distributed redis cluster. The distributed redis cluster is adopted as a cache pool, the client writes in the file from a storage cluster of a rear-end magnetic disk, and the file is read from the redis cluster. It can be seen that for write-once read-many-times, on the condition that the file is small and is not deleted, during write-in, the small file is cached into the redis cluster, when read, the small file is read directly from the redis cluster, and the file reading delay is shortened; the redis cluster and the storage cluster of the rear-end magnetic disk are isolated, the redis cluster reading behavior cannot affect the write-in behavior of the rear-end magnetic disk, the pressure of the rear-end magnetic disk is reduced, and the file system performance is improved.

Description

technical field [0001] The invention relates to the technical field of file access, in particular to a distributed file system access method and platform. Background technique [0002] In the field of distributed cloud storage, in order to reduce file system capacity redundancy, erasure codes are usually used to store data, that is, one piece of data is written to multiple disks through erasure algorithms. When a file needs to be read, it is necessary to read data from multiple disks to obtain the final data, which requires multiple disks to participate in the read at the same time. When write-once-read-many is required, a large number of read requests will occupy the input and output (IO) of the disk, which will affect the bandwidth of the write request and put a lot of pressure on the file system, especially when the file to be written in the write request is small , the performance of the file system appears to be lower. [0003] In the prior art, a fast solid-state dis...

AI Technical Summary

Problems solved by technology

[0004] In this way, if the current writing pressure is high, the performance of the file system will also be affected due to the migration of hot data

Images