Distributed memory file management system

Abstract

The invention discloses a distributed memory file management system. The system is provided with a metadata storage server and a file data storage server, the metadata storage server is used for managing metadata information of the system and related information of the file data storage server; wherein the file data storage server is used for storing file data blocks, and the client obtains the physical addresses of the file data blocks through the metadata storage server and then directly accesses the physical memories of the file data blocks in the file data storage server through RDMA single-side reading and writing. The system has the effects that the overhead of querying the file data block index in the local file system of the file data storage server is avoided, and meanwhile, metadata can be stored in a client cache by utilizing index prefetching and space predistribution, so that the communication frequency of requesting the metadata storage node to query the index by the client is reduced, and the data access performance is further improved.

Description

technical field [0001] The invention relates to computer memory management technology, more specifically, a distributed memory file management system. Background technique [0002] In recent years, the emerging non-volatile memory (Non-Volatile Memory, referred to as NVM) has the characteristics of being addressable by byte, data is not lost when power off, and the read and write performance is close to that of DRAM. Access (RDMA for short) technology provides opportunities for efficient remote data access. Existing distributed memory file systems are trying to integrate NVM and RDMA technologies into the file system to improve data access performance. [0003] However, these distributed memory file systems strictly separate the file system and the network layer, and only replace the communication module through the RDMA library, or use NVM to replace the main memory and local storage media, without reconstructing the internal file system mechanism. This layered and heavy ...

AI Technical Summary

Problems solved by technology

[0003] However, these distributed memory file systems strictly separate the file system and the network layer, and only replace the communication module through the RDMA library, or use NVM to replace the main memory and local storage media, without reconstructing the internal file system mechanism

This layered and heavy software design makes the distributed memory file system too heavy to take full advantage of emerging high-speed hardware

Images