A distributed memory file system based on rdma

A memory file system and file system technology, applied in the field of distributed memory file systems, can solve problems affecting system scalability, etc., and achieve the effects of reducing data duplication, improving overall efficiency, and reducing response delays

Active Publication Date: 2020-01-17
TSINGHUA UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, there is no general-purpose data transmission module to efficiently handle different network I / O characteristics. At the same time, in terms of concurrency control, a centralized synchronization model is still used, which seriously affects the scalability of the system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed memory file system based on rdma
  • A distributed memory file system based on rdma
  • A distributed memory file system based on rdma

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0029] These and other aspects of embodiments of the invention will become apparent with reference to the following description and drawings. In these descriptions and drawings, some specific implementations of the embodiments of the present invention are specifically disclosed to represent some ways of implementing the principles of the embodiments of the present invention, but it should be understood that the scope of the embodiments of the present invention is not limited by this limit. On the contrary, the embodiments of the present...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an RDMA (Remote Direct Memory Access)-based distributed memory file system. In an initialization phase of the distributed memory file system, memory used by a cluster for filestorage is uniformly divided, and is registered to network cards to support direct memory access of remote-end nodes, and then a distributed shared memory pool is constructed; on the distributed memory sharing pool, file indexing and file data block indexing are respectively carried out through two-level hash indexing to provide query services for the file system; and a request of a client is processed through a self-identifying remote-procedure-call (RPC) method, and a processing result is returned. The system has the following advantages: reducing data copying of files in reading / writing, reducing response delay, and improving overall efficiency of file access in program software.

Description

technical field [0001] The invention relates to the field of distributed storage systems, in particular to an RDMA-based distributed memory file system. Background technique [0002] Remote Direct Memory Access (RDMA) refers to direct access to remote memory without the direct participation of both host operating systems, thereby providing high bandwidth and low latency features. [0003] Data transmission in a distributed environment determines the overall I / O performance of the system, and this type of technology is widely used in distributed file systems and database systems. Traditional distributed systems mostly use disks as storage media, and transmit data through remote procedure call modules based on TCP / IP. Due to low disk bandwidth and high latency, the network transmission module itself will not become a bottleneck. In recent years, memory has become increasingly In-memory computing, which is cheap and transfers storage and computing to memory, has become a trend...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0611G06F3/064G06F3/067
Inventor 陆游游舒继武陈游旻
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products