Supercharge Your Innovation With Domain-Expert AI Agents!

Remote file access method for distributed memory file system

An in-memory file system and remote file technology, applied in the field of remote in-memory file data, can solve the problems of time-consuming RPC, high system resource overhead, occupation of computing resources of the server computer, etc., to achieve improved read and write performance and stable data read and write performance Effect

Inactive Publication Date: 2017-12-19
诸葛晴凤 +1
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0016] The disadvantages of method 1 are: 1) Each data read and write access needs to perform 4 RPC operations, and RPC is a time-consuming operation; 2) Each data read and write access needs to arouse the operating system of the server computer, occupying the service Computing resources of the end computer; 3) Every read and write access to data requires the server computer to create a buffer and copy the data to the buffer
However, if the user requests to access multiple pages, limited by the file organization method of the existing file system, the second method must decompose the access to the file data of multiple pages into multiple accesses to the file data of one page, and each access Request access to data for only one page
Since it is necessary to perform 4 RPC operations and evoke the operating system of the server computer every time the data of a page is accessed, the second method will also lead to high system resource overhead and low access performance to remote memory files with large amounts of data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Remote file access method for distributed memory file system
  • Remote file access method for distributed memory file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] Such as figure 1 as shown, figure 1 Take a system of two computers and one RDMA switch as an example, in which each computer is equipped with an RDMA-specific network card (hardware) and memory (hardware) used as a storage device. The file server needs to mount the memory file system (software) that manages memory devices, and the client can choose whether to mount the memory file system according to needs. The computer is connected to a high-speed RDMA network through an RDMA switch and a proprietary RDMA network cable.

[0057] Computers can use ordinary remote communication protocols such as sockets, remote procedure calls and other mature technologies to transmit information. In the case of knowing the memory address of the server computer, you can also use RDMA technology to directly access the memory in the RDMA area set by the other party. .

[0058] In this embodiment, the computer where the user process is located is the "client computer", and the non-client...

Embodiment 2

[0070] Such as figure 2 As shown, this embodiment provides a method for efficiently accessing remote files by a distributed memory file system using network technology that can directly access the memory of a remote computer system. Address space, the client computer obtains the starting address of the continuous virtual address space; the second stage is to use this continuous virtual address space and RDMA to access remote memory files. The two stages are described below,

[0071] The first stage:

[0072] S1 The client computer sends a request to open the file in the server computer through RPC;

[0073] After the S2 server computer receives the request to open the file, it allocates a large enough continuous virtual address space VA to the file to be opened;

[0074] The S3 server computer analyzes the page table corresponding to the virtual address space VA and inserts the mapping table of the file into the page table item corresponding to the virtual address space VA...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a remote file access method for a distributed memory file system. The remote file access method for the distributed memory file system comprises the steps that: a client computer sends a request for opening a remote memory file to a server computer; a server distributes a continuous virtual address space VA to a corresponding memory file, and establishes mapping from file data to the VA; the server sends the initial address of the virtual address space of the file to a client; the client calculates the virtual address of the memory file data of the server according to a remote file reading and writing request of a user; and the client directly accesses a physical memory corresponding to the virtual address of the server through network equipment, and reads and writes the remote memory file. According to the remote file access method for the distributed memory file system disclosed by the invention, when the remote memory file is read and written, the server sends the initial address of the virtual address space of the file to the client only for one time; then, when the client reads and writes the same file, the server does not need to send the address; therefore, the reading and writing performance of the remote memory file is greatly improved; furthermore, few server computing resources can be occupied; and little influence of a server load exists.

Description

technical field [0001] The present invention relates to the technical field of computer software, in particular to a method for efficiently accessing remote memory file data in a distributed memory file system by using a network technology (for example, RDMA) that can directly access the memory of a remote computer system in a distributed system or a remote system architecture . Background technique [0002] The full name of RDMA (Remote Direct Memory Access) technology is Remote Direct Memory Access. RDMA technology includes dedicated high-speed optical fibers, RDMA network cards, switches and network protocols. Multiple computers equipped with RDMA network cards can be connected through switches and high-speed optical fibers to form a data network. Computers in this network can directly access the memory of other computers through RDMA technology. To use RDMA technology for remote access to memory data between any two computers, you must first establish an appropriate R...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L29/06G06F17/30
CPCH04L67/025G06F16/172G06F16/182H04L67/60H04L67/133Y02D30/50
Inventor 沙行勉诸葛晴凤
Owner 诸葛晴凤
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More