A distributed file system data transmission method and system based on rdma network

A distributed file and network data technology, applied in the field of distributed file system data transmission, can solve the problems of large server load, large memory operation overhead, and prolonged transmission time, so as to reduce load, reduce overhead, reduce data replication and The effect of context switching

Active Publication Date: 2020-07-03
HUAZHONG UNIV OF SCI & TECH
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the above defects or improvement needs of the prior art, the present invention provides a distributed file system data transmission method and system based on an RDMA network. Combined together, it solves the technical problems of large memory operation overhead in the data transmission process existing in the existing distributed file system using RDMA network, as well as the technical problems of large server load and long transmission delay

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A distributed file system data transmission method and system based on rdma network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0043] Such as figure 1 As shown, the distributed file system data transmission method based on RDMA network of the present invention comprises the following steps:

[0044] (1) When the client receives a file access request from the user, it initiates an RDMA connection request to the server;

[0045] (2) After obtaining the RDMA connection request from the client, the server establishes an R...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed file system data transmission method based on an RDMA network. The method comprises the following steps: a client receives a file access request from a user; an RDMA connection request is initiated to the server; a server acquires an RDMA connection request from a client and establishes RDMA connection with a client; the client generates a network data accessrequest according to the file access request; the network data access request is sent to a server side by using RDMA connection; and the server analyzes the network data access request to obtain address information in the network data access request, obtains an address of a file corresponding to the address information in the memory of the server as a server return address according to the addressinformation, and sends the server return address and the RDMA remote access permission information to the client. According to the invention, the technical problem of high memory operation overhead in the data transmission process of the existing distributed file system can be solved, and the technical problems of high load and long transmission delay of the server side can be solved.

Description

technical field [0001] The invention belongs to the technical field of computer networks, and more specifically relates to a distributed file system data transmission method and system based on an RDMA network. Background technique [0002] With the rapid development of computer information technologies such as big data, cloud computing, and artificial intelligence in recent years, the scale of global Internet data has grown exponentially, and the demand for high-performance hardware from many high-concurrency and low-latency applications has led to the emergence of high-performance memories. . For high-performance storage, due to its strong I / O throughput on the storage side, the distributed file system needs to allocate more computing resources to complete data processing and data exchange, which increases the transmission delay of the system and limits the network capacity. Transmission capacity and system performance. In order to solve this problem, the Remote Direct M...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08G06F16/182
CPCG06F16/182H04L67/06H04L67/1097H04L67/141
Inventor 王桦周可阴智辉
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products