A method of high concurrent data transmission based on rdma

A data transmission method and technology of a data transmission system, applied in transmission systems, electrical components, etc., can solve problems affecting system scalability and achieve the effects of reducing data duplication, reducing processing pressure, and efficient concurrency control

Active Publication Date: 2019-12-17
TSINGHUA UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, there is no general-purpose data transmission module to efficiently handle different network I / O characteristics. At the same time, in terms of concurrency control, a centralized synchronization model is still used, which seriously affects the scalability of the system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of high concurrent data transmission based on rdma
  • A method of high concurrent data transmission based on rdma
  • A method of high concurrent data transmission based on rdma

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0028] These and other aspects of embodiments of the invention will become apparent with reference to the following description and drawings. In these descriptions and drawings, some specific implementations of the embodiments of the present invention are specifically disclosed to represent some ways of implementing the principles of the embodiments of the present invention, but it should be understood that the scope of the embodiments of the present invention is not limited by this limit. On the contrary, the embodiments of the present...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a high-concurrency data transmission method based on RDMA, comprising: constructing a graded buffer before a client accesses a data transmission system; when performing remote data reading and writing, the client actively executes the user buffer, Data transfer between the grading buffer and the remote storage area; the server sets a lock field at the header of each independent data block in the remote storage area for concurrency control, when multiple clients read and write data concurrently , concurrency control is performed through a distributed lock protocol that locks locally on the server and unlocks remotely on the client. The present invention has the following advantages: reducing data duplication during file reading and writing, reducing server processing pressure, and providing efficient concurrency control.

Description

technical field [0001] The invention relates to the field of distributed storage systems, in particular to an RDMA-based high-concurrency data transmission method. Background technique [0002] Remote Direct Memory Access (RDMA) refers to direct access to remote memory without the direct participation of both host operating systems, thereby providing high bandwidth and low latency features. [0003] Data transmission in a distributed environment determines the overall I / O performance of the system, and this type of technology is widely used in distributed file systems and database systems. Traditional distributed systems mostly use disks as storage media, and transmit data through remote procedure call modules based on TCP / IP. Due to low disk bandwidth and high latency, the network transmission module itself will not become a bottleneck. In recent years, memory has become increasingly In-memory computing, which is cheap and transfers storage and computing to memory, has bec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/568
Inventor 陆游游舒继武陈游旻
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products