RDMA network data transmission method based on erasure code

A network data transmission and erasure code technology, applied in the network field, to achieve the effect of reducing computing overhead, reducing decoding overhead, and reducing encoding overhead

Active Publication Date: 2018-10-09
NANJING UNIV +2
View PDF6 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But at the same time, this also brings problems: the completion time of a data stream is determined by the last arriving data block, which will produce a long tail effect; and the receiver needs to implement a complex sorting algorithm to rearrange the original data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • RDMA network data transmission method based on erasure code
  • RDMA network data transmission method based on erasure code
  • RDMA network data transmission method based on erasure code

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings.

[0026] figure 1 It is a typical Clos structure data center network topology. The switch on the rack (ToR) is connected to the server on the rack (Rack) through d0 10G links, and then connected to the aggregation switch (Agg) through d1 40G links. Each aggregation switch is connected to d2 switches on racks (ToR) and d3 main switches (Spine). Therefore, there are d1 identical paths between hosts in the same aggregation area (pod), and d1*d3 identical paths between different areas across the main switch. For example, when d1=d3=8, there are 64 such paths. Making full use of these parallel paths and dividing the data stream into fine-grained data blocks for parallel transmission can effectively accelerate data transmission between nodes and reduce network delay of data transmission.

[0027] The data transmission method of the present inventi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an RDMA network data transmission method based on an erasure code. The method comprises the following steps that (1) a sending end acquires data of an application, segments thedata into fixed-size data frames, segments each frame of data into k data blocks with the same size, and sends the data blocks to a receiving end; (2) if the data block does not reach the receiving end in a specified time threshold, the sending end encodes the k data blocks to generate m check blocks, and sends the check blocks to the receiving end; and (3) one frame of data can be recovered by receiving any k of the k+m blocks by the receiving end, and one-time data transmission is completed when all the data frames are received. According to the method, redundant data is generated through the erasure code, so that the receiving end does not need to wait for a data packet on a delay path, and thus the transmission delay is reduced; and furthermore, by means of erasure code hardware unloading, the computing cost of a CPU is not increased.

Description

technical field [0001] The invention belongs to the field of network technology, and in particular relates to an erasure code-based RDMA network data transmission method. Background technique [0002] In the face of high-concurrency and low-latency applications such as cloud computing, big data, and artificial intelligence computing, the traditional TCP / IP software and hardware architecture cannot meet the needs. Because of the multiple memory copies, interrupt processing, context switching, complex TCP / IP protocol processing, store-and-forward mode and packet loss of the TCP / IP software and hardware architecture, excessive transmission delay and additional CPU computing overhead are caused. [0003] Remote Direct Memory Access (RDMA), as a complementary technology to TCP / IP, provides message services for direct access to virtual memory on remote machines. Since the RDMA network card can directly copy data, it can bypass the complex network protocol stack and minimize the p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L1/00
CPCH04L1/0006H04L1/0056H04L1/0061
Inventor 易怀杰叶保留陆桑璐
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap