A method of data transmission in rdma network based on erasure code

A technology of network data transmission and erasure codes, which is applied in the network field to achieve the effect of simplifying data transmission, reducing decoding overhead, and reducing encoding overhead

Active Publication Date: 2021-06-25
NANJING UNIV +2
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But at the same time, this also brings problems: the completion time of a data stream is determined by the last arriving data block, which will produce a long tail effect; and the receiver needs to implement a complex sorting algorithm to rearrange the original data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method of data transmission in rdma network based on erasure code
  • A method of data transmission in rdma network based on erasure code
  • A method of data transmission in rdma network based on erasure code

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings.

[0026] figure 1 It is a typical Clos structure data center network topology. The switch on the rack (ToR) is connected to the server on the rack (Rack) through d0 10G links, and then connected to the aggregation switch (Agg) through d1 40G links. Each aggregation switch is connected to d2 switches on racks (ToR) and d3 main switches (Spine). Therefore, there are d1 identical paths between hosts in the same aggregation area (pod), and d1*d3 identical paths between different areas across the main switch. For example, when d1=d3=8, there are 64 such paths. Making full use of these parallel paths and dividing the data stream into fine-grained data blocks for parallel transmission can effectively accelerate data transmission between nodes and reduce network delay of data transmission.

[0027] The data transmission method of the present inventi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an erasure code-based RDMA network data transmission method. The method includes the following steps: (1) The sending end obtains application data, divides the data into data frames of a fixed size, and then divides each frame of data Divide into k data blocks of the same size, and then send them to the receiving end; (2) If there are still data blocks that have not arrived at the receiving end within the specified time threshold, the sending end encodes the k data blocks to generate m checksums block, and send the check block to the receiving end; (3) the receiving end can recover a frame of data after receiving any k of the k+m blocks, and completes a data transmission when all data frames are received. The invention generates redundant data through the erasure code so that the receiving end does not have to wait for the data packet on the delay path, thereby reducing the transmission delay; through the erasure code hardware unloading, the calculation overhead of the CPU is not increased.

Description

technical field [0001] The invention belongs to the field of network technology, and in particular relates to an erasure code-based RDMA network data transmission method. Background technique [0002] In the face of high-concurrency and low-latency applications such as cloud computing, big data, and artificial intelligence computing, the traditional TCP / IP software and hardware architecture cannot meet the needs. Because of the multiple memory copies, interrupt processing, context switching, complex TCP / IP protocol processing, store-and-forward mode and packet loss of the TCP / IP software and hardware architecture, excessive transmission delay and additional CPU computing overhead are caused. [0003] Remote Direct Memory Access (RDMA), as a complementary technology to TCP / IP, provides message services for direct access to virtual memory on remote machines. Since the RDMA network card can directly copy data, it can bypass the complex network protocol stack and minimize the p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L1/00
CPCH04L1/0006H04L1/0056H04L1/0061
Inventor 易怀杰叶保留陆桑璐
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap