Data transmission method and device, electronic equipment and computer storage medium

A data transmission method and data technology, applied in the computer field, can solve problems such as poor scalability of RDMAWrite, and achieve the effects of ensuring accuracy, improving scalability and flexibility, and zero-copy transmission

Pending Publication Date: 2021-09-21
ALIBABA GRP HLDG LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the limitations of the RDMA protocol itself, only 32-bit imm data can be used to carry relevant data when performing a write operation (RDMA Write), and the RDMA network card at the data receiving end can process the received data packet according to the data carried by the 32-bit imm data , but because Immdata is only 32 bits, it cannot be extended, making the existing RDMA Write poor in scalability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method and device, electronic equipment and computer storage medium
  • Data transmission method and device, electronic equipment and computer storage medium
  • Data transmission method and device, electronic equipment and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0020] Figure 1A It is a system including an RDMA network card according to Embodiment 1 of the present application. As shown in the figure, the system may include: a plurality of devices with data processing capabilities, Figure 1A Devices A, B, C, and D are shown as examples, but are not actually limited thereto.

[0021] Multiple devices may form any system, such as a distributed storage system, a cloud computing system, etc., which is not limited in this embodiment.

[0022] Multiple devices are connected through a network, and the network may be the Internet, an intranet, a local area network, a wide area network, a storage area network, etc., as long as the communication between multiple devices can be realized, which is not limited in this embodiment.

[0023] In this embodiment, each device can be provided with an RDMA network card (also known as RNIC), and multiple devices can perform remote direct memory access through the RDMA network card and the network. For exa...

Embodiment 2

[0060] figure 2 A schematic flowchart of the data transmission method provided in Embodiment 2 of the present application is shown. like figure 2 As shown, data transfer methods include:

[0061] S201. The data sending end sends the handshake information carrying the data length of the fixed-length data packet header to the data receiving end.

[0062] S202. The RDMA network card at the data receiving end registers a virtual continuous buffer according to the handshake information, and determines the memory address corresponding to the memory address that has a mapping relationship with the header storage area in the virtual continuous buffer according to the data length of the fixed-length data packet header The third address information of .

[0063] In this embodiment, the data length of the fixed-length data packet header can be agreed upon through the handshake information. Therefore, in subsequent steps, the data receiving end can directly separate the fixed-lengt...

Embodiment 3

[0087] image 3 It is a structural block diagram of a data transmission device in Embodiment 3 of the present application. The data transmission device is arranged at the data sending end. As shown in the figure, the data transmission device includes:

[0088] The address obtaining module 301 is used to obtain the first address information of the fixed-length data packet header set for data fragmentation, and the second address information of the data body corresponding to the data packet header, wherein the data sending end uses the RDMA network card Data transmission with the data receiving end;

[0089] An encapsulation module 302, configured to obtain a corresponding fixed-length data packet header and data body according to the first address information and the second address information, and encapsulate the fixed-length data packet header and data body into a data packet conforming to the RDMA protocol ;

[0090] The sending module 303 is configured to perform an RDMA ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data transmission method and device, electronic equipment and a computer storage medium, and the method comprises the steps: obtaining first address information of a fixed-length data packet header set for a data fragment and second address information of a data body corresponding to the data packet header through a data transmitting end, wherein the data transmitting end performs data transmission with a data receiving end through a RDMA network adapter; acquiring a corresponding fixed-length data packet header and the data body according to first address information and second address information through the data transmitting end, and packaging the fixed-length data packet header and the data body into a data packet complying with an RDMA protocol; and executing an RDMA write operation through the RDMA network adapter of the data transmitting end, and transmitting the data packet to a virtual continuous buffer area of the data receiving end, so that the data receiving end stores the fixed-length data packet header into the memory space indicated by the third address information, and the separation of the data body of the data packet and the fixed-length data packet header is realized.

Description

technical field [0001] The embodiments of the present application relate to the field of computer technology, and in particular, to a data transmission method, device, electronic device, and computer storage medium. Background technique [0002] With the continuous development of cloud storage systems, low latency has become a hot demand for cloud storage systems. The traditional TCP protocol cannot meet low latency storage requirements. Therefore, Remote Direct Access Memory (RDMA) technology is widely used. RDMA is a technology that directly performs data operations in the storage area of ​​the device during network data transmission without the intervention of the operating system and processor. Since there is no need for operating system and processor intervention, transfer times are greatly reduced and latency is reduced. [0003] When data is transmitted through the RDMA technology, if the amount of data to be transmitted is large, the data is generally sent directly ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L29/06
CPCH04L67/1097H04L69/06
Inventor 高翼枭邱昊楠李强
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap