Data transmission method, device and system based on data transmission system

A technology of data transmission system and data transmission method, which is applied in the field of communication, can solve problems such as consuming network bandwidth and increasing network transmission burden, and achieve the effect of reducing burden, reducing network transmission burden, and improving efficiency

Active Publication Date: 2019-01-01
RUIJIE NETWORKS CO LTD
View PDF8 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] After the local server receives the corresponding data blocks in turn, it will check whether one or some data blocks are wrong. Once a certain data block is wrong, the local server will ask each of the multiple storage nodes t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method, device and system based on data transmission system
  • Data transmission method, device and system based on data transmission system
  • Data transmission method, device and system based on data transmission system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0095] In order to better understand the technical solutions provided by the embodiments of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation manners.

[0096] In the field of data centers, in order to ensure the reliability of data storage, a big data may be stored in multiple storage nodes, and each storage node can communicate with each other, and the communication-connected storage nodes form a network topology. RDMA is a data transmission method suitable for the data center field born under the network topology. RDMA provides the ability to directly access devices stored in remote hosts, and it does not require computer operating system and CPU intervention during data transmission.

[0097] Please refer to figure 1 , is a schematic diagram of the existing RDMA data transmission scenario. The existing RDMA data transmission process mainly involves servers and storage nodes. The se...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a data transmission method, device and system based on a data transmission system which are used to reduce the network transmission burden in the retransmission data process. The method comprises the steps of: sending a first request configured to obtain first data to a first management node of at least one management node to allow the first management node to indicate L storage nodes in the at least one storage node to send K data blocks included in first data and first commands of K first information being in one-to-one correspondence with the K data blocks tothe at least one storage node; obtaining M data blocks corresponding to the first data in the L storage nodes and first information being in one-to-one correspondence with the M data blocks; accordingto the M data blocks and the M first information, determining first storage nodes corresponding to the first data blocks having data errors in the M data blocks from the L storage nodes; and sendinga second request to the first storage nodes to allow the first storage nodes to re-send the first data blocks.

Description

technical field [0001] The present application relates to the field of communication technologies, and in particular to a data transmission method, device and system based on a data transmission system. Background technique [0002] Remote direct memory access (Remote Direct Memory Access, RDMA) transfers data to meet the low processing latency requirements of large data transfers. In the storage system, a piece of data may be stored in multiple storage nodes in a distributed manner. When the local server needs to obtain the data, it needs to send a data read request to multiple storage nodes, and each storage node in the multiple storage nodes registers the corresponding memory buffer, and then write the data blocks stored on each storage node into the registered memory buffer in turn, the local server obtains multiple data blocks in the memory buffer, and then combines multiple data blocks, Finally get that data. [0003] After the local server receives the corresponding...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L1/18H04L1/00
CPCH04L1/0018H04L1/18H04L1/1829H04L1/1867
Inventor 陈小龙朱丽品
Owner RUIJIE NETWORKS CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products