A data transmission method, device and system based on a data transmission system

Abstract

The present application provides a data transmission method, device and system based on the data transmission system, which are used to reduce the network transmission burden in the process of retransmitting data. The method includes sending a first request for obtaining first data to a first management node of at least one management node, so that the first management node sends a request for indicating L storage devices in the at least one storage node to at least one storage node The node sends K data blocks included in the first data and K first information first instructions corresponding to the K data blocks one-to-one; acquires M data blocks corresponding to the first data from L storage nodes, and M pieces of first information one-to-one corresponding to the M data blocks; according to the M data blocks and the M pieces of first information, determine from the L storage nodes the first data block corresponding to the first data block in the M data blocks that has a data error A storage node; sending a second request to the first storage node, so that the first storage node resends the first data block.

Description

technical field [0001] The present application relates to the field of communication technologies, and in particular to a data transmission method, device and system based on a data transmission system. Background technique [0002] Remote direct memory access (Remote Direct Memory Access, RDMA) transfers data to meet the low processing latency requirements of large data transfers. In the storage system, a piece of data may be stored in multiple storage nodes in a distributed manner. When the local server needs to obtain the data, it needs to send a data read request to multiple storage nodes, and each storage node in the multiple storage nodes registers the corresponding memory buffer, and then write the data blocks stored on each storage node into the registered memory buffer in turn, the local server obtains multiple data blocks in the memory buffer, and then combines multiple data blocks, Finally get that data. [0003] After the local server receives the corresponding...

AI Technical Summary

Problems solved by technology

[0003] After the local server receives the corresponding data blocks in turn, it will check whether one or some data blocks are wrong. Once a certain data block is wrong, the local server will ask each of the multiple storage nodes to retransmit the data. Multiple storage nodes need to repeat the above data transmission process, and the retransmission process of multiple storage nodes will consume network bandwidth and increase the burden of network transmission

Images