Distributed block file transmission method and system

Abstract

The invention discloses a distributed block file transmission method and system. The method comprises the following steps: 1) a client initiates a transmission request to a host on a distributed network through a message in a NETPACK2 format, wherein fields of the message comprise a command word field, a resource file number section and multiple resource IDs; 2) the host on the network blocks a resource file according to the resource IDs in the message, and generates a network message through each part of block data to send to a client according to a format of a NETPACK1 message protocol, wherein the fields of the message protocol comprise the command word field, a resource ID field, a file fragment number field, an ending ID field, a block data length field and a block data field; and 3)enabling each thread to find a path for saving the file according to the resource ID in the network message; and then finding the migration of the block data in the file according to the file fragmentnumber in the network message, and storing the data block to a location corresponding to the file.

Description

technical field [0001] The invention relates to a distributed file transmission method and system, belonging to the technical field of computer software. Background technique [0002] The HTTP / HTTPS protocol is a widely used protocol on the Internet. It is usually used for browser browsing and file transfer, but it does not support distributed file transfer. [0003] FTP protocol is a simple file transfer protocol, usually used for file transfer, but also does not support distributed file transfer. [0004] The BT protocol is also commonly referred to as the P2P protocol. It is a distributed file transfer protocol that supports distributed file transfers, and also supports breakpoint resumes. Files are transferred in blocks, and SHA-1 will be performed on the received file blocks. Checksum, so it will cause CPU performance loss here. Here, the BitTorrent protocol assumes that the hosts in the network expansion are untrustworthy, so it is necessary to verify the file blocks...

AI Technical Summary

Problems solved by technology

[0005] 1. Using SHA-1 to verify data blocks causes CPU performance loss;

[0006] 2. The introduction of verification has brought the complexity of the protocol, as well as the complexity of the BT protocol itself

[0007] 3. After removing the SHA-1 verification data block, there is no longer data integrity verification!

[0008] And if in a trusted network, if the SHA-1 verification of the BT protocol is removed, there will be no integrity verification of the data, so it is impossible to know whether the file is transmitted correctly, so for the above BT in the trusted network The shortcomings of the present invention are based on a trusted network, and a new distributed block file transmission method has been invented to effectively solve the above problems

Images