Peer-to-peer network transmission neighbor node selection method and system

Abstract

The invention discloses a peer-to-peer network transmission neighbor node selection method. The method includes the following steps that: connections are established between a central node and targetnodes in a cluster which download a target file; downloaded fragments of the central node are calculated, so that a first bit array is obtained, fragments stored in the target nodes are calculated, sothat second bit arrays are obtained; exclusive OR operation is performed on the first bit array and all the second bit arrays, so that the mutually-different data amount of the central node and eachtarget node can be obtained; and the target nodes are sequenced according to the large-to-small order of the mutually-different data amount, so that a sorted list can be obtained, and top N target nodes in the sorted list are selected as neighbor nodes. With the method adopted, data transmission rate can be improved under the premise that impact on the normal operation of a cluster task is decreased. The present invention also discloses a peer-to-peer network transmission neighbor node selection system, a computer readable storage medium and a server. The peer-to-peer network transmission neighbor node selection system has the advantages as the peer-to-peer network transmission neighbor node selection method.

Description

technical field [0001] The invention relates to the field of data storage, in particular to a method and system for selecting neighboring nodes in peer-to-peer network transmission, a computer-readable storage medium and a server. Background technique [0002] A data center is a facility that accommodates computing resources, network connections, storage, and other related components. For stability and availability, it usually includes safety facilities such as redundancy, backup power, and air conditioning, and specific data center equipment is often configured very high. Data transmission between nodes is the most common problem in the data center, such as virtual machine image distribution, and the transfer of intermediate results during parallel computing. How to quickly transfer data between machines in the cluster has also become one of the hotspots in the data center. [0003] The BitTorrent (bit stream) protocol is widely used in the Internet for file exchange. A fil...

AI Technical Summary

Problems solved by technology

[0004] In the existing technology, tit-for-tat is applied to the data center environment, not only the network bandwidth is much larger than that of the Internet, but also all the machines in the cluster complete specific tasks under the unified scheduling of the administrator. While ensuring the speed of data distribution, sufficient bandwidth must be reserved for data exchange between machines during normal operation. For example, when running Spark distributed computing tasks, nodes also need bandwidth to ensure the exchange of intermediate results. Using the Internet based on The neighbor node selection algorithm of the tooth-for-tooth strategy, each node will try its best to upload the data in order to download the data as soon as possible, which will undoubtedly give up the cost and chase the end, which will greatly affect the tasks running on it

Images