Distributed load balancing system and distributed load balancing method based on peer to peer (P2P) technology

Abstract

Provided are a distributed load balancing system and a distributed load balancing method based on the peer to peer (P2P) technology. The system is composed of a distributed processing cluster with the load balancing function. A plurality of isomorphism or isomerism processing nodes formed by processing layers and communication layers and distributed in different servers are arranged in the cluster. Each processing node can independently bear the distributed arbitral load balancing function, the authority limits and the functions are identical, and only incident processing speeds are different. When a client transmits mass data processing requests in real time to the distributed processing cluster, one processing node packages the generated middle result as the incident and transmits the incident to other processing nodes to be processed after the processing node finishes request processing. The processing nodes adopt the distributed load balancing method to ensure load balancing of incident distribution in the whole incident distribution process till the final results is generated and returned to the client. The system and the method effectively avoid load balancing with single point failure and are capable of achieving load balancing with node dynamic change in a distributed cluster system.

Description

technical field [0001] The invention relates to a distributed load balancing system and method based on peer-to-peer (Peer-to-Peer) technology, belonging to the technical field of computer networks. Background technique [0002] With the rapid growth of network traffic, access and data traffic, server cluster technology has been widely used and researched, and load balancing technology, as an important part of server cluster technology, has also been extensively and deeply researched and applied. [0003] At present, load balancing technology has a lot of research in the fields of business load management of commercial web services, computing task load management in grid computing, computing task load management in parallel computing, and computing resource load management in cloud computing. and practical application. [0004] According to the arbitration method, load balancing technology is mainly divided into centralized arbitration load balancing and distributed arbitra...

AI Technical Summary

Problems solved by technology

However, this scheme does not consider the load of the nodes. Moreover, the load distribution of each node in the system is closely related to the requested keyword, resulting in a relatively high probability of unbalanced load of each node in the system. Therefore, Although based on the Kademlia algorithm, it also solves the dynamic change of processing nodes and the fast data access process in a distributed cluster environment like the Chord algorithm.

However, their common disadvantage is that there is no load balancing strategy, and the nodes in the system may be overloaded or underweight

However, this processing still cannot solve the load balancing problem in a distributed cluster environment well. The reasons are: firstly, because of the existence of a strong virtual node layer, when a physical node changes, the mapping from the weak node to the strong virtual node needs to be changed relationship and the mapping relationship between strong virtual nodes and reference values, the change of a weak node may also cause the change of its neighbor strong virtual nodes; therefore, when the system scale is large and the dynamic changes of nodes are frequent, the change of strong virtual nodes will give the system The overhead will seriously affect the overall performance and stability of the system

Secondly, because its strong virtual nodes are a collection of multiple weak nodes, that is, the actual processing nodes, the balanced mapping from the reference value to the strong virtual nodes in the second layer only ensures the balance of the request to the weak node set, and does not realize the distributed Load balancing in the global sense of the cluster system

Images