Load balancing method and device, node and computer readable storage medium

Abstract

The embodiment of the invention provides a load balancing method and device, a node and a computer readable storage medium, and relates to the field of distributed storage, and the method comprises the steps: determining the basic weight of each storage space based on the storage space residual rate of each storage node; judging whether the selection probability information of the storage node meets a weight correction condition or not, and if so, modifying the basic weight of the storage node according to the correction parameter to obtain a target weight of the storage node; if not, taking the basic weight of the storage node as a target weight of the storage node; forming a priority interval sequence of the storage nodes according to the target weights of all the storage nodes; obtaining a target storage node with the highest priority in the priority interval sequence of the storage nodes as a storage node for data writing. Compared with the prior art, the phenomenon that the load of the distributed system is unbalanced due to the fact that the selection mode of the storage nodes is improper in the data writing process can be avoided.

Description

technical field [0001] The present invention relates to the field of distributed storage, in particular to a load balancing method, device, node and computer-readable storage medium. Background technique [0002] With the rapid growth of Internet access and data traffic, the workload of the distributed storage system is also gradually increasing, resulting in greater processing pressure on the nodes in the system. When data is written into the distributed storage system, due to the different service capabilities of different nodes, the tasks assigned to each node are quite different, which will lead to a large difference in the storage capacity of each node, and the data distribution in the cluster is not consistent. Evenly, the load of the cluster and nodes is unbalanced. [0003] In order to solve the unbalanced load phenomenon, in the prior art, performance indicators such as disk utilization, central processing unit (Central Processing Unit, CPU) occupancy and memory oc...

AI Technical Summary

Problems solved by technology

When data is written into the distributed storage system, due to the different service capabilities of different nodes, the tasks assigned to each node are quite different, which will lead to a large difference in the storage capacity of each node, and the data distribution in the cluster is not consistent. Uniform, the cluster and nodes have unbalanced load

[0003] In order to solve the unbalanced load phenomenon, in the prior art, performance indicators such as disk utilization, central processing unit (Central Processing Unit, CPU) occupancy and memory occupancy are combined as the weight of the node, and the node corresponding to the maximum weight is selected. The node is used as the node for writing data. When performing dynamic load balancing, this method does not aim at disk space utilization. It only selects available nodes based on the level of some performance indicators, which may cause the node to be duplicated. Being selected makes the disk full in advance, and other nodes have no chance to be selected, so that in the process of data writing, the load of the distributed system cannot reach a balanced state due to improper selection of storage nodes

Images