Load balancing method and system

A technology of load balancing and physical storage nodes, applied in transmission systems, electrical components, etc., can solve problems such as high space occupancy rate of storage devices, unbalanced load, unavailable storage system space, etc.

Inactive Publication Date: 2015-12-23
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF3 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the two-level hash algorithm is not an absolute load balancer. When there are fewer storage nodes and the system capacity is heavily used, the load imbalance will gradually be exposed.
Especially when the storage capacity of the entire storage system is close to but not up to the upper limit, due to the unbalanced load, there may be a particularly high space occupancy rate of some object storage devices
Due to program design, individual fully loaded object storage devices will cause the remaining space of the entire storage system to be unavailable, resulting in poor user experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Load balancing method and system
  • Load balancing method and system
  • Load balancing method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0035] The invention provides a load balancing method. In a distributed object storage system, a two-level hash algorithm can efficiently solve the problem of how to determine which storage node in the distributed storage system a certain storage object should be allocated to. In the process of establishing the mapping relationship between storage objects and storage nodes, an intermediate layer is introduced, which is called a placement group. In this way, th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a load balancing method and system. The load balancing method comprises: using a preset hash function to calculate a hash value for each physical storage node, respectively determining the position of each physical storage node on a hash ring according to each hash value, respectively adding a preset number of virtual storage nodes for each physical storage node, calculating a corresponding number of hash values according to the number of the virtual storage nodes corresponding to each physical storage node, respectively determining the position of each virtual storage node on the hash ring according to the hash value corresponding to each physical storage node, and mapping each virtual storage node to the corresponding physical storage node. The virtual storage nodes and the mapping to the physical storage nodes are added to load storage objects to the storage nodes in a more balanced manner to reduce the computation burden of re-locating the storage objects in a failure recovery process.

Description

technical field [0001] The invention relates to the field of distributed object storage systems, in particular to a load balancing method and system. Background technique [0002] With the rapid development of network applications, the amount of network information data is increasing, and PB-level mass data storage is becoming more and more important. The traditional file system can no longer meet the requirements of large capacity, high reliability, and high performance of existing applications. In order to meet these new requirements, the application of new distributed object storage systems has been widely valued and applied. [0003] In a distributed object storage system based on two-level hashing, the two-level hashing algorithm of hashing and consistent hashing is used to locate the object, that is, for a given object, its name is determined by the hash result of its object name. The object storage device where it resides. This method does not require query operatio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/1001
Inventor于涛张立强
OwnerINSPUR BEIJING ELECTRONICS INFORMATION IND