Unlock instant, AI-driven research and patent intelligence for your innovation.

Load balancing method in distributed data storage system

A technology of distributed data and storage system, applied in the field of distributed data storage, can solve problems such as unbalanced resource allocation, achieve efficient use, and achieve the effect of space

Inactive Publication Date: 2021-02-09
南京泛函智能技术研究院有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the present invention provides a load balancing method in a distributed data storage system, which can solve the problem of unbalanced resource allocation in a distributed data storage system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Load balancing method in distributed data storage system
  • Load balancing method in distributed data storage system
  • Load balancing method in distributed data storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] The embodiment of the present invention provides a method for constructing a node load status queue, and the method flow includes:

[0026] Define the user access node as AN, the node list in the distributed system as LN, the node as Ni, the node storage space as SNi, define the node load status queue NQ, and define the node load status queue construction algorithm as BNQ.

[0027] The user access node AN requests the storage space SNi from each node Ni in turn according to the node list LN, and then constructs the node load status queue NQ according to the queue construction algorithm BNQ.

[0028] Algorithm 1: Node load status queue construction algorithm

[0029]

[0030] In this way, the construction of the node load queue NQ is realized, which prepares for the subsequent balanced distribution of content.

Embodiment 2

[0032] The embodiment of the present invention provides a method for acquiring global file storage status:

[0033] Define the list of files to be stored in the user access node AN as FL, the size of each file as FSj, define the file buffer queue FQ, and define the file buffer queue construction algorithm as BFQ.

[0034] The user access node AN constructs the file buffer queue FQ according to the file buffer queue construction algorithm BFQ according to the size FSj of each file in the file list FL to be stored.

[0035] Algorithm 2: File buffer queue construction algorithm BFQ

[0036]

[0037]

[0038] In this way, the construction of the file buffer queue FQ is realized to prepare for the subsequent balanced distribution of content.

Embodiment 3

[0040] Combining the contents of the first and second embodiments above, this embodiment provides a content distribution algorithm CDF. Method, the specific method process of this embodiment is:

[0041] Algorithm 3: Content Distribution Algorithm CDF

[0042] Input: node load status queue NQ, file buffer queue

[0043] FQ

[0044] Output: the key-value pair column of the corresponding relationship between the file and the cache host

[0045] Table HL

[0046]

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a load balancing method in a distributed data storage system. The method comprises the following steps: constructing a load condition queue of nodes in a system through a real-time node storage condition and a proposed node load priority rule; constructing a file buffer queue by real-time file information in the buffer pool to be uploaded and the proposed file priority rule; through a proposed content distribution scheme, selecting a specific storage node and a specific file in the file buffer queue to distribute a file with load balancing. Through the implementation ofthe scheme, the files in the distributed data storage system occupy resources of different distributed nodes in a relatively balanced manner, and the overall load of the system is in a relatively dynamic balanced state, so that the real-time efficient utilization of space is realized.

Description

technical field [0001] The invention relates to the field of distributed data storage, in particular to a load balancing method in a distributed data storage system. Background technique [0002] With the rapid development of computer technology and network technology, the application of data storage technology is becoming more and more extensive. Traditional database technology is becoming more and more mature, and database applications have been generally established on computer networks. At this time, the centralized database system shows its shortcomings: the data has been distributed and stored on the network according to the actual needs, and then the centralized processing will inevitably cause a large communication overhead; If there is a fault, the entire system will be affected, and the reliability is not high; the scale and configuration of the system caused by centralized processing are not flexible enough, and the scalability of the system is poor. In this sit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50G06F16/22G06F16/27
CPCG06F9/5083G06F16/22G06F16/27
Inventor 杨树杰许长桥郝昊赵楠皮文超熊永平
Owner 南京泛函智能技术研究院有限公司