Distributed storage control method based on virtual ring load balancing algorithm

A load balancing algorithm and distributed storage technology, applied in the field of data processing, can solve the problems of high cost, low efficiency, affecting system performance and scalability, etc., to improve monotonicity, avoid data movement, and eliminate the impact of data mapping Effect

Inactive Publication Date: 2017-09-12
TONGREN POWER SUPPLY BUREAU
View PDF7 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Through calculation, we found that in order to increase the storage capacity of the cluster by 1%, it is necessary to move 9,900,989 data items, which is 99.01% of the data items! Obviously, this algorithm seriously affects the performance and scalability of the system
[0011] Obviously, this low-efficiency and high-cost implementation method is not a good solution. It is necessary to design a new storage control method. By using ordinary hardware to build a redundant and scalable distributed object storage cluster, the storage The capacity can reach a higher level, and the cost can be controlled

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed storage control method based on virtual ring load balancing algorithm
  • Distributed storage control method based on virtual ring load balancing algorithm
  • Distributed storage control method based on virtual ring load balancing algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be understood that the preferred embodiments are only for illustrating the present invention, but not for limiting the protection scope of the present invention.

[0033] Such as figure 1 Shown, method of the present invention comprises the following steps:

[0034] Step 1: The user remotely uploads and saves large-capacity data through the client;

[0035] Step 2: Segment the data;

[0036] Step 3: Perform a hash algorithm for each data segment to calculate the key value;

[0037] Step 4: The client processes and encapsulates the Key value of the segmented data block, unique data identification information and timestamp information, etc., and submits it to the server. The server returns the node IP address corresponding to each data block to the client, and then starts Concurrent data upload;

[0038] Step 5: The virtual ri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed storage control method based on a virtual ring load balancing algorithm. By introducing a consistent hashing algorithm, the change of the number of data items caused by increased nodes can be reduced, and the monotonicity can be improved; and by introducing a virtual ring and a historical modulus table, the problem of data movement caused by the change of the number of storage nodes can be avoided. According to the method disclosed by the invention, the impact of the storage medium size on data mapping can be eliminated, and good redundancy characteristics and high scalability of the cloud storage capacity can be achieved on the basis of ensuring load balancing.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a distributed storage control method based on a virtual ring load balancing algorithm. Background technique [0002] With the development and application of distributed cloud storage technology, the industry gradually accepts the use of fragmented storage and distributed load balancing in the cloud storage system as the main technical means to divide large-capacity files into multiple objects. Store them in different physical media. [0003] A key issue in distributed object storage is how to store data. The ring-shaped mapping space is the most important concept, which is used to record the mapping relationship between storage objects and physical locations. [0004] Map rings are used to determine where data resides in the cluster. The position of each node in the map ring space is maintained by a logical "ring" and stored in the map. The ring space uses the concept...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/1097H04L67/1001
Inventor 李亚林方曦詹乐贵陈潇瑞龙章勇陈晖
Owner TONGREN POWER SUPPLY BUREAU
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap