Method for uniformly distributing data in cloud storage

A balanced distribution, cloud storage system technology, applied in the field of cloud storage, can solve problems such as uneven distribution of storage nodes, uneven load, and no consideration of performance differences of storage nodes

Active Publication Date: 2012-05-16
CHINA STANDARD SOFTWARE
View PDF4 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the consistent hash function is a random function. When the number of storage nodes is small, it is likely to cause uneven distribution of storage nodes o

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for uniformly distributing data in cloud storage
  • Method for uniformly distributing data in cloud storage
  • Method for uniformly distributing data in cloud storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] In order to make the object, technical solution and beneficial effects of the present invention more clear, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0018] The following steps 1 to 4 describe the content of initializing virtual nodes with balanced distribution in the cloud storage system. The specific implementation process is as follows: figure 1 shown.

[0019] 1. Set the total number of virtual nodes and the number of copies of virtual nodes in the current cloud storage system. Usually, in order to ensure the balance of data distribution, the average number of virtual nodes on each storage node is preferably more than 100. The sum of the number of virtual nodes on each storage node is the approximate total number of virtual node...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for uniformly distributing user data in a cloud storage system, which comprises the following steps of: setting a total number of virtual nodes and a number of copies in the cloud storage system; setting a distribution weight of each storage node in the cloud storage system; determining the number of virtual nodes to be distributed according to the total number of the virtual nodes, the total number of the copies and the distribution weight of each node in the cloud storage system; uniformly distributing three copies of all the virtual nodes onto different storage nodes according to the number of the virtual nodes to be distributed of each node in the cloud storage system; when the data need to be stored, mapping the data to a certain virtual node by a hash function and then respectively storing three copies of the data into the three copies of the acquired virtual nodes; and when the storage nodes are added in or removed from the cloud storage system, acquiring information of the virtual nodes to be redistributed, recalculating the number of virtual nodes to be distributed of each available storage node and then redistributing the virtual nodes.

Description

technical field [0001] The invention belongs to the field of cloud storage, and in particular relates to a strategy for how to balance data in cloud storage. Background technique [0002] Cloud storage is a new concept extended and developed on the concept of cloud computing. It refers to a system that integrates a large number of different types of storage devices in the network through application software to work together through functions such as cluster applications, grid technology, or distributed file systems, and jointly provide data storage and business access functions to the outside world. When the core of cloud computing system computing and processing is the storage and management of large amounts of data, a large number of storage devices need to be configured in the cloud computing system, then the cloud computing system will be transformed into a cloud storage system, so cloud storage is a data storage and management as the core cloud computing system. [0...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
Inventor 兰雨晴李俊丽宋潇豫张永军夏颖
Owner CHINA STANDARD SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products