Data balancing method and apparatus of storage device

A balancing method and object storage device technology are applied in the field of data balancing devices of storage devices, and can solve problems such as unbalanced data distribution.

Active Publication Date: 2017-11-03
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF5 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The object of the present invention is to provide a data equalization method and device for a storage device, which improves the defect of unbalanced data distri...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data balancing method and apparatus of storage device
  • Data balancing method and apparatus of storage device
  • Data balancing method and apparatus of storage device

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment

[0061] This specific embodiment is specifically as follows:

[0062] s1: Count the number of object storage devices in the storage system and the number of minimum storage units in each object storage device;

[0063] s21: Calculate the sum of the minimum number of storage units in each object storage device;

[0064] s22: Calculate the distribution average of the smallest storage unit;

[0065] s3: Judging whether the MAX_PG distribution average value * preset threshold is met, if not, it is judged that the distribution is uneven, and enters step s41;

[0066] Wherein, MAX_PG is the number of minimum storage units on the object storage device with the most distributed minimum storage units.

[0067] s41: Determine whether all preset weight adjustments corresponding to the current preset threshold are completed, if not, go to step s42; if yes, go to s44;

[0068] s42: Adjust the weight of the object storage device according to the preset adjustment principle, and redistribu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data balancing method of a storage system. The method comprises the following steps: counting the number of object storage devices in the storage system and the number of minimum storage units in each object storage device; calculating a total sum of the numbers of the minimum storage units in the object storage devices; calculating a distribution average value of the minimum storage units; judging whether the minimum storage units are uniformly distributed according to a preset balancing rule, if not, judging whether all preset weight adjustments are accomplished, if not, performing weight adjustment on the object storage devices according to a preset adjustment rule, and distributing the minimum storage units again after the adjustment; and counting the number of the minimum storage units in each object storage device again, and returning to a balancing judgment operation. The invention further provides a data balancing apparatus of the storage system. According to the data balancing method, the defect of unbalanced data distribution is improved by adjusting the weights of the OSDs so as to guarantee that capacities of the OSDs in storage pools are basically the same and improve the whole capacity utilization rate of the system.

Description

technical field [0001] The invention relates to the technical field of computer clusters, in particular to a data equalization method for a storage device, and also relates to a data equalization device for a storage device. Background technique [0002] With the increase of Internet business volume, the rapid growth of access volume and data flow, the processing intensity of each core part of the storage system is also relatively increased, which increases the system workload. Consistent Hash (hash algorithm) and CRUSH (Controlled Replication Under Scalable Hashing) algorithms are used in the storage system to calculate data distribution. In this process, the CRUSH algorithm uses PG (minimum Storage unit) is mapped to a group of OSDs (object storage devices), and each OSD should be distributed with a number of equal PGs. However, in the actual application environment, PGs will only be pseudo-randomly distributed on OSDs according to the CRUSH algorithm, so that the actual ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
CPCH04L67/10H04L67/1097
Inventor 李景要
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap