Method, device and medium for adjusting main pg equalization of distributed storage system

A distributed storage, balanced adjustment technology, applied in the input/output process of data processing, instruments, electrical and digital data processing, etc., can solve the high average delay, the performance bottleneck of the distributed storage system, and the OSD read hit rate of only 70%. % or even lower, to achieve the same effect as above

Inactive Publication Date: 2019-02-15
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF2 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, when the read hit rate of some OSDs in a distributed storage system reaches 100%, there are some OSDs whose read hit rate is only 70% or even lower; generally, the lo

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device and medium for adjusting main pg equalization of distributed storage system
  • Method, device and medium for adjusting main pg equalization of distributed storage system
  • Method, device and medium for adjusting main pg equalization of distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0038] The core of the present invention is to provide a method, device and medium for balancing and adjusting the main PG of the distributed storage system, which is used to balance the read hit rate of each OSD in the distributed storage system so as to overcome the problem caused by some OSDs in the system due to read hits. Performance bottlenecks caused by low rates.

[0039] In order to enable those skilled in the art to better understand ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a main PG balance adjustment method for a distributed storage system, Devices and media, the method presets a desired number of primary PGs for each OSD, the initial value of the weight value of the expected deviation and the primary PG affinity, and then determining whether to adjust the weight value of the current primary PG affinity of the OSD according to the relationship between the absolute difference between the current primary PG number of each OSD and the expected primary PG number and the expected deviation, The primary PG number distribution on each OSD is adjusted by adjusting the weight value of the current primary PG affinity until the weight value of the current primary PG affinity for each OSD does not need to be adjusted. Therefore, compared with the prior art method of randomly distributing the main PG number on each OSD, the method applied to each OSD can gradually approach the expected main PG number, and the maximum deviation is the expecteddeviation, thereby realizing the equalization adjustment of the main PG.

Description

technical field [0001] The present invention relates to the field of distributed storage systems, in particular to a method, device and medium for balancing and adjusting master PGs of a distributed storage system. Background technique [0002] As distributed storage systems are widely used in video surveillance, high performance, broadcast media, cloud computing, big data, virtualization and other fields, customers have higher and higher performance requirements for distributed storage systems. The performance of the storage system is becoming more and more important. [0003] PG (Placement Group) is a very important concept in distributed storage systems. It can be regarded as a virtual node in consistent hashing, which maintains a part of data and is the smallest unit of data migration and change. It plays a very important role in a distributed storage system. In a distributed storage system, there are a certain number of PGs (which can be dynamically increased or decrea...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
CPCG06F3/0631G06F3/067
Inventor 李军站
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap