Unlock instant, AI-driven research and patent intelligence for your innovation.

A storage unit performance optimization method, device, storage device and storage medium

A storage unit and optimization method technology, which is applied to instruments, electrical digital data processing, input/output to record carriers, etc., can solve the problem of excessively shortened service life of storage units, uneven pressure distribution, and overall performance impact of distributed file systems. and other problems, to achieve the effect of performance optimization, pressure average, and prevention of rapid shortening of service life

Active Publication Date: 2020-03-31
INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of this application is to provide a storage unit performance optimization method, device, storage device, and computer storage medium, aiming to overcome the pressure distribution that exists when some storage units store too many master copies in the prior art as much as possible Uneven, the service life of the storage unit is shortened too quickly, and the overall performance of the distributed file system is affected

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A storage unit performance optimization method, device, storage device and storage medium
  • A storage unit performance optimization method, device, storage device and storage medium
  • A storage unit performance optimization method, device, storage device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0054] See figure 1 , figure 1 A flow chart of a storage unit performance optimization method provided in an embodiment of the present application, which includes the following steps:

[0055] S101: Record the time-consuming information of each operation performed by each storage unit, and calculate the average time-consuming according to the number of operations occurring in each cycle;

[0056] The operations performed by the storage unit are divided into read operations and write operations according to different types. The execution time of each read operation or write operation is often related to the working status of the corresponding storage unit, that is, a storage unit in good working condition is compared with Carrying a storage unit in poor working condition, there will be a significant difference in the execution time of the operation between the two. The pros and cons of the working status are usually affected by various factors, such as whether it is under a l...

Embodiment 2

[0077] See image 3 , image 3 It is a flow chart of a method for determining the relative number of master copies in the storage unit performance optimization method provided in the embodiment of this application. On the basis of Embodiment 1, this step aims to further determine the relative number of master copies according to the number of reads Different from the contribution of this book to further optimize the relative number of master copies determined, including the following steps:

[0078] S301: Divide the execution times into read times and write times according to the operation types;

[0079] S302: Assigning different weights to the number of reads and the number of writes respectively;

[0080] Assuming that the weight assigned to the number of reads is the first weight and the weight assigned to the number of writes is the second weight, the first weight should be greater than the second weight, because the read-write mechanism of the existing master-slave cop...

Embodiment 3

[0085] see below Figure 4 , Figure 4 A structural block diagram of a storage unit performance optimization device provided in an embodiment of the present application, the device may include:

[0086] The average time-consuming calculation unit 100 is used to record the time-consuming information of each operation performed by each storage unit, and calculate the average time-consuming according to the number of operations occurring in each cycle;

[0087] The execution times determination unit 200 is configured to record the type information of each operation performed on the master copy stored in each storage unit, and determine the execution times of each operation according to the type information occurring in each cycle;

[0088] The master affinity determining unit 300 is configured to determine the master affinity of each storage unit in a corresponding cycle according to the average time-consuming and execution times corresponding to each cycle;

[0089]The primary...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a storage unit performance optimization method. According to the method, the main affinity of each storage unit is measured through two parameters, namely the average time consumption of the read-write operation of each storage unit and the executed read-write operation times of the main copy in each storage unit, which are obtained through statistics; according to the sizeof the main affinity, the number of copies which are stored in each storage unit and serve as main copies is adjusted in each period; the pressure distribution is optimized in a dynamic adjustment mode, so that the pressure of each storage unit is more uniform, and the problems that the service life of a certain storage unit is shortened quickly and the overall performance of the distributed filesystem is tired due to overlarge pressure are prevented as much as possible. The invention further discloses a storage unit performance optimization device, storage equipment and a computer readablestorage medium which have the above beneficial effects.

Description

technical field [0001] The present application relates to the technical field of distributed storage, and in particular to a storage unit performance optimization method, device, storage device, and computer-readable storage medium. Background technique [0002] A distributed file system can store massive amounts of data through multiple storage units. In order to make the storage space occupied by the data stored in each storage unit roughly the same, the prior art uses various rules to achieve a balanced distribution of data. [0003] In a distributed file system, multi-copy redundancy is usually used to ensure data security, that is, multiple copies of a piece of data are stored in multiple storage units, and multiple copies are usually divided into a primary copy and a The remaining multiple replicas. Under the rules of the PG group (Placement Group), each PG group will have its own multiple data copies, but because each PG group is relatively independent, the copies st...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/061G06F3/0631G06F3/067
Inventor 赵赞刘杰
Owner INSPUR SUZHOU INTELLIGENT TECH CO LTD