Method for improving erasure code repair performance on ARM based on Glusterfs

A technology of erasure code and performance, applied in the field of erasure code, can solve the problem of CPU consumption and achieve the effects of repair acceleration, performance improvement, and low power consumption

Pending Publication Date: 2021-02-02
SHENZHEN VIRTUAL CLUSTERS INFORMATION TECH
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The erasure code adopts the matrix operation, which consumes a lot of CPU, and requires specific instruction sets supported by the CPU, such as x64, see, avx, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for improving erasure code repair performance on ARM based on Glusterfs
  • Method for improving erasure code repair performance on ARM based on Glusterfs
  • Method for improving erasure code repair performance on ARM based on Glusterfs

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to facilitate those of ordinary skill in the art to understand and implement the present invention, the embodiments of the present invention will be further described below in conjunction with the accompanying drawings.

[0027] refer to Figure 1-2 , the present invention provides a method for improving the performance of erasure code repair in ARM based on Glusterfs, comprising steps:

[0028] S1. According to the bluedata product architecture, deploy ARM as the storage resource pool of Glusterfs;

[0029] S2. Configuring several servers at the front end of the storage resource pool to be used as Glusterfs mounts;

[0030] S3. Migrate the Glusterfs repair process to the server.

[0031] Wherein, the server is configured as X86 (or Kunpeng server), and its CPU performance processing capability is better. These servers with better CPU processing capability are mounted as Glusterfs, and the write performance of a single node ARM385 can reach 730MB / s. Therefor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for improving erasure code repair performance in ARM based on Glusterfs, and the method comprises the steps: deploying the ARM as a storage resource pool of the Glusterfs according to a Bluedata product architecture; configuring a plurality of servers at the front end of the storage resource pool, wherein the servers are used for mounting the Glusterfs; and migrating the Glusterfs repair process to the server according to the Glusterfs repair process. According to a Bluedata product architecture, a plurality of servers such as x86 and the like with better CPUperformance are deployed at the front end of a storage resource pool for Glusterfs mounting, and the writing performance of a single node ARM385 reaches 730MB / s. The Glusterfs repair process is migrated to the server, the encoding and decoding capacity as high as 5G / s is provided for repair, and the high-performance repair capacity is provided, so that higher stability is provided for the product,and the commercial use of the Bluedata product is realized.

Description

technical field [0001] The present invention relates to the technical field of erasure codes, in particular to a method for improving the performance of erasure code restoration in ARM based on Glusterfs. Background technique [0002] In order to save procurement costs, operating costs, and reduce power consumption, arm385 servers are used; distributed storage uses Glusterfs erasure code storage mode, and is deployed to low-cost, low-power arm385. A large number of arm385 machines are deployed, and several x86 servers with better performance are used as the mount head of the arm385 resource pool. In this way, the glusterfs erasure code mode provides high-performance erasure code storage capabilities (Glusterfs erasure code encoding and decoding capabilities are at the fuse mount point), but the Glusterfs erasure code repair process is on the server side, that is, in the arm385 cluster , the arm385 CPU cannot support the encoding and decoding capabilities of erasure codes, s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/10
CPCG06F11/1004G06F11/1012
Inventor 林世跃曾靖华
Owner SHENZHEN VIRTUAL CLUSTERS INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products