Method for improving erasure code based storage cluster recovery performance

A storage cluster and erasure code technology, which is applied in the field of improving the recovery performance of storage clusters based on erasure codes, can solve problems such as a large number of additional data transmission, and achieve the effect of improving reconstruction efficiency and overcoming data transmission.

Active Publication Date: 2013-07-17
HUAZHONG UNIV OF SCI & TECH
View PDF1 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Aiming at the defects of the prior art, the purpose of the present invention is to provide a method for improving the recovery performance of storage clusters based on erasure codes, aiming to solve the problems existing in the existing centralized decoding methods that will lead to a large amount of additional data transmission

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for improving erasure code based storage cluster recovery performance
  • Method for improving erasure code based storage cluster recovery performance
  • Method for improving erasure code based storage cluster recovery performance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0028] First provide the definition of relevant terms of the present invention:

[0029] ●Reconstruction source node: the node that stores some of the data participating in this reconstruction. This manual uses SN i Indicates the i-th reconstructed source node. for different SN p and SN q , possibly belonging to the same physical machine. Remember SN i The data that participates in this refactoring is stored as data i .

[0030] ●Reconstruction destination node: the node where the invalid data block is reconstructed. This manual uses DN i to represent the i-th reconstruction destination nod...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for improving an erasure code based storage cluster recovery performance. The method comprises that a reconfiguration control node sends reconfiguration read requests to reconfiguration source nodes and sends reconfiguration write requests to reconfiguration destination nodes simultaneously, all reconfiguration source nodes implement reconfiguration read optimization according to reconfiguration read requests, all reconfiguration destination nodes implement reconfiguration write optimization according to reconfiguration write requests simultaneously, all reconfiguration source nodes read data participating in reconfiguration of this time from a disc respectively and divide the data into a plurality of data blocks respectively, all reconfiguration source nodes transmit the plurality of data blocks to corresponding reconfiguration destination nodes simultaneously through networks respectively, all reconfiguration destination nodes adopt a reconfiguration algorithm to reconfigure received data blocks coming from all reconfiguration source nodes respectively, and all reconfiguration destination nodes return data blocks obtained through reconfiguration to a client side respectively. By the aid of the method, the problem of transmission of a large amount of additional data caused by existing centralized decoding methods can be solved.

Description

technical field [0001] The invention belongs to the field of computer storage, and more specifically relates to a method for improving recovery performance of a storage cluster based on an erasure code. Background technique [0002] In today's large data centers, the size and complexity of data sets has increased dramatically, and large-scale storage cluster deployments consisting of hundreds to thousands of nodes provide online services and huge data capacity to meet demand. With such large systems, failures are not uncommon. Its key is to ensure the availability of data, which is usually achieved by the redundancy technology of the storage cluster. [0003] In their statistical analysis of failures, Schroeder found that in five different large clusters, the disk failure rates they observed were much higher than what the manufacturers claimed. For a disk with an annual failure rate of 2 to 4%, the actual failure rate can usually be increased to 13%, that is, the average f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 万胜刚曹强谢长生陈迪涂剑洪
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap