Data repairing method for distributed erasure code storage system

A storage system and data restoration technology, which is applied in the field of data restoration of distributed erasure code storage systems, can solve the problem of no distinction between original blocks and data blocks, reduce the number of degraded reads, improve repair efficiency, and ensure data reliability Effect

Inactive Publication Date: 2017-02-22
EISOO SOFTWARE
View PDF4 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, the industry does not distinguish between original blocks and data blocks in the da

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data repairing method for distributed erasure code storage system
  • Data repairing method for distributed erasure code storage system
  • Data repairing method for distributed erasure code storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments. This embodiment is carried out on the premise of the technical solution of the present invention, and detailed implementation and specific operation process are given, but the protection scope of the present invention is not limited to the following embodiments.

[0034] The invention provides a data repair method for a distributed erasure code storage system. The method distinguishes the loss of original data and verification data, delays repairing verification data to restore the original data first, and at the same time for the sake of data reliability Consider, canceling this delay when certain conditions are met. In fact, from a performance point of view, the missing parity blocks will not be directly accessed by the client and will not trigger degraded reads, so they will not affect performance; from the point of view of resource consumpt...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data repairing method for a distributed erasure code storage system. The data repairing method comprises the following steps: 1) acquiring an updated strip repairing queue, wherein the strip repairing queue comprises strip records corresponding to strips, the strips keep original data, and the number of verifying blocks in each strip is greater than or equal to 3; 2) judging whether the strip repairing queue is null, and if yes, executing the step 5), otherwise, executing the step 3); 3) taking out a first strip in the strip repairing queue, and according to the strip record corresponding to the strip, acquiring a data loss state of the strip; 4) according to the data loss state, correspondingly repairing the strip, and returning to the step 1); 5) after repairing all the strips, quitting. Compared with the prior art, the data repairing method has the advantages as follows: the downgrade reading frequency is reduced and the resource expenses are reduced.

Description

technical field [0001] The invention belongs to the field of cloud storage technology and the field of computer information technology storage, and in particular relates to a data restoration method of a distributed erasure code storage system. Background technique [0002] With the advent of the era of big data, the scale of cloud storage systems is increasing day by day. A cloud storage system is a distributed storage system that includes a large number of servers (called nodes), storage media (mainly mechanical hard drives and solid state drives), and network interconnection devices. The sheer scale leads to node or hard drive failures becoming the norm in the system. In order to make a trade-off between data reliability, storage device overhead and system performance, more and more distributed storage systems (such as HDFS, GFS-II, Ceph, Azure) tend to use erasure coding strategies to replace three copies Policies store data that takes up a large amount of space but is...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/10G06F11/14
CPCG06F11/1048G06F11/1464
Inventor 黄思倜
Owner EISOO SOFTWARE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap