Unlock instant, AI-driven research and patent intelligence for your innovation.

I/O Optimized Distributed Storage Data Restoration Method

A distributed storage and data repair technology, applied in the field of storage coding, can solve problems such as damage, no description or report found, storage node failure and node data block damage, etc., to achieve the effect of reducing the amount of data

Active Publication Date: 2020-06-16
SHANGHAI JIAOTONG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] Fourth, damage mode, including storage node failure and node data block corruption
[0014] At present, there is no description or report of the similar technology of the present invention, and no similar data at home and abroad have been collected yet.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • I/O Optimized Distributed Storage Data Restoration Method
  • I/O Optimized Distributed Storage Data Restoration Method
  • I/O Optimized Distributed Storage Data Restoration Method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The following is a detailed description of the embodiments of the present invention: this embodiment is implemented on the premise of the technical solution of the present invention, and provides detailed implementation methods and specific operation processes. It should be noted that those skilled in the art can make several modifications and improvements without departing from the concept of the present invention, and these all belong to the protection scope of the present invention.

[0045] This embodiment provides an I / O-optimized method for repairing distributed storage data, including any one or more of the following steps:

[0046] -RBT help data block repair steps:

[0047] In the RBT code, according to the RBT help data block allocation strategy, the faulty node queries the distribution of the corresponding RBT help data block in the storage system, and counts the health status information of the RBT help data block;

[0048] The fault node downloads m RBT he...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides an I / O optimized distributed storage data restoration method. The method comprises the following one or a plurality of steps that: data downloaded when a failure node is restored can be utilized to perform calculation to obtain the content of the RBT (Reconstruct-by-Transfer) help data blocks of the failure node, and the reading or downloading of new data is not required; and the public restoration set of non-RBT help data blocks is calculated, and therefore, data read from a magnetic disk can be decreased. With the method of the invention adopted, I / O optimization in data restoration under a node failure and data block damage-combined mode can be realized.

Description

technical field [0001] The invention belongs to the technical field of storage encoding, in particular to an I / O optimized distributed storage data repair method, which realizes I / O optimization during data repair in distributed storage. Background technique [0002] Today, in large-scale distributed storage, the total amount of stored data is growing exponentially. The storage system will face the problem of temporary failure or permanent failure of many data nodes. In order to ensure the reliability of the system, most storage systems will choose to provide data backup. For example, the Google file system uses a 3-fold backup method. The reason why backup is used is that it is convenient to implement, easy to operate, and data recovery is simple and reliable. However, due to the rapid growth of the data volume, the backup method has brought a huge burden on the storage overhead. [0003] Erasure coding provides another option for storage systems, which can provide bette...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08G06F11/14
CPCG06F11/1464H04L67/1097
Inventor 骆源何奇芫应臣浩
Owner SHANGHAI JIAOTONG UNIV