A fully distributed repair method based on erasure codes

A repair method and erasure code technology, applied in the field of data fault tolerance of distributed storage systems, can solve problems such as limited repair efficiency

Active Publication Date: 2019-02-15
NAT UNIV OF DEFENSE TECH
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the traditional repair method selects k available data blocks from k+m-1 available data blocks, uploads data from the storage nodes where the k available data blocks are located, and only uses the uplink of the storage nodes where the k available data blocks are located. Band

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A fully distributed repair method based on erasure codes
  • A fully distributed repair method based on erasure codes
  • A fully distributed repair method based on erasure codes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0092] image 3 It is the general flowchart of the present invention. The specific process is as follows:

[0093] The first step is to build a figure 1 The distributed storage system shown is composed of a control node and N storage nodes (N is a positive integer). Each node (including the control node and storage node) is a computer that can operate independently. Device interconnection. Both control nodes and storage nodes are computers that contain processors, memory, disks, and network interfaces. Both the control node and the storage node are installed with an operating system, TCP / IP protocol software, and a network environment is configured. The control node is responsible for interacting with the user, receiving the data object writing request submitted by the user, responsible for storing the encoding coefficient, performing block and encoding calculation on the data object, and distributing the data block writing request to each storage node; receiving the inval...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a fully distributed repair method based on erasure codes, aiming at improving the repair efficiency of failure data. The technical proposal is to construct a distributed storage system composed of a control node and a storage node, and the control node is provided with a data writing management program and a data repairing management program. A data writing program and a data repairing program are installed on the storage node; The data writing management program divides the data object into blocks and calculates the encoding, and writes the original data block and theredundant data block into different storage nodes. The data repair management program selects a new storage node LN for the failed data block D'i. The data repair management program and the data repair program cooperate with each other, and after decoding calculation, the data sub-blocks which have been repaired successfully are obtained and stored in the LN. The data repair program of LN combinesthe data sub-blocks to get the D'i recovered Di. The invention can fully utilize the uplink bandwidth of each storage node, effectively avoid the bottleneck bandwidth in the network, and improve therepair efficiency of invalid data.

Description

technical field [0001] The invention relates to the data fault tolerance technology of the distributed storage system, in particular to the fully distributed repair method based on the erasure correction code. Background technique [0002] Data fault tolerance is one of the key technologies for distributed storage of massive data, and data fault tolerance is crucial to improving system availability and reliability. Currently, data fault-tolerant technologies mainly include fault-tolerant technologies based on replication and fault-tolerant technologies based on erasure codes. [0003] The fault-tolerant technology based on replication is simple and intuitive, easy to implement and deploy, and needs to create several copies of the same size for each data object, and the storage space overhead is relatively large. The error-tolerant technology based on erasure code divides the data object into multiple data blocks, uses the erasure code algorithm to encode the original data b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/10G06F11/14H04L29/08
CPCG06F11/1004G06F11/1464H04L67/1097
Inventor 王意洁许方亮包涵马行空
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap