A Fully Distributed Restoration Method Based on Erasure Codes

A repair method and erasure code technology, which is applied in the field of data fault tolerance of distributed storage systems, can solve problems such as limited repair efficiency, achieve the effects of improving repair efficiency, avoiding bottleneck bandwidth, and reducing memory space requirements

Active Publication Date: 2021-10-29
NAT UNIV OF DEFENSE TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the traditional repair method selects k available data blocks from k+m-1 available data blocks, uploads data from the storage nodes where the k available data blocks are located, and only uses the uplink of the storage nodes where the k available data blocks are located. Bandwidth, does not make full use of the uplink bandwidth of the storage nodes where all k+m-1 available data blocks are located for fully distributed repair, and its repair efficiency is often limited by the uplink bandwidth of the storage nodes where the k available data blocks are located

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Fully Distributed Restoration Method Based on Erasure Codes
  • A Fully Distributed Restoration Method Based on Erasure Codes
  • A Fully Distributed Restoration Method Based on Erasure Codes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0092] image 3 It is the general flowchart of the present invention. The specific process is as follows:

[0093] The first step is to build a figure 1 The distributed storage system shown is composed of a control node and N storage nodes (N is a positive integer). Each node (including the control node and storage node) is a computer that can operate independently. Device interconnection. Both control nodes and storage nodes are computers that contain processors, memory, disks, and network interfaces. Both the control node and the storage node are installed with an operating system, TCP / IP protocol software, and a network environment is configured. The control node is responsible for interacting with the user, receiving the data object writing request submitted by the user, responsible for storing the encoding coefficient, performing block and encoding calculation on the data object, and distributing the data block writing request to each storage node; receiving the inval...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a fully distributed repair method based on an erasure code, and aims to improve the repair efficiency of invalid data. The technical solution is to build a distributed storage system composed of control nodes and storage nodes. Data writing management programs and data repair management programs are installed on the control nodes; data writing programs and data repair programs are installed on the storage nodes; data writing management programs The program divides and encodes the data object into blocks, and writes the original data block and the redundant data block into different storage nodes; the data repair management program is the invalid data block D' i Select a new storage node LN; the data repair management program and the data repair program cooperate with each other to obtain the successfully repaired data sub-blocks after decoding and calculation, and store them in LN; the data repair program of LN merges the data sub-blocks to obtain D' i recovered D. i . The invention can make full use of the upstream bandwidth of each storage node, effectively avoid the bottleneck bandwidth in the network, and improve the recovery efficiency of invalid data.

Description

technical field [0001] The invention relates to the data fault tolerance technology of the distributed storage system, in particular to the fully distributed repair method based on the erasure correction code. Background technique [0002] Data fault tolerance is one of the key technologies for distributed storage of massive data, and data fault tolerance is crucial to improving system availability and reliability. Currently, data fault-tolerant technologies mainly include fault-tolerant technologies based on replication and fault-tolerant technologies based on erasure codes. [0003] The fault-tolerant technology based on replication is simple and intuitive, easy to implement and deploy, and needs to create several copies of the same size for each data object, and the storage space overhead is relatively large. The error-tolerant technology based on erasure code divides the data object into multiple data blocks, uses the erasure code algorithm to encode the original data b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/10G06F11/14H04L29/08
CPCG06F11/1004G06F11/1464H04L67/1097
Inventor 王意洁许方亮包涵马行空
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap