Failure data recovery method based on improved erasure codes

A technology of invalid data and erasure codes, which is applied in the field of invalid data repair based on erasure codes, can solve the problem of data repair methods such as limited repair efficiency, bottleneck bandwidth, etc., to reduce the amount of transmitted data, reduce bandwidth costs, and improve repair efficiency Effect

Active Publication Date: 2014-04-16
NAT UNIV OF DEFENSE TECH
View PDF2 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The repair efficiency of existing data repair methods is mainly limited

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Failure data recovery method based on improved erasure codes
  • Failure data recovery method based on improved erasure codes
  • Failure data recovery method based on improved erasure codes

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0088] figure 1 It is a physical structure diagram of the distributed storage system constructed in the first step of the present invention. The nodes of the distributed storage system are composed of control nodes and storage nodes. Both control nodes and storage nodes are computers that contain processors, memory, disks, and network interfaces. The control node and the storage node are connected through an interconnection network.

[0089] figure 2 It is a software deployment diagram of the distributed storage system of the present invention. Operating system, TCP / IP network software, data writing management program and data repair program are installed on the control node. Wherein the operating system and the TCP / IP network software are general software, which are obtained from publicly issued software packages; the data writing management program and the data repair program are special software of the present invention. An operating system, TCP / IP network software, d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a failure data recovery method based on improved erasure codes and aims at designing an efficient failure data recovery method based on data access characteristics. According to the technical scheme, a distributive storage system composed of one control node and N storage nodes is set up, the control node is provided with a data writing management program and a data recovery program. The storage nodes are provided with data writing programs and data reading programs. The data writing program receives data objects submitted by a user and is used for conducting block partition and coding calculation on the data objects and writing obtained data blocks into the storage nodes. The data recovery program receives a failure data sub-block recovery request, reads useable data sub-blocks from the storage nodes, and conducts decoding calculation so as to obtain recovered data blocks. By the adoption of the method, the data usability of the system can be improved, the influence of data block failure on data access can be reduced, the failure data size relevant to data access can be reduced, the network transmission data size can be reduced, and failure data recovery efficiency can be improved.

Description

technical field [0001] The invention relates to a data fault-tolerant method of a distributed storage system, in particular to a method for repairing invalid data based on an erasure code. Background technique [0002] Data fault tolerance is one of the key technologies for distributed storage of massive data, and data fault tolerance is crucial to improving system availability and reliability. Currently, data fault-tolerant technologies mainly include fault-tolerant technologies based on replication and fault-tolerant technologies based on erasure codes. [0003] The fault-tolerant technology based on replication is simple and intuitive, easy to implement and deploy, and needs to create several copies of the same size for each data object, and the storage space overhead is relatively large. The error-tolerant technology based on erasure code divides the data object into multiple data blocks, and encodes the original data block by using the erasure code algorithm to obtain ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06H04L29/08
Inventor 王意洁孙伟东裴晓强许方亮符永铨程力李小勇马行空王媛赵越林轩熊泽宇
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap