A Method of Repairing Invalid Data Based on Improved Erasure Code

A technology of invalid data and erasure codes, which is applied in the field of invalid data repair based on erasure codes, can solve the problems of data repair methods such as limited efficiency, bottleneck bandwidth, etc., to reduce the amount of transmitted data, reduce the amount of invalid data, and avoid bottlenecks The effect of bandwidth

Active Publication Date: 2016-06-29
NAT UNIV OF DEFENSE TECH
View PDF2 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The repair efficiency of existing data repair methods is mainly limited by the bottleneck bandwidth between storage nodes in the repair topology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of Repairing Invalid Data Based on Improved Erasure Code
  • A Method of Repairing Invalid Data Based on Improved Erasure Code
  • A Method of Repairing Invalid Data Based on Improved Erasure Code

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0088] figure 1 It is the physical structure diagram of the distributed storage system constructed in the first step of the present invention. The nodes of the distributed storage system are composed of control nodes and storage nodes. Both control nodes and storage nodes are computers that contain processors, memory, disks, and network interfaces. The control node and the storage node are connected through an interconnection network.

[0089] figure 2 It is a software deployment diagram of the distributed storage system of the present invention. Operating system, TCP / IP network software, data writing management program and data repairing program are installed on the control node. The operating system and TCP / IP network software are general-purpose software, which are obtained from publicly issued software packages; the data writing management program and the data repairing program are the special software of the present invention. An operating system, TCP / IP network softwar...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a failure data recovery method based on improved erasure codes and aims at designing an efficient failure data recovery method based on data access characteristics. According to the technical scheme, a distributive storage system composed of one control node and N storage nodes is set up, the control node is provided with a data writing management program and a data recovery program. The storage nodes are provided with data writing programs and data reading programs. The data writing program receives data objects submitted by a user and is used for conducting block partition and coding calculation on the data objects and writing obtained data blocks into the storage nodes. The data recovery program receives a failure data sub-block recovery request, reads useable data sub-blocks from the storage nodes, and conducts decoding calculation so as to obtain recovered data blocks. By the adoption of the method, the data usability of the system can be improved, the influence of data block failure on data access can be reduced, the failure data size relevant to data access can be reduced, the network transmission data size can be reduced, and failure data recovery efficiency can be improved.

Description

Technical field [0001] The invention relates to a data fault tolerance method of a distributed storage system, in particular to a method for repairing invalid data based on erasure codes. Background technique [0002] Data fault tolerance is one of the key technologies for distributed storage of massive data. Data fault tolerance is essential to improve the availability and reliability of the system. At present, data fault-tolerant technologies mainly include replication-based fault-tolerant technology and erasure code-based fault-tolerant technology. [0003] The replication-based fault tolerance technology is simple and intuitive, easy to implement and deploy. It is necessary to create several copies of the same size for each data object, and the storage space overhead is relatively large. The error-tolerant technology based on erasure codes divides the data object into multiple data blocks, and obtains redundant data blocks by using the erasure code algorithm to encode the orig...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06H04L29/08
Inventor 王意洁孙伟东裴晓强许方亮符永铨程力李小勇马行空王媛赵越林轩熊泽宇
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap