A cross-center cooperative repair method based on erasure code

A collaborative repair and erasure code technology, applied in the field of data fault tolerance in distributed storage systems, can solve problems such as not fully considering repair efficiency

Inactive Publication Date: 2018-12-21
NAT UNIV OF DEFENSE TECH
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing erasure code data repair technology mainly randomly selects available data blocks for invalid data repair, and does not fully consider the impact of the difference in network delay between the storage nodes where the available data blocks are located on the repair efficiency.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A cross-center cooperative repair method based on erasure code
  • A cross-center cooperative repair method based on erasure code
  • A cross-center cooperative repair method based on erasure code

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] image 3 It is the general flowchart of the present invention. The specific process is as follows:

[0074] The first step is to build a figure 1The distributed storage system shown is composed of M data centers and a control node, each data center includes N storage nodes, and each node (including control nodes and storage nodes) is a computer that can run independently , each node is interconnected through network equipment. Both M and N are positive integers. The nodes of the distributed storage system are composed of control nodes and storage nodes. Both control nodes and storage nodes are computers that contain processors, memory, disks, and network interfaces. The control node and the storage node are connected through an interconnection network. Both the control node and the storage node are installed with an operating system, TCP / IP protocol software, and a network environment is configured. The control node is responsible for interacting with users, rece...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a cross-center cooperative repair method based on erasure code. The technical scheme is as follows: firstly, a distributed storage system composed of a data center and a control node is constructed; the data center comprises N storage nodes; the control node is a new storage node LN for an invalid data block Di, and sends a network delay test request and a storage node two-dimensional array NSet to the LN; LN tests the network delay between LN and each storage node in NSet, and sends the network delay test result array NL to the control node. A control node selects k available data blocks and a storage node where the k available data blocks are located according to the NL, decodes and calculates the data blocks by the storage node where the k available data blocks are located, and the data center where the selected storage node is located merges the decoded calculation results and sends the merged results to the LN. LN further merges the results to obtain the recovered Di; The control node returns the repair success information to the user. The invention can improve the data repair efficiency and the fault tolerance of the large-scale distributed storage system.

Description

technical field [0001] The invention relates to a data fault-tolerant technology of a distributed storage system, in particular to a cross-center cooperative restoration method based on an erasure code. Background technique [0002] Data fault tolerance is one of the key technologies for distributed storage of massive data, and data fault tolerance is crucial to improving system availability and reliability. Currently, data fault-tolerant technologies mainly include fault-tolerant technologies based on replication and fault-tolerant technologies based on erasure codes. [0003] The fault-tolerant technology based on replication is simple and intuitive, easy to implement and deploy, and needs to create several copies of the same size for each data object, and the storage space overhead is relatively large. The error-tolerant technology based on erasure code divides the data object into multiple data blocks, uses the erasure code algorithm to encode the original data block to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L12/26G06F3/06
CPCG06F3/067H04L43/0852H04L67/1097
Inventor 王意洁许方亮包涵马行空
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap