Repair method for distributed data storage system

A distributed data and storage system technology, applied in the field of data repair in distributed data storage systems, can solve problems such as router performance and functional requirements, large management node load, waste of storage resources, etc., to improve comprehensive capabilities, balance load, The effect of effective work

Active Publication Date: 2015-12-16
福建省海峡信息技术有限公司
View PDF7 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The disadvantage of this technology is that: nodes need to store a large amount of data, and each storage node needs to store a copy of a file, and the storage redundancy is large, resulting in a large waste of storage resources
[0012] However, there is a problem with erasure codes when repairing damaged data nodes: repairing M1-sized data blocks requires a total of k×M1-sized data block

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Repair method for distributed data storage system
  • Repair method for distributed data storage system
  • Repair method for distributed data storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

[0052] This embodiment provides a method for repairing a distributed data storage system, such as Figure 4 As shown, it specifically includes the following steps:

[0053] Step S1: Provide a management node and a plurality of storage nodes; the management node is used to find out whether there is data damage in the storage node; the storage node includes a storage node set S for repairing damaged data blocks and a set of storage nodes for A storage node set A that stores erasure coded data required for repairing data;

[0054] Step S2: The management node monitors and searches for the damaged data block in the distributed data storage system, and when the management node finds the damaged data block, uses the LeDiR algorithm in the storage node set S for repairing the damaged data block Select an optimal storage node for the damaged data block, and a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention relates to a repair method for a distributed data storage system, which comprises the following steps of: S1, providing a management node and a plurality of storage nodes, wherein the storage nodes comprise a storage node set for repairing damaged data blocks and a storage node set for storing erasure code data required for data repair; S2, monitoring and searching the damaged data blocks in the system by the management node and when the management node searches the damaged data blocks, selecting the optimal storage node by adopting a LeDiR algorithm and carrying out authorization on the optimal storage node to carry out data repair work; S3, carrying out repair work by the optimal storage node through adopting an erasure code algorithm; and S4, after the optimal storage node completes data repair, sending the data repair condition to the management node. According to the repair method disclosed the present invention, damaged storage nodes are detected by the means of the management node, repair is carried out on the basis of the erasure code algorithm and the repair process on different nodes can be carried out concurrently, so that repair capacity of the storage system is improved and a load of a management server is reduced.

Description

technical field [0001] The invention relates to the technical field of data restoration in a distributed data storage system, in particular to a method for repairing a distributed data storage system. Background technique [0002] With the popularization and development of the Internet, data plays an increasingly important role in human life, and people have higher requirements for data reliability and security. Gordon Moore, one of the founders of Intel, proposed Moore's Law, which reads: when the price remains constant, the number of transistors that can be accommodated on an integrated circuit will double every 18 months, and the performance will also be doubled. In 1998, Jim Gray, the winner of the Turing Award, published the famous "Moore's Law" in the storage industry: the amount of new information in the world every 18 months is equal to the sum of all the information in history. Data massification has become a trend. In order to facilitate the storage of large-scal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
Inventor 高翔陈健赖建华刘志光
Owner 福建省海峡信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products