Unlock instant, AI-driven research and patent intelligence for your innovation.

Data recovery method, data recovery device and distributed storage system

A data storage and recovery method technology, applied in the computer field, can solve the problems of difficult coding implementation of algorithms, low recovery performance, and difficulty of complex coding implementation of recovery algorithms.

Active Publication Date: 2016-08-24
HUAWEI TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, cloud storage still faces many problems: how to provide user data with the highest reliability at the lowest cost; how to ensure the security of user data from being stolen, encrypted, etc.
[0006] When three data storage nodes (i.e. three data disks) are lost, the recovery algorithm using EVENODD and STAR is complicated and difficult to realize the coding; check disk) is lost, it is necessary to restore the data of the horizontal check node first, and then restore the original data of the data storage node, the recovery performance is low, and the algorithm is not easy to implement

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data recovery method, data recovery device and distributed storage system
  • Data recovery method, data recovery device and distributed storage system
  • Data recovery method, data recovery device and distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0109] Figure 1a It is a flow chart of the data recovery method in Embodiment 1 of the present invention, such as Figure 1a As shown, the data recovery methods include:

[0110] Step 101. In the case that the distributed storage system loses data of three nodes, restore the data of the target data storage node among the data of the three nodes according to the data of the unlost check nodes and data storage nodes, and the target data The storage node is determined according to the symmetry of the lost data.

[0111] Step 102: Downgrade and recover the remaining lost data according to the recovered data of the target data storage node.

[0112] Preferably, if the number of data storage nodes (data disks) in the distributed system or RAID is p', each data storage node can be divided into p stripe units, where p≥p', p is a prime number That is, prime numbers. In addition, there may be 3 check nodes in the distributed system or RAID, so the total number of nodes is p'+3. The ...

Embodiment 2

[0120] Figure 2a It is a flow chart of the data distribution method in Embodiment 2 of the present invention, Figure 2a and Figure 1aSteps with the same numbers have the same meanings, and for the sake of brevity, detailed descriptions of these components are omitted. Such as Figure 2a As shown, the difference from the above-mentioned embodiment is that: in the first case described in the above-mentioned embodiment, in the case that the lost data of the three nodes includes the data of three data storage nodes, step 101 The data of the verification node and the data storage node, and recovering the data of the target data storage node in the three node data may specifically include the following steps:

[0121] Step 201. Generate a diagonal adjustment factor and an inverse diagonal adjustment factor according to the verification data, where the verification data includes data of a horizontal check node, a diagonal check node, and an inverse diagonal check node.

[0122]...

Embodiment 3

[0163] Figure 3a It is a flow chart of the data distribution method in Embodiment 3 of the present invention, Figure 3a and Figure 1a Steps with the same numbers have the same meanings, and for the sake of brevity, detailed descriptions of these components are omitted. Such as Figure 3a As shown, the difference with the above-mentioned embodiment is that: in the second case described in the above-mentioned embodiment, in the case that the lost data of the three nodes includes the data of the horizontal check node and two data storage nodes, step 101 According to the data of the unlost check node and data storage node, recovering the data of the target data storage node among the three node data may specifically include the following steps:

[0164] Step 301. In the case that the lost data of the three nodes includes the data of the horizontal check node and two data storage nodes, according to the data of the diagonal check node and the inverse diagonal check node, gener...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention relates to a data recovery method, a data recovery device and a distributed storage system, where the method includes: in a case that a distributed storage system loses data of three nodes, recovering data on a target data storage node of the data on the three nodes according to data of a parity node and a data storage node without data loss, where the target data storage node is determined according to symmetry of the lost data; and performing degraded recovery on the remaining lost data according to the recovered data of the target data storage node. According to the embodiments of the present invention, parity data is used to perform data recovery, which can ensure effective utilization of a storage space in a distributed system such as cloud storage, so as to meet a performance requirement of the distributed storage system; and a target data storage node first recovered is determined according to the symmetry of lost data, and the lost data of three nodes is recovered according to parity data and data that is not lost, which can improve the data recovery performance of the distributed storage system in a case that the data of three nodes is lost.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data recovery method, data recovery equipment and a distributed storage system. Background technique [0002] With the popularity of cloud computing technology, cloud storage is getting closer to people's lives. The suppliers of cloud storage are also increasing year by year, and the number of suppliers in the industry has reached nearly 200. Data can be stored on remote cloud storage systems, thus greatly reducing the need for local storage. However, cloud storage still faces many problems: how to provide user data with the highest reliability at the lowest cost; how to ensure the security of user data from being stolen or encrypted. [0003] In order to ensure the security of user data, multiple copies (replication) of the same data can be copied and stored on different storage nodes. If a storage node fails, as long as there is another storage node, the user can obtain ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/14G06F17/30
CPCH03M13/6502G06F11/1088G06F16/25G06F16/27H03M13/2918H03M13/2921H03M13/373
Inventor 马晓慧孙亚萍陈海啸
Owner HUAWEI TECH CO LTD