Data recovery method, data recovery equipment and distributed storage system

A technology for data storage and recovery methods, applied in the computer field, can solve problems such as difficult algorithm implementation, low recovery performance, and difficulty in complex encoding implementation of recovery algorithms, etc.

Active Publication Date: 2013-11-27
HUAWEI TECH CO LTD
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, cloud storage still faces many problems: how to provide user data with the highest reliability at the lowest cost; how to ensure the security of user data from being stolen, encrypted, etc.
[0006] When three data storage nodes (that is, three data disks) are lost, the recovery algorithm usin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data recovery method, data recovery equipment and distributed storage system
  • Data recovery method, data recovery equipment and distributed storage system
  • Data recovery method, data recovery equipment and distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0109] Figure 1a It is a flow chart of the data recovery method in Embodiment 1 of the present invention, such as Figure 1a As shown, the data recovery methods include:

[0110] Step 101. In the case that the distributed storage system loses data of three nodes, restore the data of the target data storage node among the data of the three nodes according to the data of the unlost check nodes and data storage nodes, and the target data The storage node is determined according to the symmetry of the lost data.

[0111] Step 102: Downgrade and recover the remaining lost data according to the recovered data of the target data storage node.

[0112] Preferably, if the number of data storage nodes (data disks) in the distributed system or RAID is p', each data storage node can be divided into p stripe units, where p≥p', p is a prime number That is, prime numbers. In addition, there may be 3 check nodes in the distributed system or RAID, so the total number of nodes is p'+3. The ...

Embodiment 2

[0120] Figure 2a It is a flow chart of the data distribution method in Embodiment 2 of the present invention, Figure 2a and Figure 1a Steps with the same numbers have the same meanings, and for the sake of brevity, detailed descriptions of these components are omitted. Such as Figure 2a As shown, the difference from the above-mentioned embodiment is that: in the first case described in the above-mentioned embodiment, in the case that the lost data of the three nodes includes the data of three data storage nodes, step 101 The data of the verification node and the data storage node, and recovering the data of the target data storage node in the three node data may specifically include the following steps:

[0121] Step 201. Generate a diagonal adjustment factor and an inverse diagonal adjustment factor according to the verification data, where the verification data includes data of a horizontal check node, a diagonal check node, and an inverse diagonal check node.

[0122] ...

Embodiment 3

[0163] Figure 3a It is a flow chart of the data distribution method in Embodiment 3 of the present invention, Figure 3a and Figure 1a Steps with the same numbers have the same meanings, and for the sake of brevity, detailed descriptions of these components are omitted. Such as Figure 3a As shown, the difference with the above-mentioned embodiment is that: in the second case described in the above-mentioned embodiment, in the case that the lost data of the three nodes includes the data of the horizontal check node and two data storage nodes, step 101 According to the data of the unlost check node and data storage node, recovering the data of the target data storage node among the three node data may specifically include the following steps:

[0164] Step 301. In the case that the lost data of the three nodes includes the data of the horizontal check node and two data storage nodes, according to the data of the diagonal check node and the inverse diagonal check node, gener...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data recovery method, data recovery equipment and a distributed storage system. The data recovery method comprises the following steps: when a distributed storage system loses three node data, data of an objective data storage node in the three node data is recovered according to data of a check node and a data storage node which are not lost, and the objective data storage node is determined according to the symmetry of lost data; residual lost data is recovered in a degraded manner according to data of the objective data storage node which is recovered. According to the embodiment of the invention, the check data is adopted to perform data recovery, so that the effective utilization rate of distributed systems, such as a cloud storage space, is guaranteed to meet the performance requirements of the distributed storage system; the objective data storage node to be recovered at first is determined according to the symmetry of lost data, and the lost three node data are recovered according to the check data and the not-lost data, so that the data recovery performance of the distributed storage system which loses three node data is improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a data recovery method, data recovery equipment and a distributed storage system. Background technique [0002] With the popularity of cloud computing technology, cloud storage is getting closer to people's lives. The suppliers of cloud storage are also increasing year by year, and the number of suppliers in the industry has reached nearly 200. Data can be stored on remote cloud storage systems, thus greatly reducing the need for local storage. However, cloud storage still faces many problems: how to provide user data with the highest reliability at the lowest cost; how to ensure the security of user data from being stolen or encrypted. [0003] In order to ensure the security of user data, multiple copies (replication) of the same data can be copied and stored on different storage nodes. If a storage node fails, as long as there is another storage node, the user can obtain ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F11/14G06F17/30
CPCH03M13/6502G06F11/1088G06F16/25G06F16/27H03M13/2918H03M13/2921H03M13/373
Inventor 马晓慧孙亚萍陈海啸
Owner HUAWEI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap