A Data Fault Tolerance Method Based on Dynamic Block Code

A technology of data error tolerance and block code, which is applied to data error detection, electrical digital data processing, error detection/correction, etc., which can solve the problems that erasure codes cannot dynamically adapt to the needs of storage systems, and achieve The effect of good practical value, flexible structure and high fault tolerance

Active Publication Date: 2022-04-12
HARBIN ENG UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problem that current erasure codes cannot dynamically adapt to the needs of storage systems, the present invention proposes a new type of erasure codes based on block code ideas, DLRC codes (Dynamic Local Reconstruction Codes, dynamic block codes), which are used to replace traditional data fault-tolerant technology

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Data Fault Tolerance Method Based on Dynamic Block Code
  • A Data Fault Tolerance Method Based on Dynamic Block Code
  • A Data Fault Tolerance Method Based on Dynamic Block Code

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention will be further described below in conjunction with the accompanying drawings.

[0030] to combine figure 1 Therefore, the DLRC coding proposed by the present invention can be used as a data fault-tolerant technology to participate in the storage process of the distributed system. Firstly, the data to be stored is stored in blocks according to the grouping of the disks in the distributed system. When the data storage of a stripe is complete, apply the DLRC code encoding formula to encode the data blocks on this stripe to generate a global check block and a local check block, and store them in the disk of the check block. The relationship between disks, stripes, and blocks is as follows: figure 2 shown. When a data block is found to be invalid, read the node data that can participate in the reconstruction, use the encoding formula of the DLRC code to perform reverse calculation, reconstruct the lost data and store it on the disk again.

[0031]...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention proposes a data fault-tolerant method based on dynamic block codes, which belongs to the technical field of data storage, and specifically relates to data fault-tolerant problems in a distributed storage system. The data fault-tolerant method based on dynamic block codes is used to restore lost or invalid data. Firstly, the data to be stored is stored in blocks according to the grouping of the disks in the distributed system. When the data storage of a stripe is complete, apply DLRC encoding to the data blocks on this stripe, generate a global check block and a local check block, and store them in the disk of the check block. When a data block is found to be invalid, read the data of the nodes participating in the reconstruction, use the DLRC code to perform reverse calculation, reconstruct the lost data and store it to the disk again. The invention realizes the dynamic balance of the storage cost, the fault tolerance capability and the reconstruction cost, and is applicable to the requirements of different storage systems. In the case of consuming the same storage space, DLRC coding has high fault tolerance and low reconstruction overhead, which has good practical value.

Description

technical field [0001] The invention belongs to the technical field of data storage, and relates to a data fault-tolerant method based on a dynamic block code, in particular to the data fault-tolerant problem in a distributed storage system, and uses a data fault-tolerant method based on a dynamic block code to recover lost or invalid data. Background technique [0002] With the advent of the era of massive data, the early stand-alone systems have been unable to adapt to the rapid growth of data storage, and now more and more enterprises are beginning to adopt distributed storage systems. Since the distributed storage system generally uses a large number of cheap commercial servers interconnected through the network, it can provide strong expansion and service capabilities. However, as the scale of the cluster increases and the number of interconnected storage devices increases, failures of storage nodes occur more and more frequently. Therefore, how to ensure the reliabili...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/14
CPCG06F11/1489
Inventor 孟宇龙张玲玲徐东张子迎关智允王磊李贤王岩俊宫思远任龙
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap