Data storage method based on RS (Reed-Solomon) erasure codes

A data storage and erasure code technology, applied in the field of information processing, can solve problems such as wasting space and increasing costs, and achieve the effects of reducing costs, ensuring efficiency, and saving storage space

Inactive Publication Date: 2010-09-22
SHANGHAI JIAO TONG UNIV
View PDF3 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

But the biggest disadvantage of this technology is that it is a waste of space: a fi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage method based on RS (Reed-Solomon) erasure codes

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] Example

[0025] The present embodiment is used for storing the file of 180M, specifically comprises the following steps:

[0026] In the first step, the 180M file to be stored is divided into 6 original data blocks of equal size according to a fixed size of 30M, and these 6 original data blocks are divided into two groups, each group including 3 original data blocks.

[0027] In the second step, the original data block in each data group is transmitted from the client to the data node block by block. When the i-th data group is transmitted, the data node that receives the data of the data group transmits the received data to A data node designated for the management node, the data node obtains all the original data block information of the group of data blocks, 1≤i≤2.

[0028] In the third step, the data node that obtains all the original data block information of the i-th data block performs (5, 3) RS encoding on the data group, so that the i-th data group changes fr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of information processing, relating to a data storage method based on RS (Reed-Solomon) erasure codes. The method comprises the following steps of: carrying out blocking processing and grouping processing on files to be stored; transmitting original data blocks of each data group to data nodes, and carrying out RS encoding by the data nodes so that each data group is increased with a plurality of redundant data blocks on the basis of the original data blocks; storing the encoded data blocks in the same data group on a plurality of machine racks, wherein the number of the data blocks in the same data group on the same machine rack does not exceed the number of the redundant data blocks; adopting the RS erasure codes to restore the data blocks when the data blocks in the stored files are damaged, and obtaining the restored data blocks. The invention saves a large amount of storage space on the basis of ensuring daily usage efficiency. The requirements for the reliability of data storage can be flexibly set according to the importance of the files. More abundant storage strategies can be provided by setting the number of backup files and encoding parameters, and the cost for data storage is greatly reduced.

Description

technical field [0001] The present invention relates to a method in the technical field of information processing, in particular to a data storage method based on RS erasure codes. Background technique [0002] Cloud storage is a storage method serving cloud computing. It refers to the collection of a large number of different types of storage devices in the network through application software to work together through cluster applications, grid technology, or distributed file systems. A system that provides data storage and business access functions. [0003] With the advent of the information age, the storage of massive information and the requirements for reliability are getting higher and higher, and storage cost and high reliability are always a pair of contradictions that are difficult to solve. On the one hand, reliability can be significantly improved by increasing the number of backups, but the storage capacity will also increase exponentially; on the other hand, i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F12/06G06F11/14G11C29/42
Inventor 郑燕飞沈林峰曹羽中程正杰陈克非
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap