Erasure code encoding and data reconstruction method capable of reducing data updating cost

Abstract

The invention discloses an erasure code encoding and data reconstruction method capable of reducing data updating cost. The method comprises the following steps of adding an additional diagonal checkbit to each encoding strip and designing an array erasure code, designing a coding rule of each diagonal check bit, eliminating a dependency relationship among the check bits in the array erasure code, reducing the number of check bits associated with each original data bit, and reducing related check bit updating cost caused by the array erasure code during original data updating. Data under thecondition of a single-disk fault or a double-disk fault are reconstructed respectively, recovery of failure data is completed when the number of the data is smaller than two or the number of verification disk faults is smaller than two, and the data fault tolerance function is achieved. By increasing the storage overhead of a small number of check bits, higher data encoding and data reconstructionspeed is achieved, the additional updating cost of an erasure code system on a check disk during data updating is reduced, and abrasion of high-speed storage equipment such as a novel NVM / SSD can bebetter relieved.

Description

technical field [0001] The invention belongs to the technical field of computer storage systems, and in particular relates to an erasure code encoding and data reconstruction method that reduces the cost of data updating. Background technique [0002] Erasure codes such as RS and RDP can tolerate the simultaneous failure of multiple disks, and are usually used to ensure the reliability and durability of systems such as RAID and distributed storage. Different from the traditional replica fault-tolerant technology that saves multiple mirror copies of the original data, the erasure coding technology encodes the original data, obtains multiple copies of redundancy check data and saves it together with the original data. When the original data is lost, by reading the remaining healthy original data and check data, and using the corresponding data reconstruction method to decode and recover the invalid data. [0003] The erasure code first divides the original data in strips when...

AI Technical Summary

Problems solved by technology

The high data update cost will not only affect the performance improvement of some write-intensive storage systems, but also reduce the service life of SSD / NVM and other storage devices with limited erasing times due to frequent update of the check disk, which is not conducive to high-performance SSD / Extensive use of NVM in storage systems

Images