Differential log type erasure code updating method for single storage pool

A differential logging, update method technology, applied in the computer field, can solve the problems of network transmission bandwidth and disk I/O pressure, and achieve the effect of saving storage space

Active Publication Date: 2018-03-06
BEIJING INST OF COMP TECH & APPL
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the above improvements have reduced the amount of calculation, the pressure on network transmission bandwidth and disk I / O is still high, and the data update efficiency needs to be further improved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Differential log type erasure code updating method for single storage pool
  • Differential log type erasure code updating method for single storage pool
  • Differential log type erasure code updating method for single storage pool

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to make the purpose, content, and advantages of the present invention clearer, the specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0052] Utilizing the linear coding properties of erasure codes (formula (8)), the delta method can be used to update data, and the redundant network transmission volume is eliminated by only transmitting the data delta with the same size as the modified data range. It first determines the modification range of the data block, and then calculates the difference for this data block. This difference is the change between the old and new data within the modification range of the data block, and multiplied by the corresponding coefficient to obtain the verification difference. . Then the range of the modified data and the calculated data delta and check delta are sent to the corresponding data node and all other check nodes...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a differential log type erasure code updating method for a single storage pool, and belongs to the technical field of computers. According to the method, a thought of performing full coverage updating on data blocks and performing partial differential log check on check blocks is combined with an updating mode PDN-P; a new data updating mode PDN-PDS is proposed; and compared with the updating mode PDN-P, the updating mode PDN-PDS only uses a storage pool to store data differential logs together, so that the check block updating efficiency is improved, the disk seek during reading of multiple updates is reduced, and the check node storage space is saved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method for updating a difference log type erasure correction code of a single storage pool. Background technique [0002] Erasure code technology has been widely used in data storage systems to obtain high fault tolerance, but there is a great burden in data update performance, especially for distributed block storage systems with frequent data update operations. Here, we first introduce the update principle of CRS erasure codes and four common update methods: two typical erasure code update methods (DUM and PUM) and two partial update methods (PUM-P and PDN-P ). [0003] Erasure code data update complexity refers to the average number of check blocks affected by modifying, updating, or rewriting a data block. For example, for each data block in CRS(6+3,3) is protected by m=3 check blocks, so the optimal update complexity is 3. Update complexity can significantly affect th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F11/10
CPCG06F11/10
Inventor 陈付陕振张淑萍
Owner BEIJING INST OF COMP TECH & APPL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products