A differential log type erasure code update method for a single storage pool

A differential log type and update method technology, applied in the computer field, can solve problems such as network transmission bandwidth and disk I/O pressure

Active Publication Date: 2021-04-09
BEIJING INST OF COMP TECH & APPL
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the above improvements have reduced the amount of calculation, the pressure on network transmission bandwidth and disk I / O is still high, and the data update efficiency needs to be further improved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A differential log type erasure code update method for a single storage pool
  • A differential log type erasure code update method for a single storage pool
  • A differential log type erasure code update method for a single storage pool

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, content, and advantages of the present invention clearer, the specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0051] Utilizing the linear coding properties of erasure codes (formula (8)), the delta method can be used to update data, and the redundant network transmission volume is eliminated by only transmitting the data delta with the same size as the modified data range. It first determines the modification range of the data block, and then calculates the difference for this data block. This difference is the change between the old and new data within the modification range of the data block, and multiplied by the corresponding coefficient to obtain the verification difference. . Then the range of the modified data and the calculated data delta and check delta are sent to the corresponding data node and all other check nodes...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method for updating a difference log type erasure correction code of a single storage pool, which belongs to the technical field of computers. The present invention combines the full-coverage update of data blocks and the idea of ​​verifying partial logs of difference logs for check blocks with the PDN-P update method, and proposes a new data update method PDN-PDS. Compared with PDN ‑P, PDN‑PDS only uses one storage pool to store data difference logs together, which not only improves the update efficiency of check blocks, but also reduces disk seeks when reading multiple updates, saving the cost of check nodes. storage.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method for updating a difference log type erasure correction code of a single storage pool. Background technique [0002] Erasure code technology has been widely used in data storage systems to obtain high fault tolerance, but there is a great burden in data update performance, especially for distributed block storage systems with frequent data update operations. Here, we first introduce the update principle of CRS erasure codes and four common update methods: two typical erasure code update methods (DUM and PUM) and two partial update methods (PUM-P and PDN-P ). [0003] Erasure code data update complexity refers to the average number of check blocks affected by modifying, updating, or rewriting a data block. For example, for each data block in CRS(6+3,3) is protected by m=3 check blocks, so the optimal update complexity is 3. Update complexity can significantly affect th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/10
CPCG06F11/10
Inventor 陈付陕振张淑萍
Owner BEIJING INST OF COMP TECH & APPL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products