An erasure code overwriting method for distributed storage ceph

A distributed storage and overwriting technology, which is applied in the direction of error detection/correction, response error generation, redundant code error detection, etc., can solve the problem that CEPH does not support erasure code overwriting, etc., to reduce and network overhead , prevent hit rate, and reduce disk overhead

Inactive Publication Date: 2019-04-16
NANJING UNIV +3
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Purpose of the invention: Aiming at the problems existing in the prior art, the present invention provides an erasure code overwrite method based on distributed storage CEPH, which solves the problem that the distributed storage system CEPH does not support erasure code overwrite

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An erasure code overwriting method for distributed storage ceph
  • An erasure code overwriting method for distributed storage ceph
  • An erasure code overwriting method for distributed storage ceph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] Below in conjunction with embodiment the present invention is described further.

[0034] The erasure code overwrite method for distributed storage CEPH, specifically includes the following steps:

[0035] 1. According to CEPH's CRUSH algorithm and node mapping, the client node locates the object id of the write request to the main OSD of the data storage, and then sends the write request including the object id, offset offset, length and data buffer to the main OSD OSDs.

[0036] 2. The main OSD parses the write request from the network message. After the PG layer transaction processing, it enters the erasure code back-end processing. After judging that it is overwriting, it enters a new writing path, and then uses the object id as the key to construct the overwriting request. State machine, and add a write lock to the object.

[0037] 3. The state machine enters the read state, and first calculates the coding strip range involved in the write request. The specific s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an erasure code overwrite method for distributed storage CEPH. First, the client node sends a write request to the main OSD in the storage node of Ceph, and the main OSD automatically selects the optimal coding scheme and then calculates the data block to be read. , and according to the client id and object id, read the data block from the cache and return it to the main OSD; then the main OSD, after receiving all the required read data blocks, updates the data block and check block, and sends them to the corresponding OSD that needs to be updated ;Then the data block node and the check block node receive the write request, allocate a new storage location near the original data block to store the new update, and record the metadata of this write request to the log PGLOG, and send ACK to the main OSD after the data and log are placed on the disk ;Finally, after the main OSD receives the ACKs from all updated nodes, it records the metadata of this update to memory, and replies ACK to the client to complete the write request. The invention solves the problem that the distributed storage system CEPH does not support erasure code overwriting.

Description

technical field [0001] The invention relates to the field of distributed storage, in particular to an erasure code overwrite method for distributed storage CEPH. Background technique [0002] Traditional distributed storage uses multi-copy storage technology to provide high reliability by saving multiple copies of one data. While multiple copies bring high reliability, the storage cost is also multiplied. Erasure codes have been used more and more as a way to obtain the same reliability with less storage cost. [0003] At present, the main application field of erasure code is cold data storage. Most of the read and write modes are write once and read multiple times. Files only support the append mode of adding data at the end. The modification mode of additional writing is similar to writing a new file, while the overwriting of erasure codes involves the update of data blocks and the update of check blocks. The update of data blocks only needs to replace the corresponding ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F11/10H04L29/08
CPCH04L67/1097G06F3/064G06F3/0644G06F3/067G06F11/1004G06F2201/82H04L67/568
Inventor 瞿天善叶保留陆桑璐
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap