A data writing method and device

A technology of data writing and raw data, applied in the field of data processing, can solve the problem that the CephEC solution does not support overwriting, write penalty, etc., and achieve the effect of improving data writing performance

Active Publication Date: 2021-07-23
NEW H3C TECH CO LTD
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The present invention provides a data writing method and device to solve the problem that the existing Ceph EC scheme does not support overwriting and there is a writing penalty

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data writing method and device
  • A data writing method and device
  • A data writing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] In order to better understand the technical solution of the embodiments of the present invention, the above objects, features, and advantages of the embodiments of the present invention can be more apparent, and the technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings. Work more detailed description.

[0028] See figure 1 A flow schematic of a data write method provided in the embodiment of the present invention, wherein the data write method can be applied to a storage node in a distributed object storage system (such as Ceph, below as an example of Ceph), such as figure 1 As shown, the data write method can include the following steps:

[0029] Step 101, when receiving a write request for the target file, divide the target file into the original data block in accordance with the preset block, and calculates at least one check data block based on the original data block using the parity algorith...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a data writing method and device. The method includes: when receiving a writing request for a target file, dividing the target file into original data blocks according to a preset block size, and according to the The original data block uses a parity check algorithm to calculate at least one check data block; the original data block and the check data block corresponding to the target file are concurrently written to a plurality of consecutive free blocks in the object object group; the object Each object in the group is mapped to a different object storage device OSD. The application of the embodiment of the present invention can solve the problem of writing penalty in Ceph EC, and improve the data writing performance of Ceph.

Description

Technical field [0001] The present invention relates to the field of data processing, and more particularly to a data write method and apparatus. Background technique [0002] Ceph (distributed storage system) is a performance, high reliability, and high-scalability distributed storage system, widely used in all kinds of large and medium-sized storage environments. [0003] At present, Ceph mainly uses multiple copies strategies to ensure the reliability of data, but multiple copies have reduced the disk utilization of Ceph, for example, 2 copies of disk utilization rate of 50%, 3 copies of disk utilization rate of 33%. [0004] In order to improve the disk utilization, Ceph proposed an EraSure Coding, EC) policy. [0005] The hand detection algorithm divides the write data into K-raw data, calculates M-calibration data by this K-name, and all raw data can be restored by any of this k + m copy. [0006] However, in practice, it is found that when some original data in the strip i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/10G06F3/06
CPCG06F3/064G06F11/1076
Inventor 马海兵陈钊
Owner NEW H3C TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap