Method and device for writing data into

A data writing and data technology, which is applied in the input/output process of data processing, electrical digital data processing, input/output to record carriers, etc., can solve the problems of stripe data disorder, consume disk io performance, etc. Effects of loss risk, low data write latency

Active Publication Date: 2017-10-20
ZHEJIANG DAHUA TECH CO LTD
View PDF6 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This process has data consistency risks (especially when the disk group is distributed in a distributed storage system, such as some strips complete writing, while some strips fail to write, resulting in disordered data in the entire stripe), and consumes a lot of additional disk io performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for writing data into
  • Method and device for writing data into
  • Method and device for writing data into

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] In order to make the purpose, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present invention, rather than all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0054] figure 2 A system architecture applicable to the embodiment of the present invention is shown, and the system architecture is composed of at least two parts, such as figure 2 As shown, including read and write data drivers and disk storage services. Typically, disk storage services are distributed across the network in a distributed manner. Of course, the disk storage service can also fall within a storage node. The data rea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and device for writing data into. The method includes obtaining of the data to be written into, a strip matched with the volume of the obtained data to be written into is determined from a disk storage system according to the volume of the obtained data to be written into, wherein the disk storage system includes multiple strips different in depth, each strip includes n data strip units and m verification strip units, the data to be written into is divided into n data strip units, the m verification strip units are calculated out through an erasure code algorithm, and the n data strip units and the m verification strip units are written into the determined strip. According to the volume of the data to be written into, the strip of the suitable depth is selected, the data to be written into is written into the selected strip through the erasure code algorithm, and the effects that the throughput is improved by selecting the strip with the large depth when the volume of the data is large, and when the volume of the data is small, the strip with small depth is selected, so that the risks of delayed writing and data losing are reduced.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of data storage, and in particular, to a data writing method and device. Background technique [0002] Erasure coding (EC) is a data protection method, which divides the original data into data blocks (strips), encodes multiple data blocks through algorithms to form one or more redundant data blocks, and divides the data into one or more redundant data blocks by continuous A stripe (stripe) composed of multiple data blocks and associated redundant blocks is stored in different storage spaces, so that data can be reconstructed after a part of the storage space fails. Erasure coding technology is a very good compromise between disk space utilization and data reliability, and has been widely used in distributed storage systems. by figure 1 For example, D0, D1, D2, D3, D4, and D5 are data blocks, and P0, P1, and P2 are redundant data blocks obtained through algorithm calculation, forming ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/10
CPCG06F3/0611G06F3/0619G06F3/0631G06F3/0638G06F3/0644G06F3/0676G06F11/1048
Inventor 周明伟江文龙
Owner ZHEJIANG DAHUA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products