File writing-in method and related device based on erasure codes

Abstract

The invention discloses a file writing-in method and device based on erasure codes, a computer readable storage medium and a server. The method comprises the steps that whether or not the length of source data is needed to be written into zero data to make up the length of erasure strips is judged; if yes, the zero data is written into the source data, and an erasure code algorithm is used for calculating redundant data; when the zero data is written into a hard disk, a file of which the size is identical to that of the zero data is established through system operation commands, and accordingly a memory system identifies the file into the zero data. When the zero data is written into the hard disk, an empty file of which the size is identical to that of the zero data is used for replacinga writing-in operation, the memory system can identify writing-in of the zero data, the writing-in time of the zero data is saved, the performance of writing-in of original zero data is improved, andthe performance utilization rate of the memory system is improved. The file writing-in device based on the erasure codes, the computer readable storage medium and the server have the advantages.

Description

technical field [0001] The present application relates to the technical field of distributed storage, and in particular to an erasure code-based file writing method, a file writing device, a computer-readable storage medium, and a server. Background technique [0002] With the continuous development of storage technology, storage systems for different application scenarios have been extended. In terms of processing a large amount of data, a distributed storage system is generally used. In order to maintain the reliability of data storage, erasure coding technology is commonly used to improve the reliability of the storage system. [0003] Erasure code technology is a data protection method. By dividing a certain length of data into K parts, K parts of data are calculated by encoding algorithm to obtain M redundant check block data. Store K+M copies of data in different locations, such as disks, storage nodes or other locations. Only K of the K+M pieces of data are needed t...

AI Technical Summary

Problems solved by technology

When the operating pressure of the storage system is high, writing these zero data will undoubtedly affect the performance of the entire storage system, resulting in waste of storage system performance.

[0006] Therefore, how to solve the problem that writing zero data under the erasure code technology affects the performance of the storage system is a hot issue concerned by those skilled in the art

Images