Write operation control method, system and device and computer storage medium

Abstract

The invention discloses a write operation control method, system and device and a computer storage medium. The method is applied to a distributed storage system and comprises the steps that when a write request is received, a writing thread is called to segment to-be-written data into original data blocks according to a stripe mode, and the original data blocks are sent to OSD nodes for disk loading and disk unloading according to data object service OSD information corresponding to strips; a background thread is called to generate a verification data block according to the to-be-written data,and the verification data block is sent to the corresponding OSD nodes for disk loading and disk unloading. During each time of data writing, the writing thread is called to sent the to-be-written data to the data lower disk only, then the background thread is called to asynchronously calculate the verification data block, and then independent disk loading and disk unloading are carried out. Thebackground thread does not work on an IO path of a service lower disk, the data amount of the lower disk of the service IO path is reduced, and in this way, the time delay of each time of data writingis reduced so that the distributed storage system can provide higher performance, more paths of video stream services can be supported, and customer requirements can be met.

Description

technical field [0001] The invention relates to the field of distributed file systems, in particular to a write operation control method, system, device and computer-readable storage medium. Background technique [0002] In a distributed storage system, EC (Erasure Code) technology is usually used to achieve data redundancy and reliability. This mechanism ensures that data is recoverable when no more than redundant hard disks fail. . Specifically, each time the client side writes data, it calculates the verification data block corresponding to the original data block through EC technology, and then sends the original data block and the verification data block to OSD (Object-based Storage, data object service) at the same time. ) End and bottom plate. The lower disk of the verification data block occupies the IO (Input / Output, input / output) path of the business lower disk, so that the amount of data on the lower disk of the business IO path is large, resulting in a longer d...

AI Technical Summary

Problems solved by technology

The lower disk of the verification data block occupies the IO (Input / Output, input / output) path of the business lower disk, resulting in a large amount of data on the lower disk of the business IO path, resulting in a longer delay in writing requests and lower business throughput. The capacity and performance are low, it is difficult to support the writing of hundreds or thousands of video streams, and there may be a problem of business congestion

Images