A method for processing data and metadata read and write requests separately

Abstract

The invention discloses a method for separately processing data reading and writing requests and metadata reading and writing requests. The method comprises the following steps: adding metadata semantics of requests; setting a data request queue and a metadata request queue for each SCSI (small computer system interface) equipment, wherein the metadata request queue is especially used for processing metadata requests, and different processing modes are adopted for different requests. The metadata request queue adopts a priority response processing mode according to the characteristics that the metadata requests are small in particle size, high in instantaneity and disperse in distribution; the requests do not pass through an I / O (input / output) scheduling layer, are not delayed in the request queue, and are directly issued to a disk driver; the data requests which are large in request particle size, relatively low in frequentness, and centralized in distribution adopt the mode that the requests pass through the I / O scheduling layer, are stored in the request queue for a period of time, and are issued to the disk driver after being discharged, so that the bottleneck problem of a single request queue is overcome; the parallelism of different levels of request processing is strengthened; the method is especially suitable for the business which needs to frequently and greatly store small files, and has high demands on critical data instantaneity.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more specifically relates to a method for separately processing data and metadata read and write requests. Background technique [0002] The data society needs to access a large amount of data stored in the storage system every day, but in many cases, users do not need to access the data itself stored in the system, but only need to access the metadata in the system. In addition, before accessing the data stored in the system, the metadata must be accessed first, and the data stored in the device can only be read after querying and obtaining metadata information such as data size, storage location, and access rights based on file name and other information. More than half of the system's data access is related to metadata. The metadata I / O is characterized by small granularity, high frequency, and scattered distribution. Therefore, sufficient attention should be paid to the access ...

AI Technical Summary

Problems solved by technology

[0004] In view of the above defects or improvement needs of the prior art, the present invention provides a method for separately processing data and metadata read and write requests, which realizes different processing for requests with different importance and different real-time requirements, and alleviates the single The bottleneck problem of the request queue enhances the parallelism of request processing at different levels, and is especially suitable for businesses that require frequent and large storage of small files and require high real-time performance of key data

Images