Method for improving small file processing capability of storage system and storage system

Abstract

The invention discloses a method for improving small file processing capability of a storage system and the storage system.The storage system comprises a first storage space, a second storage space and a third storage space, and read-write performance of the second storage space is superior to that of the first storage space.The method comprises the steps of receiving a file to be stored; judging whether the size of the file to be stored is greater than a threshold value or not; if the size of the file to be stored is greater than the threshold value, storing the file to be stored into the first storage space; if the size of the file to be stored is less than or equal to the threshold value, storing the file to be stored into the second storage space; storing file identification and the size of the file to be stored as well as a storage address of the file to be stored in the first storage space or the second storage space as metadata, and establishing the corresponding relation among the file identification and the size of the file to be stored and the storage address.By means of the method, the read-write speed of the file with the size being less than the threshold value can be raised.

Description

technical field [0001] The invention relates to the technical field of storage processing, in particular to a method for improving a storage system to process small files and a storage system. Background technique [0002] With the development of science and technology, electronic devices are getting smaller and smaller, and people are more and more fond of using electronic devices for office, study, entertainment and so on. [0003] In order to facilitate the retrieval of data from different places, users increasingly prefer to store data in cloud storage systems, resulting in explosive growth of data stored in cloud storage systems, and storage systems are becoming larger and larger. The huge amount of stored data puts forward higher requirements on the processing performance of the storage system. In order to cope with the huge amount of stored data, traditional storage systems mainly improve processing performance by adding processors, which is very expensive. [0004]...

AI Technical Summary

Problems solved by technology

In order to cope with the huge storage data, the traditional storage system mainly improves the processing performance by adding processors, which is very expensive

[0004] The inventors of this application have found in long-term research that most of the data stored in most storage systems are small files smaller than 1M. In some application scenarios, the number of small files can reach thousands. The reading and writing frequency of small files is also very high, but the traditional storage system does not distinguish between small files and large files, and stores them uniformly. Therefore, in many cases, the limit of frequent reading and writing of small files by the storage system is the performance of the storage system bottleneck

Images