A low-latency file system address space management method, system and medium

Abstract

The invention discloses a low-latency file system address space management method, system and medium. The method of the invention includes: generating a super block and a block group allocation table from the address space of a storage device, and the super block stores file system information and The allocation of block groups on the linear address space of the storage device, the block group allocation table is used to mark the allocation of data blocks in the corresponding block group; when creating a file, the corresponding block group is dynamically created or selected according to the specified data block size and allocated Data block, write file data in the allocated data block and update the block group allocation table and super block information. The present invention can ensure that which data blocks a file occupies on a storage device can be known through only one IO operation, can significantly reduce file reading and writing delays, can significantly reduce file reading and writing addressing overhead, and can significantly improve file reading and writing efficiency. order, thereby improving read and write performance.

Description

technical field [0001] The present invention belongs to the field of file systems for large-scale storage, and in particular relates to a low-latency file system address space management method, system and medium. A novel data structure is used to manage the physical address space of the file system to significantly reduce the File read and write delays. Background technique [0002] The local file system for storage devices is the basis of all data storage and management systems. For example, mainstream databases are all built on the file system, and the distributed file system must rely on the local file system to realize the data organization on the device. The big data storage systems represented by Hbase and Dynamo are either built on the distributed file system, Either directly call the local file system to read and write data on the storage device. In conclusion, the performance of the local file system has a crucial impact on all data storage and management systems...

AI Technical Summary

Problems solved by technology

However, current operating systems generally support multi-core and multi-threading. A file system often faces concurrent writes to a large number of files at the same time. In this way, the continuous write operation for a specific file is often disrupted, making it difficult to create a long file. Extent, cross-order writing for multiple files will significantly reduce the optimization effect of Extent technology

[0010] In short, the current file system is difficult to meet the low latency requirements of data access when faced with large files, and data access latency is a key factor affecting application performance in many scenarios

Images