Data access method and device, data storage method and device and file storage system

Abstract

The invention provides a data access method and device, a data storage method and device and a file storage system. The data access method comprises the steps of determining a file directory management fragment to which a first target data volume to which a to-be-accessed file belongs belongs based on a corresponding relationship between the file directory management fragments and the data volumesin the file storage system, wherein the file storage system is provided with a plurality of file directory management fragments, each file directory management fragment manages metadata of files in aspecified data volume; and accessing the to-be-accessed file based on the metadata of the to-be-accessed file acquired from the file directory management fragment to which the first target data volume belongs. In the method, a plurality of file directory management fragments are arranged in the file storage system, and when a large file quantity is provided, the file target management fragment can be horizontally expanded, so that the problem that the quantity of metadata of files stored in a single file directory management node is limited is avoided, and the quantity of files stored in thesystem and the total data quantity are improved.

Description

technical field [0001] The invention relates to the technical field of file storage, in particular to a data access method, a data storage method, a device and a file storage system. Background technique [0002] HDFS (Hadoop Distributed File System, Hadoop Distributed File System) is a typical and widely used open source distributed file storage system. In the HDFS system, the metadata of all files is stored in the NameNode node. The memory space of the NameNode node is limited, so the number of metadata of the files that can be stored in the NameNode node is limited, which limits the total number of files that can be stored in the system as a whole. and total data volume. Contents of the invention [0003] In view of this, the object of the present invention is to provide a data access method, a data storage method, a device and a file storage system, so as to increase the number of files stored in the system and the total data volume. [0004] In the first aspect, the...

AI Technical Summary

Problems solved by technology

In the HDFS system, the metadata of all files is stored in the NameNode node. The memory space of the NameNode node is limited, so the number of metadata of the files that can be stored in the NameNode node is limited, which limits the total number of files that can be stored in the system as a whole. and the total amount of data

Images