Unlock instant, AI-driven research and patent intelligence for your innovation.

Efficient metadata memory access method in distributed file system

A technology of distributed files and metadata, applied in the fields of electronic digital data processing, special data processing applications, instruments, etc., can solve problems such as file system performance discounts

Active Publication Date: 2013-02-06
DAWNING INFORMATION IND BEIJING +1
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On an ordinary server, a system call takes about tens of microseconds. In a distributed file system with extremely frequent metadata access, this overhead will greatly reduce the performance of the file system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Efficient metadata memory access method in distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] (1) Index nodes are numbered with 64-bit unsigned integers. Starting from 0, the metadata of every 32K index nodes is stored in the same file. All index node files are stored on the disk in a two-level tree structure directory according to the node number. deposit. like figure 1 shown

[0015] (2) In order to reduce the interaction with the local file system, the present invention stores the directory structure of the inode file according to figure 1 The structure shown is organized as a multi-way search tree, with each non-leaf node of the tree corresponding to a subdirectory, and leaf nodes representing inode files. In this way, when a certain index node needs to be accessed, it is first searched from the multi-way search tree through its index node number. If the search is successful, there is no need to go to the local file system to access the index node data through system calls; only when the index node does not exist in the memory, will it interact with the l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an efficient metadata memory access method in a distributed file system, which comprises the following steps: based on a file tree access mode combining a multi-path search tree and a trie tree, reading and writing is carried out on a metadata file in a file memory mapping way; and based on a metadata tree structure, inode metadata synchronized to a disc from a memory is optimized to reduce the disc load.

Description

technical field [0001] The invention relates to the field of distributed file system management, in particular to an efficient metadata access method in a distributed file system. Background technique [0002] In a distributed file system, metadata is an important unit to describe the file system. In most typical applications of distributed file systems, such as the Internet and scientific computing, metadata access requests account for more than half of all requests. Therefore, the access efficiency of metadata in a distributed file system has an extremely important impact on the performance of the entire file system. [0003] The metadata of the file system mainly includes index nodes and directory entries. The index node is the identifier of the object (file and directory) in the file system. An index node will have a unique global number, that is, the index node number; the directory entry is a description of a sub-item in the directory, usually including the sub-item ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 杨浩邵宗有苗艳超王勇马照云
Owner DAWNING INFORMATION IND BEIJING