Efficient metadata memory access method in distributed file system

A distributed file and metadata technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as file system performance discounts

Active Publication Date: 2011-04-20
DAWNING INFORMATION IND BEIJING +1
View PDF4 Cites 33 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On an ordinary server, a system call takes about tens of microseconds. In a distributed file system with extremely frequent metadata access, this overhead will greatly reduce the performance of the file system.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Efficient metadata memory access method in distributed file system
  • Efficient metadata memory access method in distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] (1) The index nodes are numbered by 64-bit unsigned integers, starting from 0, and the metadata of every 32K index nodes is stored in the same file. store. like figure 1 shown

[0015] (2) In order to reduce the interaction with the local file system, the present invention stores the directory structure of the inode file according to figure 1 The structure shown is organized as a multi-way search tree, with each non-leaf node of the tree corresponding to a subdirectory, and leaf nodes representing inode files. In this way, when a certain index node needs to be accessed, it is first searched from the multi-way search tree through its index node number. If the search is successful, you do not need to go to the local file system to access the data of the inode through the system call; only when the inode does not exist in the memory, it will interact with the local file system, and establish a corresponding tree node for it, and later There is a request to access the s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an efficient metadata memory access method in a distributed file system, which comprises the following steps: based on a file tree access mode combining a multi-path search tree and a trie tree, reading and writing is carried out on a metadata file in a file memory mapping way; and based on a metadata tree structure, inode metadata synchronized to a disc from a memory is optimized to reduce the disc load.

Description

technical field [0001] The invention relates to the field of distributed file system management, in particular to an efficient metadata retrieval method in a distributed file system. Background technique [0002] In a distributed file system, metadata is an important unit to describe the file system. In most typical applications of distributed file systems, such as the Internet, scientific computing, etc., metadata access requests account for more than half of all requests. Therefore, the access efficiency of metadata in a distributed file system has an extremely important impact on the performance of the entire file system. [0003] The metadata of the file system mainly includes inodes and directory entries. An inode is the identifier of an object (file and directory) in the file system. An inode will have a unique global number, that is, the inode number; a directory entry is a description of a sub-item in the directory, usually including the sub-item's Name and inode ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 杨浩邵宗有苗艳超王勇马照云
Owner DAWNING INFORMATION IND BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap