Method for organizing and accessing metadata file log

A metadata and file technology, applied in the field of log management, can solve problems such as high time overhead and reduced log system performance, and achieve the effects of reducing processing time, sync operations, and file operations

Active Publication Date: 2012-07-04
DAWNING INFORMATION IND BEIJING +1
View PDF1 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since a system call is required to open a file every time, the time overhead is very large; at the same time, since writing a file cannot actually be written to the disk, sync (synchronization) must be performed, and the time of this operation itself very expensive
These problems will significantly reduce the performance of the log system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] The technical scheme in the invention is specifically described as follows:

[0017] (1) Use the red-black tree to organize all files involved in the consistent operation of the log system. Select the file name of the log file as the keyword of the red-black tree. When the log system opens a file that has not been opened, apply for the red-black tree A node, and record the file description symbol corresponding to the file on the node. For subsequent log system operations, first query on the red-black tree. If the file is found, the file description on the existing node will be used directly. character, otherwise, continue to add to the red-black tree.

[0018] If the open file has exceeded the upper limit of the system, some red-black tree nodes are selected for recycling. The method of recycling is to record the latest access time of all files and form an LRU queue, which is sorted according to the most recent access time. Every time the file is recycled, the file tha...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for organizing and accessing a metadata file log. The method comprises the following steps of: organizing all files related to a consistency operation of a log system by utilizing a red-black tree, and selecting a file name of a log file as a keyword of the red-black tree. According to the method for organizing and accessing the metadata file log, provided by the invention, the files related to a reliable operation are managed by guiding the red-black tree so that operation times of the files in the reliable operation are reduced and performance of the reliable operation is improved; and simultaneously, an operation of writing a plurality of metadata into a disc is subjected to convergence management so that a sync operation of the files is largely reduced and the processing time of the reliable operation is shortened.

Description

technical field [0001] The invention relates to log management in a distributed file system, in particular to a method for organizing and accessing metadata logs in a distributed file system based on a local file system. Background technique [0002] With the rapid development of computer technology, the requirements for storage in the fields of network and scientific computing are getting higher and higher, so the distributed file system is gradually introduced into these fields to meet the storage needs of these fields. Considering the complexity of implementation, many distributed files are implemented based on the local file system. [0003] In a distributed file system, metadata maintains important information such as all directories and files, so its reliability is very important. In order to improve its reliability, many distributed file systems use a log system to improve reliability. [0004] In this log system based on the local file system, all logs are an ordin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 王勇张东阳张玉龙邵宗有刘新春苗艳超
Owner DAWNING INFORMATION IND BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap