Method for managing memory metadata of cluster file system

A cluster file and file system technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problems of poor versatility and low efficiency, achieve good scalability, efficient use of memory space, and improve metadata The effect of processing power

Active Publication Date: 2009-01-28
SHANGHAI YINGLIAN SOMATOSENSORY INTELLIGENT TECH CO LTD
View PDF0 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] In order to overcome the defects of low efficiency and poor versatility of the cluster file processing method in

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for managing memory metadata of cluster file system
  • Method for managing memory metadata of cluster file system
  • Method for managing memory metadata of cluster file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] A method for managing metadata of a cluster file system provided by the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0037] Such as figure 1 As shown, in order to support the metadata processing of a large-scale cluster file system, the entire file system is divided into multiple metadata partitions. Among them, each metadata partition can be regarded as an independent file system, which can be loaded into memory or unloaded from memory as a whole. When the file system needs to be expanded, a new partition is created to store new metadata. Multiple metadata partitions can be loaded separately on multiple metadata servers to provide higher aggregate processing capacity.

[0038]In the multiple metadata partitions of the file system, each metadata partition is divided into multiple metadata blocks, and each metadata block contains a fixed number (for example, usually 1024, or other numbers) o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for managing metadata for a cluster unit file system, wherein the file system is divided into a plurality of metadata subareas, and each metadata subarea is divided into a plurality of metadata blocks for maintaining the unit information of the metadata. The method comprises the following steps: the client analyzes the generated metadata requirement to acquire the metadata subarea which the metadata belongs to, the request is sent to a metadata server corresponding to the metadata subarea; the metadata server determines the type of the request according to the type value in the received metadata request; according to the type of the request of the metadata server, the metadata server inquires the data structure where the metadata is stored and increases, positions and modifies the metadata. The method adopts the mode of staying the metadata in the memory to improve the processing capability of the metadata, organizes and manages the metadata according to the characteristics of memory access, effectively utilizes the memory space, and improves the processing performance of the metadata.

Description

technical field [0001] The present invention relates to the technical field of storage system architecture, and more specifically, the present invention relates to a method for managing metadata of a cluster file system. Background technique [0002] The data processed in the computer storage system includes two types: one is the data used by users, that is, user data; the other is the data used by the storage system to manage user data, that is, metadata. Metadata access is characterized by a small amount of IO, high CPU utilization, and high requirements for network latency. Usually, the storage system distinguishes the information and control flows of two types of data, defines user data and metadata processing operations separately, and separates the management of the two types of data into independent components. The component that processes metadata is called a metadata server. [0003] Metadata servers can be divided into two types according to the system composition...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 邢晶熊劲马捷孙凝晖
Owner SHANGHAI YINGLIAN SOMATOSENSORY INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap