Metadata organization and management method and system of distributed file system

A technology of distributed file and organization management, applied in electronic digital data processing, special data processing applications, instruments, etc., can solve the problem of low metadata processing performance, improve metadata processing capability, improve efficiency, and reduce response time Effect

Inactive Publication Date: 2013-09-11
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the above defects or improvement needs of the prior art, the present invention provides a metadata organization that distinguishes metadata read and write requests and adopts copy-on-write B+ tree organization to manage metadata in a distributed file system metadata server The purpose of the management method is to pr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata organization and management method and system of distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0036] In order to make the objectives, technical solutions and advantages of the present invention clearer, the following further describes the present invention in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.

[0037] The overall idea of ​​the present invention is to divide the metadata request message packet initiated by the client into a metadata read request message packet and a metadata write request message packet, and then put the differentiated metadata request message packet into the message queue and notify The read-write thread parses and processes the metadata request packet. The read-write thread...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a meta data organization and management method of a distributed file system. The method includes the steps: receiving meta data request message packets, parsing content of the meta data request message packets, putting the meta data request message packets into a corresponding message queue according to parsed types of the meta data request message packets, extracting meta data request message packets from message queues, parsing the meta data request message packets so as to obtain request types and request content of the meta data request message packets, acquiring meta data information stored in a tree B+ according to the meta data request message packets, performing corresponding read-write operation on the meta data information, putting results obtained after read-write operation in a meta data request response message packet, and returning the meta data request response message packet to a client side. The method can solve the problem of poor meta data processing performance of an MDS (meta data server) caused by existing meta data read-write high-concurrency operation, and processing capacity of the MDS is improved. .

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more particularly relates to a metadata organization and management method and system of a distributed file system. Background technique [0002] With the continuous expansion of data information and the wide application of unstructured data in various industries, the distributed file system provides an ideal solution for the storage management of unstructured data. Most current distributed file systems usually process metadata and data separately, that is, separate control flow from data flow, so as to obtain better system scalability and IO concurrency. The system under this strategy is mainly composed of a tripartite architecture of metadata server MDS (Meta Data Server), data storage server, and client. MDS is mainly responsible for storing file namespaces, responding to service requests, and providing metadata information such as file storage locations. In the file system, the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 冯丹付宁施展陈云云柳青韩江李白
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap