Metadata storage system for cluster file system and metadata management method

A storage system and cluster file technology, applied in file system, electronic digital data processing, special data processing applications, etc., can solve problems such as unsatisfactory, increase system cost, affect system performance, etc., and achieve the effect of improving performance

Active Publication Date: 2012-02-29
INST OF COMPUTING TECH CHINESE ACAD OF SCI +1
View PDF4 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For the first and third strategies, since the SSD will receive a large number of small-grained random I/O and cause rapid wear and tear, the service life of the SSD cannot be guaranteed
The second strategy of using HDD as SSD write buffer has two main problems for the metadata storage application of the cluster file system: one is that the data is finally placed on the SSD. When the data scale is large, a large number of SSDs are r

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata storage system for cluster file system and metadata management method
  • Metadata storage system for cluster file system and metadata management method
  • Metadata storage system for cluster file system and metadata management method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0040] In order to make the objectives, technical solutions and advantages of the present invention clearer, the following further describes the present invention in detail through specific embodiments with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0041] In one embodiment of the present invention, a metadata storage system for a cluster file system is provided. The system includes a volatile random access memory (such as DRAM or SRAM), a solid-state drive SDD and / or a traditional Hard disk drive HDD. Among them, DRAM is used to store some auxiliary information of the metadata storage structure, and some metadata is cached to improve performance; while the metadata is stored persistently on the SSD, or on the SSD and HDD.

[0042] figure 1 A metadata storage system for a cluster file system according to an embodiment of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a metadata storage system for a cluster file system and a metadata management method. The metadata management method comprises the following steps of: storing metadata of the cluster file system by using a dynamic random access memory (DRAM), solid-state disk (SSD) and hard disk drive (HDD) three-layer architecture, and sequentially writing the metadata into metadata buffer regions in a DRAM; and when a metadata buffer region is overwritten, sequentially writing the metadata back to an SSD to form a new metadata storage unit, and storing metadata index information in a head structure into the DRAM in the form of a data index unit. By storing the metadata by adopting a rewriting mode, the metadata performance of the cluster file system can be improved effectively; furthermore, the invention also provides a data migration strategy based on access favor; therefore, more frequently accessed metadata are retained on the SSD; and the performance of reading operation of the metadata is improved.

Description

technical field [0001] The invention relates to the system structure of a cluster file system, in particular to metadata storage and a related data migration mechanism in the cluster file system. Background technique [0002] With the development of information technology, human beings generate, save and process more and more data. The number of files increases significantly with the increase of data volume, which gives the metadata storage system of cluster file system based on traditional dynamic random access memory (Dynamic Random Access Memory, DRAM) + hard disk drive (Hard Disk Drive, HDD) storage architecture Serious challenges are posed: [0003] In terms of storage scale, the total amount of metadata storage is getting larger and larger. The number of files to be saved in the cluster file system is increasing, especially with the rapid development of Internet applications, files exist in various forms, such as emails, photos, videos, reports, etc. With the increa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/13G06F16/1847G06F16/1858
Inventor 陈卓熊劲
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap