Metadata server of mass storage system and metadata indexing method

A metadata server and mass storage technology, applied in the storage field, can solve problems such as poor flexibility, high time and space overhead, etc., and achieve the effect of small time and space overhead and reduced time and space overhead

Inactive Publication Date: 2011-01-12
JIANGSU UNIV
View PDF4 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The purpose of the present invention is to solve the problems of large time and space overhead and poor flexibility in the existing metadata indexing methods, provide a metadata indexing method for mass storage systems, and construct a new metadata indexing method for mass storage systems data server

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata server of mass storage system and metadata indexing method
  • Metadata server of mass storage system and metadata indexing method
  • Metadata server of mass storage system and metadata indexing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0078] A metadata server for a mass storage system, comprising a device for receiving a metadata access request, a device for grading metadata, a device for grading metadata for metadata, a device for searching metadata, and a device for returning metadata; There is also a metadata grading device and a metadata indexing device between the devices, which are used to classify the metadata according to the activity, and use corresponding methods to establish indexes of different levels of metadata.

[0079] In this embodiment, on the basis of the metadata server of the existing mass storage system, a metadata grading device and a metadata grading indexing device are added to form a new metadata server with relatively small time and space overhead.

[0080] The metadata grading device includes main functions such as a metadata activity calculation module and a metadata grading module.

[0081] The description of each function in the metadata grading device is shown in Table 1.

...

Embodiment 2

[0089] The classification-based metadata organization method includes the following steps: 1. Calculate the activity of metadata; 2. Divide metadata into two parts: active and inactive; 3. Establish an index of active metadata; 4. Establish an index of inactive metadata The index of the data.

[0090] The step of calculating the activity of metadata may specifically include the following steps:

[0091] (1) Calculate the activity of metadata: use formula 1 to calculate.

[0092] The step of dividing metadata into active and inactive parts may specifically include the following steps:

[0093] (1) Define the metadata active threshold , as the basis for grading metadata;

[0094] (2) Use Formula 2 to judge the level of metadata.

[0095] The step of establishing an active metadata index may specifically include the following steps:

[0096] (1) Active metadata partition: partition active metadata according to file attributes (such as suffix name);

[0097] (2) Adjust meta...

Embodiment 3

[0108] The method for searching hierarchical metadata includes the following steps: 1. Receive an access request for metadata; 2. Search for metadata; 3. Return metadata.

[0109] The step of finding metadata may specifically include the following steps:

[0110] (1) Search in active metadata: first search with the index of active metadata, if found, go to step 3, otherwise go to step (2);

[0111] (2) Search in inactive metadata: search with the help of the index of inactive metadata, if found, go to step 3, otherwise return the information that the metadata cannot be found.

[0112] like image 3 As shown in , the search step in the active metadata specifically includes the following steps:

[0113] (1.1) Use the file path or logo to calculate through Bloom Filter;

[0114] (1.2) Compare the obtained value with the summary string of a certain partition;

[0115] (1.3) If there is a hash value that is not in the summary string corresponding to the partition, go to step (4...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of a storage technology, and in particular relates to a metadata server of a mass storage system and a metadata indexing method. The metadata server comprises a metadata access request receiving device, a metadata searching device and a metadata returning device; and a metadata classifying device and a metadata classifying and indexing device are arranged between the metadata access request receiving device and the metadata searching device. The metadata indexing method comprises the following steps: collecting and classifying metadata, and establishing an active metadata index and an inactive metadata index according to metadata classification. The invention establishes a prototype system based on a classified metadata management algorithm and proves that the classified metadata management algorithm can help reduce time and space overhead for searching the active metadata through tests and comparison by using an effective method, thus improving adaptability for different loads and strengthening performance stability.

Description

technical field [0001] The invention belongs to the technical field of storage, relates to a mass storage system therein, and specifically relates to a metadata server and a metadata indexing method. Background technique [0002] In a mass storage system, before accessing data, it is first necessary to access the metadata server, query and obtain metadata information such as the size of the data, access authorization, and storage location according to the file name and other information, and then read the data stored in the corresponding storage device. But in the end, a large number of access requests do not need to operate the saved data, but only need to operate the metadata. According to statistics, in NFS and AFS, 75.4% of read operations only need to use metadata, accounting for 49% of the total time and space overhead of read operations; 82.2% of write operations only need to use metadata, accounting for 49% of the total time and space overhead of write operations 63...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 蔡涛牛德姣鞠时光刘阳宽
Owner JIANGSU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap