Unlock instant, AI-driven research and patent intelligence for your innovation.

Massive metadata fragment distribution method and device

A data fragmentation and metadata technology, which is applied in the input/output process of data processing, electrical digital data processing, special data processing applications, etc. , the effect of convenient management and maintenance

Inactive Publication Date: 2017-08-18
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF6 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a method and device for fragmentation distribution of massive metadata. The present invention solves the problem of low efficiency of file system metadata management due to the large number of files in a single directory

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive metadata fragment distribution method and device
  • Massive metadata fragment distribution method and device
  • Massive metadata fragment distribution method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] For ease of understanding, the following explanations are made to some nouns appearing in the present invention:

[0029] Hash value, the hash algorithm maps a binary value of any length to a smaller binary value of fixed length, and this small binary value becomes a hash value. A hash value is a unique and extremely compact numerical representation of a piece of data. If you hash a piece of plaintext and change even one letter of the piece, subsequent hashes will produce different values.

[0030] Below in conjunction with accompanying drawing and embodiment, the specific embodiment of the present invention is described in further detail:

[0031] This embodiment provides a method for fragmentation distribution of massive metadata, including:

[0032] Divide the metadata data block of a single directory into multiple metadata fragments;

[0033] Metadata data blocks are distributed on different metadata shards according to predetermined rules;

[0034] Store differ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of massive metadata distribution of file systems, and discloses a massive metadata fragment distribution method. The method comprises the following steps of: dividing single-catalog metadata blocks into a plurality of metadata fragments; distributing the metadata blocks on different metadata fragments according to a predetermined rule; and respectively storing different metadata fragments on a plurality of storage devices. The invention furthermore discloses a massive metadata fragment distribution device which comprises a single-catalog metadata block division module, a first metadata block distribution module and a metadata fragment storage module. According to the method and device disclosed by the invention, the problem that the file system metadata management efficiency of files with massive sing-catalog data is low is solved; and the single-catalog metadata blocks are divided into the plurality of metadata fragments, the sizes of which are decreased, so that the loading and synchronization of metadata cache can be realized.

Description

technical field [0001] The invention belongs to the technical field of massive metadata distribution in file systems, and in particular relates to a method and device for fragmentation distribution of massive metadata. Background technique [0002] Data in any file system is divided into data and metadata. Data refers to the actual data in ordinary files, while metadata refers to system data used to describe the characteristics of a file, such as access rights, file owners, and distribution information (inodes...) of file data blocks, etc. In a distributed file system, the distribution information includes the location of the file on the disk and the location of the disk in the cluster. Users need to operate a file and must first obtain its metadata before locating the location of the file and obtaining the content or related attributes of the file. When users use the file system, file system metadata requests account for more than 50% of all requests, such as (readdir, ge...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F3/06
CPCG06F16/182G06F3/061G06F3/064G06F16/134
Inventor 李雪生
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD