Method and device for reading distributed metadata files

A metadata and distributed technology, applied in the field of metadata management, can solve problems such as manual monitoring and migration directory lag, and achieve the effect of avoiding hot spots, reducing heat, and reducing load pressure

Inactive Publication Date: 2017-11-03
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF5 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage of this method is that the file stored in the directory of the smallest migration un

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for reading distributed metadata files
  • Method and device for reading distributed metadata files
  • Method and device for reading distributed metadata files

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0071] Based on the above embodiment, considering that if the files stored in the directory are too concentrated and stored in a certain directory segment, the amount of files stored in the metadata node where the segment is located is too large, and the metadata node still exists Certain hotspot issues, a specific implementation mode provided in the present invention that can further improve the above-mentioned embodiment, the method may specifically include:

[0072] The file is stored in each of the directory fragments, and the number of the files in each of the directory fragments is within a first preset range; the first preset range is based on the total number stored in the directory The number of said files is determined.

[0073] In order to avoid the files stored in the directory being too concentrated and stored in a certain directory segment, the number of files stored in each directory segment may be adjusted within a preset range according to the total number of the f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for reading distributed metadata files. After a directory is created, the directory is split into multiple directory fragments, and the multiple directory fragments are migrated to multiple metadata nodes, files which need to be written into the directory are stored in all the multiple directory fragments, when the files are read, according to the corresponding relations of identification information of the files and the directory fragments, and the directory fragments and the metadata nodes, metadata nodes stored in the files are finally determined so as to read the files, the frequency of frequently accessing the metadata nodes in which hotspot directories are located is reduced to a certain degree, the degree of hotspot of the metadata nodes is lowered, the loading pressure of the metadata nodes is reduced, and the performance of a whole metadata management system is improved. The invention further discloses a device for reading the distributed metadata files, and the device has the above same advantages.

Description

technical field [0001] The invention relates to the field of metadata management, in particular to a method and device for reading distributed metadata files. Background technique [0002] Data in any file system is divided into data and metadata. Data refers to the actual data in ordinary files, and metadata is mainly information describing data attributes, used to support functions such as indicating storage locations, historical data, resource search, and file records. There are two ways of metadata management, centralized management and distributed management. Distributed management refers to storing metadata in any node of the system and can dynamically migrate it. Responsibility for metadata management is also distributed to various nodes. [0003] In a system with multiple metadata nodes, each metadata node has its own directory structure, and the newly created subdirectory belongs to the load of the metadata node to which the parent directory belongs. If the acces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06
Inventor 程瑶
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap