Distributed metadata management method and system

A management method and metadata technology, applied in the field of metadata management, to achieve the effect of ensuring system efficiency, improving utilization, and ensuring load balance

Active Publication Date: 2017-04-26
中科天极(新疆)空天信息有限公司
View PDF5 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a distributed metadata mana

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed metadata management method and system
  • Distributed metadata management method and system
  • Distributed metadata management method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] An embodiment of the present invention provides a distributed metadata management method, including: a static load balancing method for metadata and a dynamic load balancing method for metadata;

[0061] The static load balancing method of the metadata is: using the consistent hash function of the virtual node and the metadata server list to distribute the metadata to the metadata server nodes; wherein, the metadata server list is to record all A table of mapping relationships between virtual nodes and metadata servers, each metadata server node stores a list of virtual nodes stored on the node;

[0062] The method for dynamic load balancing of metadata is as follows: using metadata migration to migrate part of metadata from overloaded nodes to underweight nodes.

[0063] In the embodiment of the present invention, the architecture of the distributed file system including the distributed metadata management system can be found in figure 1 shown, from figure 1 It can b...

Embodiment 2

[0116] An embodiment of the present invention provides a distributed metadata management system, including: a metadata server manager and a metadata server, and the metadata server manager includes a metadata server list maintenance module, a metadata server selection module and a load A balance module; the metadata server includes a metadata processing module and a load measurement module;

[0117] The metadata server list maintenance module is responsible for maintaining the correct correspondence between virtual nodes and metadata server nodes;

[0118] The selection module of the metadata server is used to complete random distribution of metadata,

[0119] The load balancing module is used to receive the load information of each metadata server, calculate the system load value and sort the load of each metadata server, and carry out metadata allocation when the system load is unbalanced or when the metadata server cluster needs to be adjusted. move;

[0120] The load mea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed metadata management method and system, and relates to the technical field of metadata management. By means of the method and the system, two strategies including static load balancing when metadata is distributed and dynamic load balancing in system operation are used; therefore, the utilization rate of metadata service resources is increased; the load balancing of the system is ensured; the expandability of the system is increased; in addition, because a metadata delay movement scheme based on a directory redirection table is used, the problem of a large number of metadata movement due to renaming operation can be solved; and the stability of the system efficiency is ensured.

Description

technical field [0001] The present invention relates to the technical field of metadata management, in particular to a distributed metadata management method and system. Background technique [0002] At present, in the face of more and more mass data, due to the limitations of performance and price, the existing storage methods can no longer meet the demand. What the market needs is data with large storage capacity, scalability, security and high availability. Storage system, thus, distributed storage emerges as the times require. [0003] In order to effectively manage each storage node in the distributed storage system, according to the storage and access characteristics of metadata and data in the file system, the distributed file system generally stores metadata and data separately. The metadata storage system is a bridge connecting users and data storage servers. Therefore, efficient metadata management is very important to achieve high performance and scalability of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F9/50
CPCG06F9/5083G06F16/164G06F16/1727G06F16/182
Inventor 郭晓凤
Owner 中科天极(新疆)空天信息有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap