Metadata sharing management method for multi-storage clusters under wide area network environment

A management method and metadata technology, applied in the computer field, can solve the problems of lack of research and development and invention of key technologies for metadata sharing, and achieve the effects of optimized performance, wide application range, and strong practicability

Active Publication Date: 2013-12-18
BEIHANG UNIV
View PDF2 Cites 30 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the research and development and invention of key technologies for metadata sharing of multi-cluster systems in the WAN environment are still lacking.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata sharing management method for multi-storage clusters under wide area network environment
  • Metadata sharing management method for multi-storage clusters under wide area network environment
  • Metadata sharing management method for multi-storage clusters under wide area network environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the object, technical solution and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0039] The main idea of ​​the present invention is to perform unified management of metadata on multi-storage clusters in a wide area network environment, selectively synchronize metadata that needs to be synchronized through the authority mechanism, and at the same time localize the synchronized global name space The user view is dynamically configured to meet the needs of users or upper-level applications for high-performance access to metadata.

[0040] The following uses HDFS (an open source distributed file system) as an example to describe a metadata sharing management method for multi-storage clusters under a wide area network environment according to the present invention, such as figure 1 with 2 The method shown includes:

[...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a metadata sharing management method for multi-storage clusters under a wide area network environment. The problems that under the wide area network environment, metadata cannot be shared between the multi-storage clusters according to needs, and a global name space cannot provide user views which can be configured dynamically are solved, and an authority control technology, a global synchronization technology and a name space reconstitution technology are used. Efficient and matched file metadata inquire supporting is provided for an upper layer application. The method comprises the steps that a local name space stored locally is read, local metadata are screened according to authority setting rules at regular intervals and then are combined into global metadata information; the global name space stored locally in a catching mode is read, synchronization frequency is determined according to synchronization strategies, and meanwhile the global consistency is maintained according to an improved Paxos protocol; the user views are configured dynamically according view configuration rules. View configuration is an implementation process that a user or the upper layer application hopes to reorganize a global name space directory tree structure according to the metadata information.

Description

technical field [0001] The invention discloses a metadata sharing management method, in particular relates to a metadata sharing management method for multi-storage clusters in a wide area network environment, and belongs to the field of computer technology. Background technique [0002] Cluster is an important research direction of the combination of computer system structure and computer system software. It organizes multiple independent machines into a unified whole, and provides transparent unified access to the outside world; by integrating the computing power and storage capabilities of multiple machine nodes under its jurisdiction, it greatly expands the computing power and storage of the overall system ability; at the same time, good system software design enables the cluster to be easily expanded on a large scale and meet diverse scalability requirements. Through multi-copy technology, the cluster can provide extremely high fault-tolerant performance and meet the re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
Inventor 肖利民钟潜潜阮利郝沁汾
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products