Distributed metadata management method and system

A management method and metadata technology, applied in the direction of digital data processing, special data processing applications, structured data retrieval, etc., to achieve stable performance, improve stability and efficiency, and reduce the risk of downtime

Inactive Publication Date: 2014-04-16
INST OF INFORMATION ENG CAS
View PDF3 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The technical problem to be solved by the present invention is to provide a distributed metadata management method and system, wh

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed metadata management method and system
  • Distributed metadata management method and system
  • Distributed metadata management method and system

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0037] The principles and features of the present invention will be described below with reference to the accompanying drawings. The examples are only used to explain the present invention, but not to limit the scope of the present invention.

[0038] likefigure 1 As shown, this embodiment provides a distributed metadata management method, which specifically includes the following steps:

[0039] Storage steps: divide independent metadata nodes and user table nodes for storing metadata and user tables respectively, and use multiple metadata nodes to store multiple copies of metadata to form master copy nodes that are all used to store the same metadata and slave replica nodes;

[0040] Verification step: perform data verification on the primary replica node and the secondary replica node to ensure the consistency of the metadata stored on the primary replica node and the secondary replica node;

[0041] Repair steps: Use ZooKeeper technology to establish a monitoring ring bas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a distributed metadata management method and system. The distributed metadata management method particularly includes the steps of carrying out storage: carrying out partition to form independent metadata nodes for storing metadata and independent user table nodes for storing user tables, adopting a plurality of metadata nodes to store multiple copies of the metadata, and forming main copy nodes and auxiliary copy nodes, wherein the same metadata are stored in the main copy nodes and the auxiliary copy nodes; carrying out verifying: carrying out data verification on the main copy nodes and the auxiliary copy nodes to guarantee that the metadata stored in the main copy nodes and the metadata stored in the auxiliary copy nodes are coincident; carrying out repairing: building monitoring rings based on the main copy nodes and the auxiliary copy nodes through the ZooKeeper technology, and when it is monitored that some main copy nodes or some auxiliary copy codes fail, triggering switching between the main copy nodes and the auxiliary copy nodes through the monitoring rings to achieve repairing of the failed nodes. The distributed metadata management system corresponds to the technical schemes of the distributed metadata management method in a one-to-one mode. The distributed metadata management method and system solve the problem of single-node failures in metadata management and achieves the aim of coincidence among multiple copies.

Description

technical field [0001] The invention belongs to the research field of massive data storage management, in particular relates to metadata management in the field of big data storage, and is a distributed metadata management method and system. Background technique [0002] In recent years, with the development of the information society, more and more information has been digitized, especially with the development of the Internet, the data has exploded. The first is the sharp expansion of storage capacity, which puts forward a greater demand for storage servers; the second is the increase of data duration; finally, it puts forward higher requirements for the management of data storage. In particular, the diversification of data, geographical dispersion, protection of important data, etc. all put forward higher requirements for data management. With the explosion of unstructured data, distributed databases have also entered a golden age of development. From high-performance co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2365G06F16/21
Inventor 王海平王树鹏张永铮吴广君周晓阳
Owner INST OF INFORMATION ENG CAS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap