A Metadata Management Method in Distributed Object Storage

A technology of object storage and management method, which is applied in the field of metadata management in distributed object storage, and can solve problems such as metadata management architecture data and metadata consistency of distributed system single point of failure

Active Publication Date: 2020-11-10
西安奥卡云数据科技有限公司
View PDF16 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a metadata management method in distributed object storage, aiming to solve the problem of single point of failure in distributed systems, the expansion of metadata management architecture, and the consistency of data and metadata

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Metadata Management Method in Distributed Object Storage
  • A Metadata Management Method in Distributed Object Storage
  • A Metadata Management Method in Distributed Object Storage

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0063] In a distributed storage system, logical volumes are divided in units of 4KB, and each 4KB is an object, and each object calculates a 20-bit hash value through the hash function according to its content, so each object has a binary The tuple (SIG, VBN) metadata object_metadate uniquely determines the position of the data object object, SIG (signature signature) is the hash value calculated by the hash function of the object content, and VBN (Logical block number) identifies the object in the logic position on the volume.

[0064] The object metadata of the logical volume has two storage forms, one is in the form of memory, which is required to run the operation; the other is stored on the back-end storage device, and the metadata is saved to reconstruct the metadata in the memory. The object metadata of the logical volume in memory is managed by Merkle Tree. The leaf node number is the VBN number. The leaf node stores the hash value of the logical volume object, and the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a metadata management method in distributed object storage, and the method comprises the steps: S1, uniformly dividing a logic volume into a plurality of logic units, enablingeach logic unit to be an object, enabling each object to correspond to one piece of object metadata, and enabling the object metadata to be used for uniquely determining the content and position of the corresponding object, wherein each piece of object metadata forms a metadata object; S2, searching a target node of copy data of each object in a cluster in a consistent hash table by calculating hash values of contents of each object and each metadata object, and storing the objects and the metadata objects on the target node through a network; and S3, through the hash value of the GUID of thelogical volume, obtaining metadata information of all objects of the logical volume on each node of the cluster, and completing reconstruction of the logical volume Merkel tree. The problems of single-point failure, expansion of metadata management architecture and consistency of data and metadata in a distributed system are solved.

Description

【Technical field】 [0001] The invention belongs to the technical field of data processing, and in particular relates to a metadata management method in distributed object storage. 【Background technique】 [0002] With the rapid development of network and information technology, global data is increasing day by day. Facing the current PB-level mass data storage requirements, traditional storage systems have bottlenecks in capacity and performance expansion. Distributed storage systems have been widely researched and applied because of their characteristics of massive data storage, high scalability, high performance, high reliability, and high availability. The distributed storage system is to disperse and store data on multiple independent storage servers, use multiple storage servers to share the storage load, and use location servers to locate and store information. It not only improves the reliability, availability and access efficiency of the system, but also Easy to expa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0631G06F3/067
Inventor 周耀辉
Owner 西安奥卡云数据科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap