A method and apparatus for processing metadata of an object in a distributed storage system

A distributed storage and metadata technology, applied in the storage field, can solve problems such as uneven distribution of metadata, achieve the effect of avoiding partition hotspots and improving uniformity

Active Publication Date: 2019-02-01
HUAWEI CLOUD COMPUTING TECH CO LTD
View PDF11 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] This application provides a method and device for processing object metadata in a d...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and apparatus for processing metadata of an object in a distributed storage system
  • A method and apparatus for processing metadata of an object in a distributed storage system
  • A method and apparatus for processing metadata of an object in a distributed storage system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The terms "first", "second", "third" and "fourth" in the description and claims of the embodiments of the present invention and the above drawings are used to distinguish different objects, rather than to limit specific order.

[0030] In the embodiments of the present invention, words such as "exemplary" or "for example" are used as examples, illustrations or illustrations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present invention shall not be construed as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete manner.

[0031] A distributed storage system includes multiple servers. Generally, multiple servers in the distributed storage system are divided into service nodes, index nodes, and storage nodes according to the functions of the servers. The storage node i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a device for processing metadata of an object in a distributed storage system, which relates to the technical field of storage and can solve the problem of unevendistribution of metadata of the object. The bucket of the distributed storage system includes at least two logical sub-buckets, the at least two logical sub-buckets are mapped to different partitions, a first logical sub-bucket of the at least two logical sub-buckets is mapped to a first partition, and an index node of the distributed storage system manages the first partition. The method comprises the following steps: a service node of a distributed storage system receives an IO operation including a name of a bucket and a name of a first object; The service node selects a first logical sub-bucket from the bucket according to the name of the bucket and the name of the first object. According to the mapping relationship between the first logical sub-bucket and the first partition, the service node sends a processing request including the name of the first logical sub-bucket and the name of the first object to the index node, and the processing request is used for requesting the metadata of the first object to be processed in the first partition.

Description

technical field [0001] Embodiments of the present invention relate to the field of storage technologies, and in particular to a method and device for processing metadata of objects in a distributed storage system. Background technique [0002] In the distributed storage system, the service node determines the metadata ownership partition of the object according to the shard key value (ShardKey) included in the object's identifier (that is, determines which partition to write the metadata of the object into), and then makes the management of the partition The inode of the object manages the metadata for the object. Generally, the slice key value includes the name of the bucket and the name of the object. In this way, in the scene where the key values ​​are arranged in order, the metadata of objects in a certain bucket in the distributed storage system always belong to one partition, resulting in partition hotspots, and the distribution of metadata of objects in this bucket i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F16/22G06F16/907
CPCG06F16/2228G06F16/278G06F16/907G06F16/22G06F16/27
Inventor 谢晓芹李坤
Owner HUAWEI CLOUD COMPUTING TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap