Metadata processing method and device, electronic equipment and storage medium

A processing method and metadata technology, applied in the computer field, can solve the problems of slow synchronization between sites and slow reconstruction speed, and achieve the effect of reducing size, improving reconstruction speed, and reducing the number of pieces of information

Active Publication Date: 2021-07-02
SHANDONG YINGXIN COMP TECH CO LTD
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can be seen that the large amount of metadata leads to slower reconstruction and slower synchronization between sites during failure recovery

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata processing method and device, electronic equipment and storage medium
  • Metadata processing method and device, electronic equipment and storage medium
  • Metadata processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Apparently, the described embodiments are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application. In addition, in the embodiments of the present application, "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence.

[0044] The embodiment of the present application discloses a metadata processing method, which reduces the size of a single bucket index fragment, thereby increasing the reconstruction speed during fault recovery and the synchronization speed between sites.

[0045] see figure 1...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a metadata processing method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: reading original metadata information on a bucket index fragment in a storage bucket, and carrying out aggregation operation on the original metadata information on the same bucket index fragment to obtain aggregated metadata information; storing the aggregated metadata information to a bucket index metadata fragment, and storing attribute information of the aggregated metadata information to the bucket index fragment; and deleting the original metadata information on the bucket index fragment. Therefore, according to the metadata processing method, the size of the single bucket index fragment is reduced, so that the reconstruction speed during fault recovery and the synchronization speed between the sites are improved.

Description

technical field [0001] The present application relates to the field of computer technology, and more specifically, to a metadata processing method and device, an electronic device, and a computer-readable storage medium. Background technique [0002] In the era of big data, Object Storage Service (OSS) is an emerging massive, safe, low-cost, and highly reliable cloud storage service, suitable for storing unstructured data. Generally, each bucket has multiple index shards, and object metadata is stored on each index shard through hash calculation. As more and more objects in the bucket reach hundreds of millions, more and more object metadata information will be recorded on each bucket index shard. [0003] After a cluster failure, the stored data and metadata need to be reconstructed during recovery. The more data and metadata, the greater the amount of data, and the slower the reconstruction speed. Synchronization between sites needs to synchronize data and metadata. The ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/16G06F16/178G06F11/07
CPCG06F16/137G06F16/162G06F16/178G06F11/0766
Inventor 陶桐桐
Owner SHANDONG YINGXIN COMP TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap