Capacity expansion method, system, device and storage medium of metadata node cluster

A metadata node and metadata technology, applied in digital transmission systems, database design/maintenance, transmission systems, etc., can solve problems such as metadata loss, confusion, and difficulty in implementation, improve efficiency and effectiveness, and reduce confusion. Probability, the effect of less data migration

Active Publication Date: 2022-03-01
ZHEJIANG DAHUA TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, when using the above method to expand the capacity of the metadata node cluster, the metadata needs to be collected together for processing, and the original metadata needs to be split. data loss or corruption
In addition, when the amount of metadata that needs to be split is relatively large, the splitting process takes a long time, affecting system performance and normal operations of other businesses

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Capacity expansion method, system, device and storage medium of metadata node cluster
  • Capacity expansion method, system, device and storage medium of metadata node cluster
  • Capacity expansion method, system, device and storage medium of metadata node cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0043] The expansion method of the metadata node cluster provided by this application can be applied to such as figure 1 shown in the application environment. Among them, the server 140 forms a server cluster, which can store user data in a distributed manner, and the terminal 102 communicates with the server cluster formed by the servers 104 through the network to write or read data. Wherein, the terminal 102 may be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers and portable wearable devices.

[0044] In one embodimen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application relates to a method, system, device and storage medium for expanding capacity of a metadata node cluster. Multiple metadata services are deployed on each metadata node in the metadata node cluster, and each metadata service corresponds to a metadata partition. The method includes: adding a new metadata node, determining the original metadata For at least one metadata partition to be migrated out in the node, the corresponding metadata service is deployed on the newly added metadata node, and the metadata service deployed on the newly added metadata node is related to the metadata partition to be migrated out. The corresponding metadata service configuration is consistent, and the metadata partition to be migrated out is migrated to the newly added metadata node. The method can reduce the complexity of expanding the capacity of the metadata node cluster, and improve the efficiency and effect of expanding the capacity of the metadata node cluster.

Description

technical field [0001] The present application relates to the technical field of data storage, in particular to a method, system, device and storage medium for expanding the capacity of metadata node clusters. Background technique [0002] In cloud storage systems and distributed file systems, storage nodes are physical devices that store user data, metadata nodes are physical devices that store metadata, and metadata nodes are also responsible for managing data and operations of the entire system. Among them, metadata can be understood as data including information such as user data indexes, file names, and access permissions. [0003] With the continuous increase of user data, there are more and more metadata, and the pressure on metadata nodes is gradually increasing. In this case, it is necessary to expand the metadata node cluster formed by all metadata nodes in the system to improve the performance of the entire system. At present, commonly used expansion methods inc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/21H04L67/1004H04L67/1008H04L67/1097H04L9/06G06F16/27
CPCH04L67/1004H04L67/1008H04L9/0643G06F16/214G06F16/27H04L67/1097H04L67/563H04L67/51
Inventor 黄思文江文龙
Owner ZHEJIANG DAHUA TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products