Unlock instant, AI-driven research and patent intelligence for your innovation.

Metadata management method and device

A management method and management device technology, applied in the direction of electronic digital data processing, special data processing applications, other database retrieval based on metadata, etc., can solve the problems of cluster I/O business blocking, long data replication time, etc., to achieve Avoid the effects of data migration

Inactive Publication Date: 2017-04-26
HUAWEI TECH CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The more nodes the cluster maintains, the greater the amount of data in the metadata collection, and the longer the time for data replication; however, there is a strict limit on the switching time of the master-standby switch in the cluster, and once it times out, the cluster will fail. / O service is blocked and other serious consequences

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Metadata management method and device
  • Metadata management method and device
  • Metadata management method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0069] image 3 It is a schematic flow diagram of an embodiment of the metadata management method of the present invention. This method can be executed by a certain node in the cluster. The method of this embodiment is a brief description. For the specific principle, please refer to the composition of the metadata heap in the node as described above. Way. Such as image 3 As shown, the method may include:

[0070] 301. Store metadata as a metadata pile, where the metadata includes the metadata collection currently running on its own node and the metadata collection currently running on all nodes in the cluster except itself;

[0071] Wherein, the metadata heap includes at least two basic shapes, and each basic shape is a binary tree shape composed of a vertex, a first leaf node and a second leaf node.

[0072] The storing metadata as a metadata heap includes:

[0073] Store the metadata set currently running by itself in the current basic shape located at the top layer of ...

Embodiment 2

[0081] Figure 4 It is a schematic diagram of the principle of another embodiment of the metadata management method of the present invention. This embodiment illustrates how each node in the cluster maintains data consistency, that is, the synchronization of configuration data on each node.

[0082] Such as Figure 4 As shown, the cluster includes four nodes, namely node 1, node 2, node 3, and node 4; and correspondingly shows the shape of the metadata heap inside each node, and the top level of each metadata heap is the local A collection of metadata that the node is currently running on. It should be noted that, see Figure 4 , for example, two layers of degraded data 1' and 1" of node 1 are stored in the metadata heap of node 1, while only one layer of degraded data 1' of node 1 is stored in the metadata heap of node 3, and in node 2 The degenerate data for node 1 is not stored in the metadata heap; this is because Figure 4 Merely for example, as already explained abov...

Embodiment 3

[0093] Figure 5 It is a schematic diagram of the principle of another embodiment of the metadata management method of the present invention. This embodiment illustrates how the metadata heap implements cluster splitting.

[0094] Such as Figure 5 As shown, the cluster including four nodes is still taken as an example. The cluster includes node 1, node 2, node 3, and node 4. The cluster is to be split into two two-node clusters, including a new cluster composed of node 1 and node 2. , and a new cluster consisting of nodes 3 and 4. After the cluster is split, because the nodes in the new cluster change, the metadata heap inside each node in the new cluster must also be changed; for example, in the new cluster composed of node 1 and node 2, the new cluster does not include node 3 and node 4, in the metadata pile inside node 1, the current basic shape corresponding to node 3 should not be connected with the current basic shape corresponding to node 2, because the two current b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a metadata management method and device, wherein the method includes: storing its own currently running metadata set in the current basic shape at the top level, and the first leaf node of the current basic shape is used to connect and store the currently running metadata set of another node. Another current basic shape of the metadata set; the second leaf node of the current basic shape is used to connect the degenerated basic shape of the metadata set run by the node corresponding to the current basic shape at the first point in time. Earlier than the current time; the metadata is managed according to the metadata heap. The invention realizes the rapid execution of active and standby switching in the cluster.

Description

technical field [0001] The invention relates to storage technology, in particular to a metadata management method and device. Background technique [0002] Metadata is the description information of the managed resources of the current device or system, which plays an important role in the self-maintenance and management of the device itself. The functional calculations involved in the operation of the device, such as I / O access, resource allocation, etc., require metadata Add, delete, modify and other operations. In a cluster system with a distributed structure, metadata is often scattered in each node of the cluster. Moreover, the cluster usually includes a master node and a standby node. The master node maintains a complete set of metadata including the metadata of all nodes in the cluster, while the standby node only maintains a subset of metadata that it may use (the subset is Compared with the full set maintained by the master node), the subset maintained by the stan...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L1/22G06F17/30
CPCG06F16/907G06F16/906
Inventor 李熠斌
Owner HUAWEI TECH CO LTD