Method and device of metadata processing

A processing method and metadata technology, applied in the network technology and computer fields, can solve the problems of low metadata service performance and write conflicts, and achieve the effects of avoiding write conflicts, ensuring consistency, and ensuring performance.

Active Publication Date: 2013-05-08
CHENGDU HUAWEI TECH
View PDF6 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] However, since multiple clients can read or write to each data server, when multiple clients write concurrently, there will be write conflicts
In such a case, a large amount of retry information will be sent between the data server and the client, resulting in low performance of the data server in providing metadata services during concurrent writing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device of metadata processing
  • Method and device of metadata processing
  • Method and device of metadata processing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The distributed system provided by each embodiment of the present invention includes a central cluster, a data cluster, and at least one client.

[0061] Among them, the central cluster is composed of one or more central nodes, and the central node may be a server. The central node is not used to store metadata, but is used to select one client as the master client when there are multiple clients. When there are multiple central nodes, one of the central nodes is the main control central node, and the other central nodes serve as backup central nodes of the main control central node, so that when the main control central node fails, the backup central node can complete the main control node. The work of the control center node. The central node referred to below refers to the master control central node.

[0062] The data cluster is composed of one or more data servers, and each data server stores metadata and / or data of the object.

[0063] The client is a device used for ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device of metadata processing. The metadata processing method includes steps of: a. receiving write requests with object identity, b. generating at least one modify instruction corresponding to the object identity according to the write requests, wherein the modify instruction includes a data identity and a target value corresponding to the data identity, and the data identity is at least one metadata identity needing modifying of the metadata corresponding to the target identity, c. sending the modify instruction to a client terminal and a data server which are corresponding to the data identify, so that the client terminal and the data server respectively modify the metadata corresponding to the data identify into target value according to the modify instrument. Therefore, metadata stored in the client terminal and the data server are updated synchronously, storing uniformity of data in a distributed system is guaranteed, write conflict caused by the fact that multiple client terminals send the write requests at the same time is avoided, and performance of providing metadata service of the distributed system is guaranteed effectively.

Description

Technical field [0001] The embodiments of the present invention relate to network technology and computer technology, and in particular to a metadata processing method and device. Background technique [0002] Distributed systems mainly provide metadata services in two ways: central metadata services and peer-to-peer metadata services. [0003] Centralized metadata services, including metadata clusters and data clusters. Among them, the metadata cluster is composed of multiple metadata servers respectively used to store metadata, and the data cluster is composed of multiple data servers respectively used to store data. In the central metadata service, the metadata cluster usually uses one of the metadata servers as the central node to communicate with the client to provide external services. After the metadata is modified, the central node updates the metadata in other metadata servers in the metadata cluster. [0004] However, when a distributed system adopts a centralized metada...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/06
Inventor 王炎夏得雨
Owner CHENGDU HUAWEI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products