Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Method and system for ensuring consistence of distributed metadata in cluster file system

A cluster file and distributed technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as inability to complete revocation, failure to consider, and high cost of cascading revocation

Active Publication Date: 2013-05-01
INST OF COMPUTING TECH CHINESE ACAD OF SCI +1
View PDF2 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the above problems are not considered in the two-way redundant distributed log method
In addition, in the two-way redundant distributed log method, it is possible that due to the simultaneous downtime of the nodes at both ends, the state of the distributed metadata operation will be undone and restored to a consistent state that has not been executed at all. However, if other metadata servers have subsequent distributed If the type operation depends on the undo distributed metadata operation, it will lead to cascading undo, and all subsequent dependent operations need to be undone. The overhead of cascading undo is high, and there may be cases where undo cannot be completed. Therefore, it is necessary to ensure that multiple There will be no cascading undo between distributed metadata operations to ensure that the system can recover to a consistent state

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for ensuring consistence of distributed metadata in cluster file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0076]In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below through specific embodiments in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0077] The patent application 201210159837.8 with the application date of May 22, 2012 and the publication date of October 24, 2012, entitled "A Method and System for Ensuring Distributed Metadata Consistency of a Cluster File System" announced a cluster file system Distributed Metadata Consistency Guarantee Method (ie Bidirectional Redundant Distributed Log Method), this application is hereby incorporated by reference in its entirety.

[0078] figure 1 A schematic diagram of a local log and a distributed log according to an embodiment of the present invention is given. Local file sys...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method for ensuring the operation consistence of distributed metadata in a cluster file system in combination with a local log. The method comprises the following steps of: making a coordinator and a participant record a distributed metadata sub-operation update generated by using distributed metadata sub-operation in the local log as a local transaction, wherein the record of the distributed metadata sub-operation update includes a distributed transaction and / or a distributed metadata update; after the local transaction is submitted, writing the distributed transaction into a distributed log, and writing the distributed metadata update into a metadata disk; and before starting the distributed metadata sub-operation, forcibly submitting a local log transaction. According to the method, the local log is multiplexed effectively, and the implementation complexity of the distributed log is lowered; and moreover, cascading aborts can be avoided.

Description

technical field [0001] The present invention relates to a distributed metadata operation technology of a cluster file system, in particular to a method for ensuring the consistency of distributed metadata in a cluster file system Background technique [0002] In large-scale cluster file systems, the separation of metadata and data services has become a trend. On the one hand, data access does not need to go through the metadata server, but directly accesses the storage device in an out-of-band manner, so as to obtain high data access performance; on the other hand, the metadata server specifically provides metadata services, offloading the data access load, Therefore, a single metadata server can support higher client access performance, manage more storage devices, and support larger system scale expansion. However, with the continuous expansion of the system scale, a single metadata server has gradually become the bottleneck restricting the expansion of the system. In or...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 郑彩平邵冰清张军伟刘振军王利虎张浩
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products