Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for guaranteeing distributed metadata consistency for cluster file system

A cluster file, distributed technology, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc.

Inactive Publication Date: 2014-11-05
INST OF COMPUTING TECH CHINESE ACAD OF SCI +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0016] The technical problem to be solved by the present invention is that in the prior art, the distributed metadata operation consistency guarantee across metadata servers requires multiple disk synchronization overheads, and a disk that can effectively reduce the distributed metadata operation consistency guarantee is provided. A method for synchronizing overhead to reduce the latency of distributed metadata operations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for guaranteeing distributed metadata consistency for cluster file system
  • Method and system for guaranteeing distributed metadata consistency for cluster file system
  • Method and system for guaranteeing distributed metadata consistency for cluster file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0101] Specific embodiments of the present invention are given below, and the present invention is described in detail in conjunction with the accompanying drawings.

[0102] Such as figure 2 As shown, the specific steps of the asynchronous two-phase commit method:

[0103] (1) The coordinator first pre-checks the executable of the first sub-operation (Sub-op1Precheck). If the check passes, vote Yes, and the coordinator pre-allocates a number C_LSN (Log Sequence Number) for the distributed metadata operation; if the check fails, it ends directly.

[0104] (2) The coordinator sends a request message to the participant, requesting the participant to perform the second sub-operation (Sub-op2), and the request message contains the coordinator's distributed metadata operation number C_LSN.

[0105] (3) The participant performs the second sub-operation (Sub-op2). If the execution is unsuccessful, it will return the undo "Abort" message, and end directly; if the execution is succ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a system for guaranteeing distributed metadata consistency for a cluster file system. The method includes that: step one, a coordinator examines the performability of a first sub-operation in advance and sends request information to a participant, the participant executes a second sub-operation and feeds the executed information back to the coordinator after execution, and the coordinator and the participant write Commit marks in a log file; and step two, the consistency of the cluster file system is restored according to recording and combination of Commit logs of the log file of the coordinator and the participant.

Description

technical field [0001] The invention relates to a distributed metadata operation technology of a cluster file system, in particular to a method and system for ensuring the consistency of the distributed metadata of a cluster file system. Background technique [0002] In large-scale cluster file systems, the separation of metadata and data services has become a trend. On the one hand, data access does not need to go through the metadata server, but directly accesses the storage device in an out-of-band manner, so as to obtain high data access performance; on the other hand, the metadata server specifically provides metadata services, offloading the data access load, Therefore, a single metadata server can support higher client access performance, manage more storage devices, and support larger system scale expansion. However, with the continuous expansion of the system scale, a single metadata server has gradually become the bottleneck restricting the expansion of the system...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 张军伟郑彩平邵冰清王利虎刘振军刘浏
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products