Method for synchronously caching by multiple clients in distributed file system

A distributed file, multi-client technology, applied in the field of client cache synchronization, can solve the problems of complex distributed lock design, high cost and low efficiency.

Active Publication Date: 2012-07-04
WUXI CITY CLOUD COMPUTING CENT
View PDF2 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The design of distributed locks is relatively complicated, the cost of development is relatively high, and in actual use, its efficiency is relatively low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The present invention selects the metadata server as the control point, and divides the client cache into two types: read-only cache and writeable cache. For a read-only cache, the client can only read but not modify; for a writable cache, the client can both read and modify. When a client needs to cache metadata or data, it needs to apply for permission on the corresponding metadata server, and the metadata server will make corresponding records. When multiple clients access metadata or data competition, the metadata server is responsible for coordination, so that each client can clean up the cache in time, and obtain fair access to the data or metadata.

[0020] For the modification of metadata information, in addition to the file size information, other information is directly modified by the metadata server, that is, only the read-only cache is kept on the client; for the content and size information of the file, in order to ensure efficiency, the client A writable ca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for synchronously caching by multiple clients in a distributed file system. The method comprises the following steps of: taking a metadata server as a control node, in which a client caches information, and recording a storage state of each client on the metadata server according to a maintained index node on the metadata server; and dividing the metadata information into read only cache and writable cache according to the client cache attribute, wherein for the read only cache for metadata, when the client reads the metadata for the first time, the metadata server authorizes a read only authority or a writable cache authority to the client, and the client always has the authority after finishing operation; and for the writable cache for the metadata, the modification of the client is temporarily stored locally, and when a write-back trigger condition is met, writing-back is performed. According to the method, the cache consistency among different clients is strictly guaranteed; and furthermore, compared with a distributed phase locked method for Lustre and a general parallel file system (GPFS), the method is relatively low in development cost.

Description

Technical field [0001] The present invention relates to the problem of client cache synchronization in a distributed file system, and in particular to a method for multi-client cache synchronization in a distributed file system. Background technique [0002] After entering the information age, with the continuous development of technology, the demand for storage in all walks of life is increasing geometrically, which has caused the conventional local file system to fail to meet business needs. As a result, under the stimulation of application demand, various types of distributed file systems have emerged, such as NFS, Lustre, GPFS, Google FS, etc. [0003] For a distributed file system, because its clients are distributed on different physical machines, the operations of different clients on the file system metadata and data are mutually invisible. Therefore, there is a problem that the modification of the file system by one client is not visible to another client, that is, the pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L29/08
Inventor 杨浩常涛吕明强邵宗有刘新春苗艳超王勇
Owner WUXI CITY CLOUD COMPUTING CENT
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products