Method for maintaining data consistency for cluster file system

A cluster file system and consistency technology, which is used in electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as inability to guarantee data consistency, incomplete data, user influence, etc. The effect of guaranteeing no loss and guaranteeing that data is not lost

Active Publication Date: 2012-10-24
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

After the client module (1) writes data, it then forcibly interrupts the connection between the client module (1) and the file system. At this time, because the data is first written into the client cache, it is not written to the back-end disk in time. That is, on the data storage cluster (3), when the connection between the client module (1) and the cluster file system is re-established, the data may be incomplete and the consistency of the data cannot be guaranteed, which will affect users

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for maintaining data consistency for cluster file system
  • Method for maintaining data consistency for cluster file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The method of the present invention is described in detail below with reference to the accompanying drawings.

[0018] The system includes: client module (1); metadata cluster (2); data storage cluster (3); log management module (4), in which:

[0019] The client module (1) is the entrance to access the file system and is responsible for the user's data request;

[0020] The metadata cluster (2) is responsible for storing the metadata part of user data;

[0021] The data storage cluster (3) provides a data storage unit responsible for storing data, including data after removing metadata;

[0022] The log management module (4) is used to detect the status of the client; to ensure that the written data will not be lost after the client is forcibly disconnected, and to ensure that the data written by the client is not lost after the client is disconnected from the file system , to ensure that data can be successfully written to the back-end storage to maintain data consi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for maintaining data consistency for a cluster file system. The method is characterized in that a log management module (4) is arranged on a client, on one hand, the log management module can detect the linking status of a client module (1) and the cluster file system, on the other hand, the log management module can guarantee that data are firstly cached through the log management module (4) and then written in the cluster file system when a user writes data, therefore even if the client module (1) disconnects linking with the cluster file system forcedly, data can be guaranteed to be written in a back-end disk through the log management module (4), data are prevented from loss, and data consistency is maintained.

Description

technical field [0001] The present invention is a method applicable to distributed and parallel file systems, capable of maximally ensuring that data is not lost and maintaining data consistency, specifically a method for cluster file system data consistency. Background technique [0002] The current status of some distributed cluster file systems is that the metadata cluster (2) and the data storage cluster (3) are associated through the distributed file system, and then the client accesses the cluster by mounting or patching the client kernel File system, there may be a problem in the client module (1) at this time, especially when writing small files, the problem is particularly prominent. After the client module (1) writes data, it then forcibly interrupts the connection between the client module (1) and the file system. At this time, because the data is first written into the client cache, it is not written to the back-end disk in time. That is, on the data storage clu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 胡振
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products