Data processing method for distributed file system and distributed file system

A distributed file and file data technology, applied in the direction of electronic digital data processing, special data processing applications, generation of response errors, etc., can solve the problems of reducing the performance of writing and modifying, reducing the guarantee of file system consistency, etc., to achieve Avoid inconsistency, reduce latency and performance loss, and achieve high consistency

Active Publication Date: 2016-05-18
ZTE CORP
View PDF8 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, in most distributed file systems, some focus on throughput performance, but reduce the guarantee of file system consistency
The other part greatly reduces the performance of writing and modification while ensuring the consistency of synchronization.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method for distributed file system and distributed file system
  • Data processing method for distributed file system and distributed file system
  • Data processing method for distributed file system and distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The solution of the embodiment of the present invention is mainly: Fac obtains file data, pushes to Fas; Fas records the file data that Fac pushes over, records the modification of the corresponding metadata on this Fas in the buffer zone, writes log file, and Return the file data push completion message to the Fac; Fac sends a metadata modification change request to Flr after receiving the file data push completion message returned by the Fas; Flr modifies the corresponding metadata according to the metadata modification change request , and recorded in the log file system; when the abnormal restart of the Fas is detected, Flr performs a rollback operation of correspondingly modified data according to the log records, completes the repair of the log file system, and ensures the recovery of files after the distributed file system is reset and restarted. Ultimately high consistency, avoiding data inconsistency between multiple copies caused by machine downtime and restart...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a data processing method for a distributed file system and the distributed file system. The method comprises the steps as follows: an Fac obtains file data and pushes the file data to an Fas; the Fas records pushed file data, records modification of metadata corresponding to the Fas in a buffer zone, writes the modification into a log file, and returns a file data push completion message to the Fac; the Fac transmits a metadata modification change request to an Flr; the Flr modifies the corresponding metadata according to the metadata modification change request and records the metadata into a log file system; and the Flr carries out rollback operation of corresponding modified data according to a log record when monitoring abnormal restart of the Fas. According to the data processing method and the distributed file system, final high consistency of the file after the distributed file system is reset and restarted is ensured; the data inconsistency among multiple replicas caused by downtime and restart of a machine is avoided; and corresponding delay and performance loss caused by addition of a log system are reduced to the maximal extent.

Description

technical field [0001] The invention relates to the technical field of distributed file storage, in particular to a data processing method of a distributed file system and a distributed file system. Background technique [0002] With the rapid development of the multimedia industry, due to cost, reliability and other considerations, more and more manufacturers choose to deploy self-developed distributed upper-level storage systems in their products, and the distributed file system has also gained rapid development. develop. The distributed file system can provide high throughput rate, which can provide several times the throughput rate of ordinary local file system, and can provide high reliability at the same time. Through multi-copy and redundant copy technology, the reliability of data when a single machine is abnormal is improved, and at the same time For equipment such as magnetic arrays, it has the advantages of low price and universal equipment. [0003] At present,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30G06F11/07
CPCG06F16/00
Inventor 朱鹏林健胡剑华
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap