Method and system for synchronizing data caching of distributed parallel file system

A file system and cache data technology, applied in transmission systems, electrical digital data processing, special data processing applications, etc., can solve problems such as data cache inconsistency, achieve enhanced data consistency, and achieve the effect of early synchronization

Active Publication Date: 2013-02-13
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF3 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The technical problem to be solved by the present invention is to overcome the defect that the current distributed parallel file sys

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for synchronizing data caching of distributed parallel file system
  • Method and system for synchronizing data caching of distributed parallel file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The implementation of the present invention will be described in detail below with reference to the accompanying drawings and embodiments, so as to fully understand how the present invention applies technical means to solve technical problems and achieve the realization process of technical effects and implement them accordingly. The embodiments of the present application and the combination of the various features in the embodiments without conflict are within the protection scope of the present invention.

[0036] In addition, the steps shown in the flowcharts of the drawings may be executed in a computer system such as a set of computer-executable instructions. Also, although a logical sequence is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than here.

[0037] Such as figure 1 As shown, the distributed parallel file system cache data synchronization system of the embodiment of the present application mainly inc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and system for synchronizing data caching of a distributed parallel file system, aiming at overcoming the defect that data caching is consistent as a busy state is continued before a write request is executed in practice. The system is characterized in that a metadata monitoring module, a data storage monitoring module and a client monitoring module respectively monitor metadata access, data storage and a performance load of a client in the distributed parallel file system in real time, so as to generate metadata load evaluation, data storage load evaluation and client load evaluation; a load arbitrating module generates multiple load duration evaluation data in different time dimensions according to the metadata load evaluation, the data storage load evaluation and the client load evaluation as well as a preset load evaluation time window and a load duration fluctuation threshold; and a caching synchronizing module executes caching synchronizing operation of metadata, data storage and the client according to the load duration evaluation data. The embodiment of the invention enhances data consistency of the file system.

Description

Technical field [0001] The invention relates to a distributed parallel file system, in particular to a method and system for realizing cache data synchronization of the distributed parallel file system. Background technique [0002] With the further development of cloud computing technology and cloud storage technology applications, the distributed parallel file system as the core of its application has also been rapidly applied and developed. Distributed parallel file system has the characteristics of dynamic high scalability, large capacity, cluster structure and support for high concurrency. [0003] In order to meet the needs of actual business requests for cloud computing and cloud storage, the distributed parallel file system running on its back end is built on distributed cluster nodes, which mainly include metadata nodes, data storage nodes, and client nodes. Metadata is constructed using high-performance, large-capacity servers or using metadata clusters, data storage is ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08H04L29/06G06F17/30
Inventor 郭鹏
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap