System and method thereof for guaranteeing data effectiveness in parallel network file system

A network file system and data validity technology, which is applied in transmission systems, electronic digital data processing, special data processing applications, etc., can solve the problems of data validity guarantee obstacles, and the inability to accurately determine which file the prefetched data page belongs to, etc. , to improve performance

Active Publication Date: 2015-09-23
INST OF COMPUTING TECH CHINESE ACAD OF SCI +1
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, compared with metadata prefetching, the biggest difficulty in data prefetching is that even with good physical locality, it is impossible to accurately determine which file the p

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method thereof for guaranteeing data effectiveness in parallel network file system
  • System and method thereof for guaranteeing data effectiveness in parallel network file system
  • System and method thereof for guaranteeing data effectiveness in parallel network file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The following describes the present invention in detail with reference to the drawings and specific embodiments, but it is not intended to limit the present invention.

[0042] Such as figure 1 Shown is a schematic diagram of the validity of the version number marked data.

[0043] The version number is a time stamp that can distinguish different read-only directory authorizations of the same client. It can distinguish between authorizations between different directories, and it can also distinguish multiple authorizations of the same directory. When the metadata server grants the client directory authorization, it also marks the authorization version number. When the client catalog authorization is recalled, the version number becomes invalid at the same time. After obtaining authorization next time, get a new version number.

[0044] The version number can identify invalid data in the client cache. During the holding period of the read-only directory authorization, when ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a system and a method thereof for guaranteeing data effectiveness in a parallel network file system. The system comprises a client side and a metadata server, wherein the client side is used for sending a read-only directory authorization application, receiving endowed read-only directory authorization, marking a version number of a read-only directory and accessing a file under the read-only directory and a data page of the file; the metadata server is used for receiving the read-only directory authorization application sent from the client side and endowing the read-only directory authorization to the client side; and the client side returns the read-only directory authorization to the metadata server after access is finished, and clears the version number of the read-only directory.

Description

Technical field [0001] The invention relates to a cache validity mechanism after pre-reading data between files in a parallel network file system, and particularly relates to a system and method for ensuring data validity in a parallel network file system. Background technique [0002] With the advent of the big data era, the amount of global data information has grown rapidly. There are more and more small-sized files in the fields of e-commerce, social networking, and scientific computing. According to statistics from the Pacific Northwest National Laboratory in 2007, of the more than 12 million files stored internally, more than 80% of the files are smaller than 1MB, and more than 50% of the files are smaller than 32KB. In a sense, there is currently no purely large file application. Mankind has gradually entered into the "age of massive and small files". [0003] Parallel Network File System (pNFS) adopts a separate structure of metadata and data services. The client directl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30H04L29/08
CPCG06F16/182H04L67/568
Inventor 杨洪章张建刚张军伟刘健
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap