File reading system and method of distributed file systems

A distributed file and file technology, applied in the field of file reading system, can solve the problem that the storage server cannot play the sequential pre-reading function, and can not play the sequential pre-reading function, so as to achieve the effect of improving the aggregation performance

Inactive Publication Date: 2008-04-09
INST OF COMPUTING TECH CHINESE ACAD OF SCI
View PDF0 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] The purpose of the present invention is to provide a file reading system and method of a distributed file system, which can solve the problem that the sequential pre-reading function cannot be exerted on the storage server side, and especially can solve the problem that multiple client processes can simultaneously read the storage server. When the same target file is on the server side, the method of caching the read-ahead descriptor by target file on the storage server side cannot play the sequential read-ahead function

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File reading system and method of distributed file systems
  • File reading system and method of distributed file systems
  • File reading system and method of distributed file systems

Examples

Experimental program
Comparison scheme
Effect test

example

[0074] A hash function is used to quickly locate cached read-ahead descriptors in a hash table. It is a function of the front-end load triplet to the index value of the hash entry array. An instance function is as follows:

[0075] y=(client_id+process_id+target_ino)%HASH_ENTRY_NUM

[0076] Among them, client_id, process_id and target_id are the three components of the front-end load; HASH_ENTRY_NUM is the number of hash table entries.

[0077] The read request processing module is used to obtain the front-end load information according to the file read request of the client 1, use the front-end load information to search the pre-read descriptor in the cache descriptor table, obtain the address of the pre-read descriptor, and complete the target file read operation.

[0078] In this way, the read-ahead descriptor table module may not cache the target file, but cache the read-ahead descriptor according to each front-end load.

[0079] When multiple client processes (whether...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a file reading system and a method of a distributed file system. The system comprises a memory server end and a plurality of client ends, and the server end comprises a pre-reading descriptor table module and a reading request processing module, wherein the pre-reading descriptor table module is for buffering the pre-reading descriptors for a plurality of front-end loads from the client ends and buffering all the information of the pre-reading descriptors by a table structure; the reading request processing module is for acquiring the information of the front-end loads, searching the pre-reading descriptors in the buffered descriptor table using the information of the front-end loads, acquiring the address of the pre-reading descriptors and accomplishing the reading operation on objective files. The invention can enhance the converging performance of a plurality of the client end processes to read the identical file at the same time.

Description

technical field [0001] The invention relates to the technical field of computer storage, in particular to a file reading system and method of a distributed file system in a cluster structure. Background technique [0002] A cluster is a parallel computer system composed of multiple independent computers (called nodes of the cluster) that are interconnected by a network and can work together. Its nodes and interconnection network usually use off-the-shelf commodities (Commodity Off The Shelf, COTS) rather than custom-made. The openness of this hardware platform reduces the system cost and makes it suitable for commercial software and open source software. All very friendly. Since the cluster has an excellent performance-price ratio compared with the traditional MPP and large SMP, the research, production and application of the cluster have achieved rapid development since the mid-1990s. In the twenty-sixth Top500 list released in mid-November 2005, the proportion of fleet s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L29/06
Inventor 刘岳李剑宇唐荣峰熊劲
Owner INST OF COMPUTING TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap