Distributed file system based IO (input output) request dispatching method and system

A distributed file and IO request technology, applied in multi-program devices, instruments, program startup/switching, etc., can solve the problems of not considering the client process and difficult to reduce the average waiting time, etc.

Active Publication Date: 2013-09-11
HUAZHONG UNIV OF SCI & TECH
View PDF2 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Generally speaking, the request scheduling layer in the traditional distributed file system adopts a simple strategy, such as FCFS. Existing research has proposed some new scheduling methods, such as SJF, WSJF, MLF, etc., but these The schedulin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed file system based IO (input output) request dispatching method and system
  • Distributed file system based IO (input output) request dispatching method and system
  • Distributed file system based IO (input output) request dispatching method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0071]In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0072] Such as figure 1 As shown, the IO request scheduling method based on the distributed file system of the present invention comprises the following steps:

[0073] (1) Initialize the server's global process table and multi-level process request queue and its parameters, including the following sub-steps:

[0074] (1-1) Initialize the global process table to be empty, as shown in Table 1 b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed file system based IO (input output) request dispatching method. The distributed file system based IO request dispatching method includes receiving an IO request from a client; updating an overall situation process table according to the IO request; adding the IO request to the end of a request line of an overall situation object which the IO request belongs to; judging whether length of the continuous IO request of the overall situation object is smaller than REQ_MAX (L) or notand the L is smaller than maximum series of the multi-grade request line , if yes, deleting the overall situation object from the Lth line, and inserting the same to the end of the Lth+1 line; continuously monitoring the IO request from the client, repeating the above steps to generate a dynamic multi-grade progress request line; extracting all the IO requests of a first progress object in the multi-grade progress request line which is not null currently, and executing and updating status messages and parameters of the progress object. By the method, overall response time of a client request can be greatly reduced when system load is bigger, and performance of the system can be improved.

Description

technical field [0001] The invention belongs to the technical field of computer storage, and more particularly relates to a distributed file system-based IO request scheduling method and system. Background technique [0002] With the development of distributed computer clusters, large-scale data-intensive high-performance computing relies on distributed parallel file systems, such as Lustre, GPFS, PVFS, pNFS, etc. However, with the development of hardware, the mismatch between CPU speed and IO device speed has become more and more prominent. IO bottlenecks have become an important factor limiting the high performance of computer clusters. For applications with intensive data I / O requirements This bottleneck is more prominent. [0003] Parallel I / O refers to the parallel I / O access of multiple computer nodes to shared files or files on different disks at the same time. It mainly uses a set of storage devices to store massive data and provides corresponding parallel I / O inter...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48G06F17/30
Inventor 谭支鹏杜立冯丹崔捷周炜王芳
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap