Supercharge Your Innovation With Domain-Expert AI Agents!

Wide area network data prefetching method based on flow fairness

A data prefetching, wide area network technology, applied in the computer field, can solve problems such as difficulty in guaranteeing and performance differences

Active Publication Date: 2020-10-23
BEIHANG UNIV
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a WAN data prefetching method based on traffic fairness. The direct reading method adopted by the cl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Wide area network data prefetching method based on flow fairness
  • Wide area network data prefetching method based on flow fairness
  • Wide area network data prefetching method based on flow fairness

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The following combined with the attached drawings ( Figure 1-Figure 4 ) The present invention will be described in further detail.

[0047] Such as figure 1 Shown is the flow chart of the implementation of the present invention. The WAN data prefetching method based on traffic fairness includes the following steps:

[0048] 1) The client starts the pre-reading operation.

[0049] 2) Read the extended attributes of the file that needs to be prefetched. If the extended attributes of the file exist, the r, p, and l tags of the file will be obtained. If the file does not exist, the three tags of the file are directly generated, and r, p, and l are given a unified initial value (the same for all files).

[0050] 3) The client will access the server to obtain the IOPS value of the corresponding file on the server to reinitialize the l tag of the file, l=the IOPS value of the server *1.5;

[0051] 4) According to (t is the current time) Calculate the R, P, L labels of the request,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a wide area network data prefetching method based on flow fairness. An improved mclock algorithm is used, three different labels are used for ensuring the condition that each file has the minimum IOPS (Input/Output Operations Per Second, namely the read-write speed per second); the current IOPS is distributed in proportion, so that a remote pre-fetching mechanism based on flow fairness is realized; the pre-reading size of the file and the processing sequence of requests in a flow fairness mechanism are adjusted according to the hit rate of the application to the file pre-reading cache. The IOPS of each file is analyzed offline at a server side by utilizing historical access records, and an initial value of a flow fairness mechanism is initialized.

Description

Technical field [0001] The invention discloses a wide area network data prefetching method based on flow fairness, relates to the challenges faced by wide area high-performance computing, and belongs to the field of computer technology. Background technique [0002] In a wide-area high-performance computing environment, when accessing remote file data, it is necessary to send a data request to the remote server through the client and access it. The use of pre-reading mechanism to obtain data in advance is a common method to improve the data accessibility of files. The main idea is to obtain partial data in advance based on the principle of data locality, and when nearby data is accessed, it can reduce The number of network requests to improve performance. In this method, a traffic fairness mechanism and monitoring of access patterns will be added to adjust the prefetch size and order to optimize performance. [0003] In terms of traffic fairness, there are currently many QOS (Qua...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04L29/08G06F16/13G06F16/18
CPCG06F16/13G06F16/1815H04L67/568H04L67/5681
Inventor 肖利民王超波秦广军霍志胜宋尧周汉杰徐耀文常佳辉
Owner BEIHANG UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More