Remote file data access performance optimization method based on efficient caching of client

Abstract

The invention provides a remote file data access performance optimization method based on the efficient caching of a client. The method comprises the steps of caching the global metadata and the filedata on the client based on a locality principle; caching the file data by adopting a mixed caching strategy based on the data block and the file as granularity; performing adaptive compression on thecache according to the use state of the computing resource; locally generating a copy file for the frequently accessed data; dynamically adjusting the size of the cache based on the IO load characteristics of the application; carrying out the fine-grained updating on the overdue cache data; and mining an associated file based on the access characteristics of the user and the load characteristicsof the application, and aggregating the index nodes of the associated file into a large index node and caching the large index node at the client. According to the method, the remote file data accessperformance can be remarkably improved.

Description

[0001] Technical field: [0002] The invention discloses a remote file data access performance optimization method based on high-efficiency caching of a client, relates to challenges faced by wide-area high-performance computing, and belongs to the field of computer technology. [0003] Background technique: [0004] In a wide-area high-performance computing environment, when accessing remote file data, it is necessary to send a data request to the remote server through the client and access it. Client-side caching is a common method for improving IO performance in remote file data access. The main idea is to cache recently accessed data on the client based on the principle of data locality. When the cached data is accessed again, it can avoid network transmission and thereby Improve access performance. Most of the research mainly optimizes cache performance from two aspects: cache data organization structure and cache data management. [0005] In terms of the organization st...

AI Technical Summary

Problems solved by technology

[0008] The client uses a data block-based structure to organize and manage the cache, which is difficult to cope with the increasingly intensive IO load from the application. Different data blocks of small files in the LRU queue are isolated from data blocks of other files. Compression and deduplication are used in the cache. space utilization in such a way that applications and caching systems compete for computing resources

Images