Performance optimization method for remote file data access based on client-side high-efficiency cache

Abstract

The present invention proposes a remote file data access performance optimization method based on high-efficiency caching on the client side. The global metadata and file data are cached on the client side based on the principle of locality; the file is cached using a hybrid caching strategy based on data blocks and files. Data is cached; the cache is adaptively compressed according to the usage status of computing resources; a copy file is generated locally for frequently accessed data; the size of the cache is dynamically adjusted based on the IO load characteristics of the application; the expired cache data is fine-grained Update; based on the user's access characteristics and application load characteristics, the associated files are mined, and the index nodes of the associated files are aggregated into a large index node and cached on the client. This method can significantly improve the performance of remote file data access.

Description

Technical field: [0001] The invention discloses a remote file data access performance optimization method based on high-efficiency caching of a client, relates to challenges faced by wide-area high-performance computing, and belongs to the field of computer technology. Background technique: [0002] In a wide-area high-performance computing environment, when accessing remote file data, it is necessary to send a data request to the remote server through the client and access it. Client-side caching is a common method for improving IO performance in remote file data access. The main idea is to cache recently accessed data on the client based on the principle of data locality. When the cached data is accessed again, it can avoid network transmission and thereby Improve access performance. Most of the research mainly optimizes cache performance from two aspects: cache data organization structure and cache data management. [0003] In terms of the organization structure of the ...

AI Technical Summary

Problems solved by technology

[0006] The client uses a data block-based structure to organize and manage the cache, which is difficult to cope with the increasingly intensive IO load from the application. Different data blocks of small files in the LRU queue are isolated from data blocks of other files. Compression and deduplication are used in the cache. space utilization in such a way that applications and caching systems compete for computing resources

Images