File data edge caching method in cross-domain virtual data space

An edge cache and virtual data technology, applied in the computer field, can solve problems such as restricting the operation of upper-layer computing applications, reducing application performance, and slowing network IO systems.

Active Publication Date: 2020-10-16
BEIHANG UNIV
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The slow network bandwidth of the WAN greatly limits the operation of the upper-layer computing application, and the upper-layer computing application waits for a long time for the slow network IO, which greatly reduces the performance of the application
Slow network IO is still the bottleneck of the system when accessing cross-domain file data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • File data edge caching method in cross-domain virtual data space
  • File data edge caching method in cross-domain virtual data space
  • File data edge caching method in cross-domain virtual data space

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0070] Such as figure 1 Shown is the implementation flowchart of the present invention. A method for edge caching of file data in a cross-domain virtual data space, comprising the following steps:

[0071] 1) The client caches user-related global metadata information and memory, including user information, user area information, area authority information, space information, space name, space location, space authority information, etc.; adopts timeout update and timing asynchronous update strategies ;

[0072] 2) Add an edge cache management module to the management node, which can be called an edge cache management node from the perspective of caching, and is used to cache file metadata information and small file data information in the cache space and data index of sparse file cache in the edge cache node.

[0073] 3) Set up an edge cache node to cache l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a file data edge caching method in a cross-domain virtual data space, and provides an edge caching mechanism for the file data in allusion to the requirement of efficient accessof remote data in the cross-domain virtual data space and the IO bottleneck problem brought to an upper-layer application by a wide-area environment. The method comprises the following steps: cachingremote data in a place close to a client, establishing an edge cache to improve the overall performance of accessing the remote data by an upper application, and further reducing data redundancy through cache sharing; the edge cache establishes a memory-based file cache for the small file, and establishes a sparse file-based file system cache for the large file; the consistency of data in the virtual data space is improved by adopting a caching strategy of a central read-write mark based on file extension attributes; and through a cache replacement strategy based on the file popularity, the cache performance and efficiency are ensured.

Description

Technical field: [0001] The invention discloses a file data edge caching method in a cross-domain virtual data space, relates to challenges faced by wide-area high-performance computing, and belongs to the technical field of computers. Background technique: [0002] In the current national high-performance computing environment, storage resources are widely dispersed and isolated and autonomous. Large-scale computing applications urgently need a global virtual data space that can support cross-domain unified access. Aggregating wide-area decentralized autonomous storage resources forms a cross-domain virtual data space to realize storage resources. Global unified management and efficient access. At present, the construction of the virtual data space model has been completed, and the basic software system of the virtual data space has been designed and implemented. At present, it has been deployed and tested at five sites including the Network Center of the Chinese Academy o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/172G06F16/174G06F16/188
CPCG06F16/172G06F16/1744G06F16/188
Inventor 肖利民徐耀文秦广军霍志胜宋尧周汉杰王超波
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap