Edge caching method for file data in cross-domain virtual data space

An edge cache and virtual data technology, applied in the computer field, can solve problems such as slow network IO system, restricting the operation of upper-layer computing applications, and reducing application performance.

Active Publication Date: 2022-07-26
BEIHANG UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The slow network bandwidth of the WAN greatly limits the operation of the upper-layer computing application, and the upper-layer computing application waits for a long time for the slow network IO, which greatly reduces the performance of the application
Slow network IO is still the bottleneck of the system when accessing cross-domain file data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Edge caching method for file data in cross-domain virtual data space
  • Edge caching method for file data in cross-domain virtual data space
  • Edge caching method for file data in cross-domain virtual data space

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The present invention will be described in further detail below in conjunction with the accompanying drawings.

[0070] like figure 1 Shown is a flow chart of the implementation of the present invention. A method for edge caching of file data in cross-domain virtual data space, including the following steps:

[0071] 1) The client caches user-related global metadata information and memory, including user information, user area information, area authority information, space information, space name, space location and space authority information; using timeout update and timing asynchronous update strategy;

[0072] 2) Add an edge cache management module to the management node, which can be called an edge cache management node from the cache point of view, and is used for file metadata information and small file data information in the cache space and data index of sparse file cache in the edge cache node.

[0073] 3) Set up edge cache nodes to cache large files in the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for edge caching of file data in a cross-domain virtual data space. Aiming at the requirement of efficient access to remote data in the cross-domain virtual data space and the IO bottleneck problem brought by the wide-area environment to upper-layer applications, the edge cache of file data is proposed. caching mechanism. Cache remote data close to the client and establish an edge cache to improve the overall performance of upper-layer applications accessing remote data, and further reduce data redundancy through cache sharing; edge cache establishes a memory-based file cache for small files, and for large files The file establishes a file system cache based on sparse files; the cache strategy based on the central read-write flag of file extension attributes is adopted to improve the consistency of data in the virtual data space; the cache replacement strategy based on file popularity ensures the performance and efficiency of the cache .

Description

Technical field: [0001] The invention discloses a file data edge caching method in a cross-domain virtual data space, relates to the challenges faced by wide-area high-performance computing, and belongs to the technical field of computers. Background technique: [0002] In the current national high-performance computing environment, storage resources are widely dispersed and isolated and autonomous. Large-scale computing applications urgently need a global virtual data space that can support unified access across domains. Aggregate wide-area decentralized autonomous storage resources to form cross-domain virtual data spaces and realize storage resources. Global unified management and efficient access. At present, the construction of the virtual data space model has been completed, and the basic software system of the virtual data space has been designed and implemented. At present, deployment tests have been carried out at five points including the Chinese Academy of Scienc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/172G06F16/174G06F16/188
CPCG06F16/172G06F16/1744G06F16/188
Inventor 肖利民徐耀文秦广军霍志胜宋尧周汉杰王超波
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products