Intelligent pre-reading implementation method for distributed file system

A technology for distributed files and implementation methods, applied in the field of intelligent pre-reading implementation of distributed file systems, can solve the problems of many times of direct interaction between clients and metadata services, improve file operation performance, improve metadata caching, The effect of reducing the number of interactions

Inactive Publication Date: 2017-05-17
ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
View PDF4 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are still many direct interactions between the client and the metadata service, and there is still room for improvement in file operation performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent pre-reading implementation method for distributed file system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] When the client sends a file system operation request to browse the directory, the specific steps are as follows:

[0047] S1. The client sends a catalog browsing request, and client A sends the catalog browsing request to the metadata service;

[0048] S2. The metadata service counts the popularity of metadata and establishes a pre-read cache;

[0049] S3. The metadata service pushes the pre-read metadata to other client B;

[0050] S4. Client B's directory browsing request directly hits the client's local metadata cache;

[0051] S5. The client B misses the client's local metadata cache, and the metadata service reads the metadata from the storage pool storage device to the memory; then responds to the client request according to the client B's request;

[0052] S6. Client B receives the response from the server and returns the client request.

Embodiment 2

[0054] When the client sends a file system operation request to browse the directory, the specific steps are as follows:

[0055] S1. The client sends a catalog browsing request, and client A sends the catalog browsing request to the metadata service;

[0056] S2. The metadata service counts the popularity of metadata and establishes a pre-read cache;

[0057] S3. The metadata service decides whether to push the pre-read metadata to other client B through intelligent prediction;

[0058] S4. Client B's directory browsing request directly hits the client's local metadata cache;

[0059] S5. The client B misses the client's local metadata cache, and the metadata service reads the metadata from the storage pool storage device to the memory; then responds to the client request according to the client B's request;

[0060] S6. Client B receives the response from the server and returns the client request.

[0061] The present invention also includes an intelligent pre-reading dev...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent pre-reading implementation method for a distributed file system, and belongs to the field of distributed file systems. The method specifically comprises the following steps that S1, a customer transmits a file system operating request, and the request is transmitted to a meta-data service through the client; S2, the meta-data service builds a pre-reading meta-data buffer memory according to the heat degree of meta-data of a plurality of clients; S3, the meta-data service intelligent pre-judges other client buffer memories, and pushes the meta-data to all client buffer memories; S4, other customers transmits the same file system operating request, and directly hits the local meta-data buffer memory of the client. According to the invention, the plurality of clients visit a file system at the same time, and the method increases the meta-data buffer memory through the intelligent pushing of meta-data, reduces the number of direct interaction between the clients and the meta-data service, and improves the file operating performance.

Description

technical field [0001] The invention relates to the field of distributed file systems, in particular to a method for realizing intelligent pre-reading of distributed file systems. Background technique [0002] A structure in which metadata and data are separated has become a trend. The metadata server is responsible for maintaining the global namespace of the file system, managing the mapping relationship between the logical location of the file and the physical location of the disk, and allocating physical storage resources for the file. Metadata is recorded in a proprietary metadata storage device. Metadata is the data that the file system manages file attribute information, including file name, creation time, permissions, data storage location and other information. [0003] The metadata management of distributed file systems can be divided into two types: symmetric and asymmetric. Symmetry means that all clients use consistent caching. Every file operation needs to req...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F17/30
CPCG06F16/182H04L67/568H04L67/5681
Inventor 李雪生
Owner ZHENGZHOU YUNHAI INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap