Distributed network file storage system and method based on remote calling

A network file system and distributed network technology, applied in the field of distributed network file storage systems, can solve the problems of difficulty in improving file system functions, insufficient file service stability, and high storage coupling, and achieve convenient data sharing and high scalability. The effect of reducing the difficulty of maintenance and performance

Pending Publication Date: 2020-11-13
EAST CHINA INST OF COMPUTING TECH
View PDF1 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the file system of ceph distributed storage and its object storage are highly coupled, and it is very difficult to improve the file system function. At the same time, the file service provided by itself in the production environment is not stable enough, and there will be problems that files cannot be queried.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed network file storage system and method based on remote calling
  • Distributed network file storage system and method based on remote calling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] The present invention employs the following technical solution, implemented by calling efficient network framework for efficient remote data transfer, file read and write functions in the file system; unified file operation via standard file access interface module, including increased file, delete, update reading and the like; highly reliable storage of the data stored in the distributed data support files.

[0057] like figure 1 , The entire network file system consists of a file system client, file system server, the file system monitoring module, file system data distributed storage module and a visualization system maintenance control module, providing efficient and to the external network file unified access interface.

[0058] 1. File System Client

[0059] File system client based fuse to build a unified access interface file system, the file system framework fuse is implemented in user space, the virtual file system via docking system fuse kernel module. Based Inte...

Embodiment 2

[0084] Example 2 Example 1 can be considered to constitute preferred embodiment is. Example 2 illustrates a method of distributed file storage network-based remote call, using the distributed network-based file storage system to a remote call of Example 1 described embodiment.

[0085] Distributed network file remote method invocation based, including:

[0086] Client File Step: After building a unified access interface file, the virtual file system to the operating system kernel file request by sending file operations unified access interface to be the virtual file system in response, receiving the file operation result of the operation request, and the remote operation results call processing for data transmission;

[0087] File server: establishing a long-distance call service gRPC, and listen for client requests a file operation, after receiving the client requests a file operation, file metadata and data manipulation, complete file system data services;

[0088] Step file mon...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed network file storage system and method based on remote calling, and the method comprises the steps: transmitting a file operation request to a virtual file systemthrough a file unified access interface, receiving an operation result of the file operation request, and transmitting the operation result through remote calling; monitoring a file operation requestof a client, realizing file metadata and data operation, and finishing file system data service; achieving log recording of file operation, and monitoring file operation behaviors in a file system; constructing ceph distributed storage, and mounting a file system through a unified storage interface of ceph; providing operation and maintenance management and control functions of the network file system, providing user management, service management, file behavior monitoring and data mounting mode management, so that visual operation and maintenance management and control of file system servicesare achieved. An efficient Protobuf serialization message mode is adopted, the network data load is effectively reduced, and stable file system service is provided under the condition that the network bandwidth is limited.

Description

Technical field [0001] The present invention relates to the field of distributed data big data storage technology, in particular, to a distributed network file-based storage system and method for remote invocation. Background technique [0002] Big Data era, with the growing size of the storage and computing clusters, most of the data traffic system has been constructed in a distributed environment. In the data storage, at present, the data through the file interface operating system is the most common mode of service. [0003] ceph system is a distributed storage system that supports unified storage objects, files and blocks. However ceph distributed file storage system and its object store coupling high, the file system function there is a big difficulty improvement, files in a production environment while providing its own service stability is not enough, the file can not find the problem occurs . E.g. Patent Document CN110491478A, discloses a distributed realization ceph imag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/182G06F16/11G06F9/54
CPCG06F9/547G06F16/11G06F16/182
Inventor 佘平张慧萍罗琳徐鑫朋王晓虹
Owner EAST CHINA INST OF COMPUTING TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap