A librados-based distributed NFS system and a construction method thereof

A distributed and file system technology, applied in the direction of file system, file system management, digital data information retrieval, etc., can solve the problem of no hot and cold pool mechanism, failure to fully utilize hardware resources, and inability to effectively separate cold data from hot data Data and other issues, to achieve fast file speed, improve hot data access speed, and ensure reliability

Active Publication Date: 2019-05-21
武汉华讯国蓉科技有限公司
View PDF10 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the existing librados-based file system does not have a hot and cold pool mechanism, and cannot effectively separate cold data and hot data to different physical media, failing to fully utilize hardware resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A librados-based distributed NFS system and a construction method thereof
  • A librados-based distributed NFS system and a construction method thereof
  • A librados-based distributed NFS system and a construction method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings.

[0041] refer to Figure 5 , according to an embodiment of the present invention, a file system architecture based on librados is provided. In the original overall architecture, NFS stand-alone service, libcephfs, and MDS service are combined into a whole distributed NFS service, which is directly provided to customers The client provides services, directly connects to the RADOS object storage cluster internally, and adds a statistical database to permanently store statistical information on hot data that requires data migration. The overall NFS distributed service system can effectively reduce IO delay. At the same time, by establishing a hash table metadata management structure, the metadata access speed is improved.

[0042] refer to Image 6 , the distributed NFS data service is mainly divided into the following parts:

[0043] portmap ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a librados-based distributed NFS system and a construction method of the distributed NFS system. The system comprises a client side, an NFS server, an RADOS object storage cluster and a migration statistical information database, and the NFS server integrates an NFS service function, a file system interface function and a metadata management function, is connected with the RADOS object storage cluster and the migration statistical information database, and provides services for a client. The system can reduce the NFS read-write IO path, reduce the read-write delay, improve the read-write performance, provide better support for the scene of creating a large number of small files in a high concurrency manner, and keep metadata on each NFS service node consistent. The system supports a multi-instance distributed NFS service, an access request is loaded and balanced to each service node, and the access performance is improved. The system also supports a cold and hotpool mechanism, performs regular migration on cold and hot data according to the access condition, always stores the data with the highest access frequency in the hot pool, and effectively improves the hot data access speed.

Description

technical field [0001] The invention relates to a distributed file system, in particular to a distributed NFS file system and a construction method thereof. Background technique [0002] Network File System (Network File System, NFS) is one of the file systems supported by FreeBSD, which allows computers in the network to share resources through the TCP / IP network. In NFS applications, local NFS client applications can transparently read and write files located on remote NFS servers, just like accessing local files. refer to figure 1 with figure 2 , when a shared directory / home / public is set on the NFS server, other NFS clients that have access to the NFS server can mount this directory to a mount point of their own file system. This mount point can Define yourself, such as figure 1 The directories mounted by client A and client B are different. And after mounting, the client can see all the data of the server / home / public locally. If the client is configured as read...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/11G06F16/16G06F16/182
Inventor 袁东陈小锁陶毅昊冯骏
Owner 武汉华讯国蓉科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap