Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Distributed nfs system and its construction method based on librados

A distributed and file system technology, applied in the direction of file system, file system management, file/folder operation, etc., can solve the problem of not fully utilizing hardware resources, not being able to effectively separate cold data from hot data, and having no hot or cold data Pool mechanism and other issues to achieve the effect of improving hot data access speed, ensuring reliability, and fast file speed

Active Publication Date: 2021-07-27
武汉华讯国蓉科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In addition, the existing librados-based file system does not have a hot and cold pool mechanism, and cannot effectively separate cold data and hot data to different physical media, failing to fully utilize hardware resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed nfs system and its construction method based on librados
  • Distributed nfs system and its construction method based on librados
  • Distributed nfs system and its construction method based on librados

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings.

[0041] refer to Figure 5 , according to an embodiment of the present invention, a file system architecture based on librados is provided. In the original overall architecture, NFS stand-alone service, libcephfs, and MDS service are combined into a whole distributed NFS service, which is directly provided to customers The client provides services, directly connects to the RADOS object storage cluster internally, and adds a statistical database to permanently store statistical information on hot data that requires data migration. The overall NFS distributed service system can effectively reduce IO delay. At the same time, by establishing a hash table metadata management structure, the metadata access speed is improved.

[0042] refer to Figure 6 , the distributed NFS data service is mainly divided into the following parts:

[0043] portmap...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention proposes a distributed NFS system based on librados and a construction method thereof. The system includes a client, an NFS server, a RADOS object storage cluster, and a migration statistical information database. The NFS server is integrated with NFS service functions, The file system interface function and metadata management function are connected with the RADOS object storage cluster and the migration statistics database to provide services to the client. The system can reduce NFS read and write IO paths, reduce read and write delays, improve read and write performance, and provide better support for scenarios where a large number of small files are created with high concurrency, and the metadata on each NFS service node can be kept consistent. The system supports multi-instance distributed NFS services, and access requests are load-balanced to each service node to improve access performance. The system also supports the hot and cold pool mechanism, which regularly migrates hot and cold data according to the access situation, and always stores the data with the highest access frequency in the hot pool, effectively improving the access speed of hot data.

Description

technical field [0001] The invention relates to a distributed file system, in particular to a distributed NFS file system and a construction method thereof. Background technique [0002] Network File System (Network File System, NFS) is one of the file systems supported by FreeBSD, which allows computers in the network to share resources through the TCP / IP network. In NFS applications, local NFS client applications can transparently read and write files located on remote NFS servers, just like accessing local files. refer to figure 1 and figure 2 , when a shared directory / home / public is set on the NFS server, other NFS clients that have access to the NFS server can mount this directory to a mount point of their own file system. This mount point can Define yourself, such as figure 1 The directories mounted by client A and client B are different. And after mounting, the client can see all the data of the server / home / public locally. If the client is configured as read-...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/11G06F16/16G06F16/182
Inventor 袁东陈小锁陶毅昊冯骏
Owner 武汉华讯国蓉科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products