Method for expanding parallel file system by free hard disk space of cluster computing node

A file system and computing node technology, applied in the computer field, can solve the problems of not being equipped with a special parallel file system, the efficiency of the file system is reduced, etc., and achieve the effect of solving concurrency and bandwidth problems, rationally utilizing, and improving storage space

Inactive Publication Date: 2013-05-01
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF3 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] For small and medium-sized clusters, especially small clusters, there is generally no dedicated parallel file system. Cluster computing node sharing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for expanding parallel file system by free hard disk space of cluster computing node

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0018] The method of the present invention will be described in further detail below in conjunction with the accompanying drawings.

[0019] The Earth Observation Center of the Chinese Academy of Sciences in Beijing purchased a small cluster, a management node and 10 computing nodes, and the hard disk capacity of the computing nodes is 500G.

[0020] Luster file system implementation method:

[0021] 1. Creation of mds server

[0022] Divide a 30G partition on the management node and format it as mdt and mgs partitions;

[0023] 2. Creation of ost server

[0024] A total of 10 computing nodes, each node has 500G of disk space, take out 50G to install the operating system, and the remaining 450G space is used as the ost space of lustre;

[0025] Format the free partitions of 10 computing nodes as ost1—ost10 in sequence

[0026] So far, the luster file system has been built, consisting of 10 ost partitions with a capacity of 450G, and the file system has a total capacity of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for expanding a parallel file system by the free hard disk space of a cluster computing node. According to the method, the goal of expanding the parallel file operation by the free hard disk space of the cluster computing node is realized through a Lustre file system, a Lustre object storage file system consists of three main parts including a client, an OST (object storage target) and an MDS (metadata server), the Lustre client operates the Lustre file system, carries out file data I/O (input/output) interaction with the OST and carries out namespace operation interaction with the MDS, i.e. the free disk space of the computing node is used as the OST of the Lustre file system and is integrated into a large file system, and then, the client of the computing node mounts the file system for use. The method for expanding the parallel file system by the free hard disk space of the cluster computing node has the advantages that the IO concurrency and bandwidth problems of the file system can be solved, in addition, the storage space of the whole cluster system can be improved, and the cluster resource is reasonably utilized.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method for expanding a parallel file system by utilizing the idle hard disk space of cluster computing nodes. Background technique [0002] For small and medium-sized clusters, especially small clusters, there is generally no dedicated parallel file system. Cluster computing node sharing is generally implemented through nfs. After submitting too many jobs with high IO requirements, the efficiency of the file system will be seriously reduced. Contents of the invention [0003] The technical task of the present invention is to solve the deficiencies of the prior art, and provide a method for expanding the parallel file system by utilizing the idle hard disk space of cluster computing nodes. [0004] The technical scheme of the present invention is realized in the following manner. The parallel file operation is realized by using the idle hard disk space of cluster computing n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 孙玉超陈良华郑辉
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap