Deployment method of cluster parallel computing environment

A cluster and environment technology, applied in the field of HPC cluster deployment and implementation, can solve the problems of lower NFS file system read and write performance, network delay, poor script usability, etc., to improve deployment efficiency and stability, enhance stability and Reliability, the effect of reducing implementation costs

Active Publication Date: 2011-08-31
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF6 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this deployment method, network delays, reduced read and write performance of the NFS file system, and poor script usability lead to unstable parallel environments.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deployment method of cluster parallel computing environment
  • Deployment method of cluster parallel computing environment
  • Deployment method of cluster parallel computing environment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] Below in conjunction with accompanying drawing, the present invention will be further introduced

[0020] The network architecture of this method is divided into two parts: storage network and computing network.

[0021] The storage network uses 8GB FC fiber optic switch, adopts FC SAN architecture storage devices, divides different lun (logical unit number) spaces and mounts them to lustre (extensible high-performance file system) file system servers such as ls1, ls2...lsn, etc. superior. A total of n servers from Ls1 to lsn use ls1 as the mds server, other servers as oss (operation support system) servers, and the stored lun partitions as mdt and ost devices respectively to form a lustre distributed file system, which greatly improves the read and write performance of files .

[0022] The computing network uses an Infiniband switch, and is connected to the lustre node (ls1——lsn), management node (m1) and computing node (c1——cn) through an IB cable with the HCA card ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a deployment method of a cluster parallel computing environment, belonging to the field of deployment and implementation of high performance computing (HPC) clusters. The method comprises the following steps of: A, installing a linux system on a management node, and installing an operating system of a computing node and a lustre node through a network; B, mounting storage equipment on the lustre node through an optical fiber storage network, and deploying a lustre parallel file system; C, mounting the lustre parallel file system and a lustre parallel file catalog aimingat a management node and the computing node by using a high-speed network; D, configuring a password-free access environment, and implementing password-free access among the nodes; E, configuring nisand ntp services on the management node, and implementing user sharing and node time synchronization; F, deploying application software to the shared lustre file catalog; and G, configuring a monitoring tool, and monitoring the operating state of a cluster node in real time. By the efficient HPC implementation method, the implementation cost is reduced, and the stability and the reliability of the HPC cluster are enhanced.

Description

technical field [0001] The invention relates to the deployment and implementation of HPC clusters, in particular to a deployment method for cluster parallel computing environments. Background technique [0002] High-performance computing (HPC) usually uses many processors. In a high-speed Internet, parallel computing environments such as MPI are used to run parallel computing software to accelerate the efficiency of scientific operations. With the popularity of HPC in universities and research institutes, efficient and stable parallel environment deployment and implementation methods are a link that cannot be ignored for HPC project implementation and performance assurance. [0003] For the deployment of HPC cluster management nodes and multiple computing nodes, the traditional deployment method basically adopts network shared directories based on Ethernet and NFS, and uses custom shell scripts for gradual deployment. In this deployment method, network delays, NFS file syst...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/46G06F17/30H04L29/08
Inventor 陈良华郑辉陈彬
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap