High-performance cluster management method based on Slurm

A cluster management and high-performance technology, applied in digital transmission systems, electrical components, transmission systems, etc., can solve problems such as complex cluster topology and increased difficulty, and achieve the effect of simplifying complex operations

Inactive Publication Date: 2019-08-27
BEIJING INST OF COMP TECH & APPL
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the complexity of the cluster topology, the highly heterogeneous computing environment, and the diversification of application performance and other non-funct

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-performance cluster management method based on Slurm
  • High-performance cluster management method based on Slurm
  • High-performance cluster management method based on Slurm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] In order to make the purpose, content, and advantages of the present invention clearer, the specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0022] A high-performance cluster management method based on Slurm, including:

[0023] 1. Select multiple computer nodes to build a high-performance cluster system, and the hardware architecture of the nodes is not limited. Install the localized Galaxy Kylin system on all nodes, figure 1 The basic structure diagram of the heterogeneous cluster is shown, such as figure 1 shown.

[0024] 2. The construction and deployment of a high-performance cluster system is a complicated process. A script installation method is provided based on Slurm. Slurm is a highly scalable and fault-tolerant cluster manager and job scheduling system that can be used for large-scale computing node clusters. figure 2 The flow chart of the on...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a high-performance cluster management method based on Slurm, which comprises the following steps of: randomly selecting one machine as a control node and other machines as computing nodes; obtaining host names or IP information of all computing nodes in the cluster, and copying a cluster installation package and an installation script to each computing node; logging in each computing node on the control node through an SSH (Secure Sockets Hierarchy) service, and finishing the construction and deployment of a cluster environment on the node through the installation script; deploying a control receiving process at the control node for monitoring computing resources and receiving information sent by the computing node; wherein a daemon process exists on each computingnode to control the computing nodes in the cluster, regularly acquiring node states and information on the nodes, and sending the node states and the information to the control node through an SSH service; carrying out collaborative management on the computing nodes and the redundant backup nodes; and based on a Slurm job management mechanism and a node state monitoring process, deploying, monitoring and allocating jobs in the queue according to the current condition of cluster system resources.

Description

technical field [0001] The invention relates to a data analysis management technology, a management method of a high-performance cluster based on a Slurm architecture. Background technique [0002] In today's information society, the analysis and processing of massive data poses a great challenge to the computing power of the system. However, the limitations of existing computing platforms prevent dynamic integration of computing services, resulting in certain bottlenecks in data storage, data computing and analysis. It has been proved to be an effective means to solve this problem by interconnecting multiple computing resources through the network to form a cluster system. However, the complexity of the cluster topology, the highly heterogeneous computing environment, and the diversification of application performance and other non-functional requirements caused by the increase in cluster size make the installation, configuration, and management of the cluster system more ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L12/26H04L29/08
CPCH04L41/0663H04L41/0893H04L41/5054H04L43/10H04L67/10H04L67/30
Inventor 赵博颖郭申王宇耕
Owner BEIJING INST OF COMP TECH & APPL
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap