Cluster job scheduling system with elastic framework

A job scheduling and flexible architecture technology, applied in the computer field, can solve problems such as not supporting cluster schedulers, expensive products, and inability to provide users with graphical interfaces for remote job management, so as to speed up the scale and speed, and relieve the tension in computing power.

Inactive Publication Date: 2009-12-09
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF0 Cites 59 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage is that the product is expensive, the scheduler inside the cluster can only be Platform LSF, and does not support other cluster sche...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cluster job scheduling system with elastic framework
  • Cluster job scheduling system with elastic framework
  • Cluster job scheduling system with elastic framework

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following describes in detail the operation system architecture and job submission process for small-scale clusters, large-scale clusters, and multiple clusters with reference to the accompanying drawings and embodiments.

[0017] When it is a small-scale cluster, the operating system architecture diagram is attached Figure 4 As shown, in a small-scale cluster, WebServer, Scheduler and Manager are deployed on one server, and the processes of WebServer and SchedulerandManager and the Agent on each Node are started. The user creates and submits jobs through the user interface of WebServer, and the job enters the process of SchedulerandManager. The managed queue is waiting for scheduling. SchedulerandManager checks the resource usage of each Node through the Agent on each Node, executes the scheduling strategy, and determines the running status of a certain job.

[0018]...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a cluster job scheduling system with an elastic framework. The job scheduling system adopts a B/S structure, and a client can conveniently submit and manage jobs through a web browser to provide a single system image for multi-cluster job management. The system structure comprises a scheduler management module, a resource management module, a job management module, an application management module and a strategy management module, wherein the scheduler management module can construct different schedulers between clusters and inside the clusters; the schedulers can select and use different scheduling strategies; and the job management module obtains corresponding application configuration and application running commands from the application management module according to the application attributes of jobs. When the job is submitted, a job running script is automatically generated to provide a flexible scheduling mechanism for job scheduling, thereby facilitating users.

Description

Technical field [0001] The invention relates to the computer field, in particular to a job scheduling system with a flexible architecture in a high-performance computing cluster, and in particular to a method for supporting job scheduling among multiple clusters. technical background [0002] With the development of computer technology, the role of high-performance computing in scientific research and engineering technology is becoming more and more important. Corresponding scientific computing software exists in various scientific computing fields to assist users in solving problems. But a common problem faced by these software is that users must log in to the cluster system to use the corresponding software, create jobs, and submit jobs. This increases the difficulty for users to use the software and reduces work efficiency. In addition, most of the operating systems of high-performance clusters are Linux or Unix. If users want to use a certain scientific computing software, th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/46G06F3/048H04L29/06H04L12/56
Inventor 魏健李刚邸双朋
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap