Method and device for dispatching HPC (high performance computing) cluster work

A job scheduling and job technology, applied in the field of data processing, can solve problems such as unreasonable resource allocation, resource allocation failure, and resource allocation failure

Inactive Publication Date: 2015-07-01
LANGCHAO ELECTRONIC INFORMATION IND CO LTD
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in some cases, the above method cannot allocate resources well. For example, user A submits hundreds of jobs at the same time. These jobs are queued for processing and occupy the comput

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for dispatching HPC (high performance computing) cluster work
  • Method and device for dispatching HPC (high performance computing) cluster work
  • Method and device for dispatching HPC (high performance computing) cluster work

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0039] like figure 1 As shown, the embodiment of the present invention provides a HPC cluster job scheduling method, the method may include the following steps:

[0040] Step 101: set grouping rules, set grouping sorting rules, and set conditions, the set conditions include: with respect to the remaining resources in the current HPC cluster, the grouping includes at least one job that can be executed;

[0041] Step 102: Divide all jobs in the HPC clust...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for dispatching a HPC (high performance computing) cluster work and a device for dispatching the HPC cluster work. The method comprises the following steps: setting a grouping rule, setting a grouping sequencing rule, and setting conditions for judging the grouping; according to the set grouping rule, dividing all works in the HPC cluster into multiple groups; according to the set grouping sequencing rule, sequencing multiple groups; according to multiple groups after sequencing, orderly polling every group, and taking out one work from groups satisfied with the setting condition to execute; after all groups are polled, repeatedly executing the step until all groups cannot meet the setting conditions; when remaining calculation resources in the HPC cluster are restored until the group can meet the setting condition; sequencing according to the group and taking out one work from the groups satisfied with the setting conditions to execute until all works are finished. The method and the device for dispatching the HPC cluster work can realize the reasonable distribution of the HPC cluster calculation resource.

Description

technical field [0001] The invention relates to data processing technology, in particular to an HPC cluster job scheduling method and device. Background technique [0002] HPC (High Performance Computing, High Performance Computing) cluster is a group of servers connected through a high-performance network, which can work together to complete data analysis or scientific computing tasks. With the widespread application of cluster systems in scientific computing and business operations, the role of cluster systems is becoming more and more important, and has gradually become an indispensable tool in scientific computing and business services. More and more users use clusters to complete computing tasks. The same cluster will be used by hundreds of users at the same time, and each user will submit multiple computing tasks. When the computing resources of the cluster are insufficient, these jobs will be in a waiting state. [0003] For these queued tasks, it is necessary to uni...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48
Inventor 邸双朋
Owner LANGCHAO ELECTRONIC INFORMATION IND CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap