Task scheduling method and system facing mixed load in heterogeneous cluster

A mixed load and task scheduling technology, applied in transmission systems, electrical components, etc., can solve the problems of inability to schedule tasks, affect the efficiency of task execution, the overall performance of the task scheduling system, tasks that cannot be executed normally or run longer, etc. The effect of execution efficiency

Active Publication Date: 2014-12-24
INST OF INFORMATION ENG CAS
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the heterogeneity of tasks and machines, task scheduling must consider various constraints
Existing methods cannot describe a wide variety of constraints, nor can they schedule tasks to the optimal machine according

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method and system facing mixed load in heterogeneous cluster
  • Task scheduling method and system facing mixed load in heterogeneous cluster
  • Task scheduling method and system facing mixed load in heterogeneous cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The principles and features of the present invention will be described below in conjunction with the accompanying drawings and embodiments, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0050] Such as figure 1 As shown, the embodiment of the present invention implements a mixed-load-oriented task scheduling system running on a heterogeneous cluster. The system adopts a typical master-slave (Master-Slave) architecture, and the master control part (Master) includes two core processes Job Manager (Jobs Manager) and Resource Scheduler (Resource Scheduler), both deployed on the master physical node. The slave part (Slave) includes a core process executor (Executor), which is deployed on all other machines except the master physical node.

[0051] The job manager is responsible for managing jobs and tasks. A job includes several tasks, and a set of job IDs and task IDs can uniquely ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a task scheduling method and a task scheduling system facing mixed load in a heterogeneous cluster. The method comprises the following steps: a resource scheduler is used for receivingthe beats of machines and maintaining the cluster attributes of the machines; a job manager is used for receiving and resolving operation to obtain a plurality of tasks; the job manager is used for setting the attribute cluster and restrain demand for the task, and transmitting the task information to a resource manager; the resource scheduler is an optimal machine which is used for meeting the restraint of task matching, and returning a matching relation between the task and the machine to the job manager; and the job manager is used for transmitting the task to an actuator on the matched machine for executing tasks. The attribute and task requirement of the heterogeneous machine can be indicated by an easily expandable description method, and the optimal machine is distributed for the task based on taking the hard constraint as a filtration standard and the soft constraint as a selection standard, therefore the executing efficiency of the task and the integral performance of the system can be obviously improved.

Description

technical field [0001] The invention relates to a mixed load-oriented task scheduling method and system in a heterogeneous cluster, belonging to the field of computer parallel computing. Background technique [0002] In recent years, cluster machines have shown increasingly significant heterogeneity. Modern clusters tend to be large, run for long periods of time, and may even be geographically distributed. Throughout its lifecycle, clusters often need to update machines. In addition, in the cluster integration scenario, the cluster administrator may integrate several small clusters of different batches into one large cluster. Given the above, it is likely that there are some differences in the hardware and software of the cluster. [0003] On the other hand, with the continuous development of cloud computing, it has become a trend to run mixed loads on the same cluster, which has many benefits, such as improving resource utilization, sharing data, and reducing operation a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L29/08
Inventor 王旻张章汤学海韩冀中孟丹
Owner INST OF INFORMATION ENG CAS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap