Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Self-adaptive task scheduler and method

A task scheduling and self-adaptive technology, applied in instruments, multi-programming devices, biological models, etc., can solve problems such as performance differences

Active Publication Date: 2020-02-07
NORTHEASTERN UNIV +1
View PDF6 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in a heterogeneous cluster, the performance of each node is quite different. If the polling algorithm is still used, the nodes with good performance and nodes with poor performance will be assigned the same tasks.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Self-adaptive task scheduler and method
  • Self-adaptive task scheduler and method
  • Self-adaptive task scheduler and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0081] The specific embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and embodiments. The following examples are intended to illustrate the present invention, but not to limit the scope of the present invention.

[0082] This embodiment applies an adaptive filter and method to the big data analysis system Gaia. By default, the Gaia scheduler regards all nodes in the cluster as homogeneous, so the round-robin scheduling method is more efficient. Simple and fast. However, under the experimental conditions, the performance of each node in a heterogeneous cluster is very different, so the default scheduling mode adopted by Gaia may cause a node in the cluster to exceed the normal load. This delays the completion of the overall task set. This embodiment uses an adaptive task scheduler and initially uses a smooth round-robin task scheduling algorithm in a heterogeneous cluster mode. After the cluster warnin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a self-adaptive task scheduler and method, and belongs to the technical field of load balancing scheduling of distributed stream processing systems. The scheduler mainly comprises a performance monitoring data acquisition module, a smooth weighted polling task scheduling module and a task scheduling module based on an ant colony algorithm. According to a method for carryingout task scheduling by adopting the self-adaptive task scheduler, in the task running initial stage, a smooth weighted polling task scheduling algorithm is adopted, tasks are allocated according to the weights of nodes, and the nodes are not continuously selected under the condition that the number of times of selection is not changed. When the load of the cluster exceeds a set threshold value, in order to avoid delaying the overall completion time of the task set, an optimal task allocation scheme is calculated within a certain number of iterations by using a load balancing algorithm based on an ant colony algorithm, and when cluster resources are reduced to below the set threshold value, a smooth weighted polling algorithm is continued to be adopted.

Description

technical field [0001] The invention relates to the technical field of load balancing scheduling of distributed stream processing systems, in particular to an adaptive task scheduler and method. Background technique [0002] In a stream computing cluster, the task scheduling module is a very important part. The task scheduling module is responsible for allocating Tasks to designated Slots for scheduling and execution to ensure the load balance of each node in the entire cluster. Classic load balancing algorithms include Round Robin, Random, Source Address Hash, Weight Round Robin, Weight Random, and Minimum Connections. (Least Connections). The above load balancing algorithms are usually used in various load balancing models, and many load balancing algorithms are improved based on the above load balancing algorithms. In common big data stream computing frameworks, common schedulers are usually implemented by polling. The advantage of this is that when all nodes in the c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50G06N3/00
CPCG06F9/505G06F9/5027G06F9/5016G06N3/006Y02D10/00
Inventor 汪志峰赵宇海王国仁季航旭李博扬
Owner NORTHEASTERN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com