Task scheduling method, computer equipment and storage medium

A task scheduling and task technology, applied in computing, program control design, program startup/switching, etc., can solve problems such as no longer applicable application scenarios, achieve the effect of improving overall operating efficiency and reducing the possibility of resource conflicts

Active Publication Date: 2021-02-05
NANJING TRANSWARP INTELLIGENCE CO LTD
View PDF4 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Nowadays, the resources that need to be considered in large-scale heterogeneous parallel clusters are no longer limited to CPU, disk, memory, etc., and the resources of differen

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method, computer equipment and storage medium
  • Task scheduling method, computer equipment and storage medium
  • Task scheduling method, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0045]Example one

[0046]figure 1 It is a flowchart of a task scheduling method provided by the first embodiment of the present invention. This embodiment is applicable to the situation of task scheduling in large-scale heterogeneous parallel clusters, such as big data, artificial intelligence, cloud computing, etc. In the large-scale heterogeneous parallel cluster task scheduling in, this method can be executed by a task scheduling device, which can be implemented by software and / or hardware, and can generally be integrated in cluster computer equipment.

[0047]Such asfigure 1 As shown, the task scheduling method provided by this embodiment includes the following operations:

[0048]Step 110: Obtain the task to be scheduled, and determine the target resource requirement of the task to be scheduled.

[0049]Tasks to be scheduled refer to tasks that require resource scheduling. The to-be-scheduled task is put into the to-be-executed task queue, and the system takes the to-be-scheduled task fro...

Example Embodiment

[0071]Example two

[0072]image 3 It is a flowchart of a task scheduling method provided in the second embodiment of the present invention. The embodiment of the present invention can be combined with each of the optional solutions in one or more of the foregoing embodiments. Each resource allocation candidate subgraph is evaluated; the resource allocation candidate subgraph with the best evaluation result is used as the resource allocation target subgraph.

[0073]Such asimage 3 As shown, the task scheduling method provided in this embodiment includes the following operations:

[0074]Step 210: Obtain the task to be scheduled, and determine the target resource requirement of the task to be scheduled.

[0075]Step 220: Traverse the available resource attribute graph at the current moment to generate a preset number of resource allocation candidate subgraphs that meet the target resource requirements; where the available resource attribute graph and the attributes of the vertices in the resource...

Example Embodiment

[0090]Example three

[0091]Picture 9 It is a flowchart of a task scheduling method provided in the third embodiment of the present invention. The embodiment of the present invention can be combined with each of the alternatives in one or more of the above embodiments. In this embodiment, the available resources at the current moment are traversed. The attribute graph, before generating at least two resource allocation candidate subgraphs that meet the target resource requirements, also includes: if it is determined that the currently available resources cannot meet the target resource requirements, release the resources occupied by the task in execution according to the preset resource preemption strategy, and update Attribute map of available resources at the current moment.

[0092]Such asPicture 9 As shown, the task scheduling method provided in this embodiment includes the following operations:

[0093]Step 310: Obtain the task to be scheduled, and determine the target resource requirem...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a task scheduling method, computer equipment and a storage medium. The method comprises the steps of obtaining a to-be-scheduled task, and determining a target resource demand of the to-be-scheduled task; traversing the available resource attribute graph at the current moment, and generating at least two resource allocation candidate sub-graphs meeting thetarget resource demand; wherein attributes of vertexes in the available resource attribute graph and the resource allocation candidate sub-graph represent resource quantity information, and attributes of edges represent resource association information; and determining a resource allocation target sub-graph in the at least two resource allocation candidate sub-graphs, and deploying the to-be-scheduled task according to the resource allocation target sub-graph. The task scheduling scheme is suitable for a large-scale heterogeneous parallel cluster, can perform finer scheduling management on cluster resources, and improves the overall operation efficiency of the cluster.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of task scheduling, and in particular, to a task scheduling method, computer equipment, and storage media. Background technique [0002] With the popularization of big data technology, the scale of modern clusters is getting larger and larger, and there are more and more types of tasks running in the clusters, and the running cycles are getting longer and longer. During the entire life cycle of the cluster, the hardware of the machines in the cluster may be different and not homogeneous, and it has become a trend to run mixed loads on the same cluster. [0003] Generally speaking, task scheduling refers to resource allocation for tasks. In traditional application scenarios, cluster machines and running tasks are single isomorphic, and the scheduling granularity is relatively coarse. Usually, host resources are divided into one or more groups based on memory or CPU (Central Processing U...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5027Y02D10/00
Inventor 唐剑飞
Owner NANJING TRANSWARP INTELLIGENCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap