Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Task scheduling method and device

A task scheduling and task technology, applied in the computer field, can solve the problem of high bandwidth occupation between clusters

Active Publication Date: 2021-04-23
ALIBABA GRP HLDG LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a task scheduling method and device, which are used to solve the situation that the bandwidth between clusters is too high in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method and device
  • Task scheduling method and device
  • Task scheduling method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] figure 1 It is a schematic flowchart of a task scheduling method provided in Embodiment 1 of the present invention. The method provided in this embodiment can be executed by a task manager in a distributed system, such as figure 1 As shown, the methods include:

[0024] Step 101, determine the network resources between the default cluster of the task and the idle target cluster.

[0025] Wherein, the default cluster is a cluster storing task data required for running the task, and the network resources include: at least one of network bandwidth and network bandwidth-delay product.

[0026] Specifically, a set of network models can be established, and the network model is used to distinguish the network structure relationship between different clusters. The network structure relationship mentioned here can include the same core switch, the same region and different regions. Among them, the same core switch means that the two clusters belong to the same core switch, the...

Embodiment 2

[0042] image 3 It is a schematic flowchart of a task scheduling method provided in Embodiment 2 of the present invention, as shown in image 3 shown, including:

[0043] Step 201 , query whether the load of the default cluster of the task is idle, if it is idle, execute step 202 , otherwise execute step 203 .

[0044] Specifically, after obtaining the task to be scheduled, first check whether the load of the default cluster of the task is idle, and if it is idle, the task will be run by the default cluster. The cluster reads the task data required for running. Therefore, running the task on the default cluster can effectively avoid the bandwidth occupation caused by reading the task data, thereby avoiding the occurrence of excessive bandwidth occupation.

[0045]Step 202, schedule the task to the default cluster, and the process ends.

[0046] Specifically, tasks are scheduled to be queued to run on the default cluster.

[0047] Step 203 , judging whether there is a targe...

Embodiment 3

[0062] Figure 4 A schematic structural diagram of a task scheduling device provided by Embodiment 3 of the present invention, as shown in image 3 As shown, it includes: a determination module 31 and a scheduling module 32 .

[0063] A determining module 31, configured to determine network resources between a default cluster of a task and an idle target cluster.

[0064] Wherein, the default cluster is a cluster storing task data required for running the task, and the network resources include: at least one of network bandwidth and network bandwidth-delay product.

[0065] The scheduling module 32 is configured to schedule tasks according to network resources between the default cluster and the target cluster.

[0066] Specifically, the scheduling module 32 is specifically configured to schedule tasks to the target cluster with the most network resources.

[0067] further, Figure 5 A schematic structural diagram of another task scheduling device provided by Embodiment 3 ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a task scheduling method and device. After determining the network resources between the default cluster of the task and the idle target cluster, the task is scheduled according to the determined network resources. Among them, the default cluster is the cluster that stores the task data required for the task to run. When the task is scheduled based on the cluster load, the bandwidth usage is too high mainly because the task is scheduled to the target cluster to run. However, it still needs to be generated by reading the task data required for running from the default cluster. Therefore, only when the network resources between the target cluster and the default cluster are in good condition, the task is scheduled to the target cluster to solve the problem. The situation that the bandwidth between the clusters is too high in the prior art is solved.

Description

technical field [0001] The invention relates to computer technology, in particular to a task scheduling method and device. Background technique [0002] In order to improve the stability of the system and the data processing and service capabilities of the network center, cluster technology is usually used. The emergence of the cluster technology enables servers to be connected together to form a cluster, and multiple clusters are connected to form a distributed system, and each cluster in the distributed system runs a series of common applications. [0003] In the distributed system, the application program is divided into multiple tasks, and each task is assigned a cluster to run, and the assigned cluster is used as the default cluster of the task, and the task is run on the default cluster, and the storage task runs required task data. It can be seen that, in this case, when the operation capability required by the task does not match the operation capability of the clu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/50
CPCG06F9/5038G06F9/5083G06F9/50Y02D10/00
Inventor 何乐黄俨史英杰张杰张辰
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products