Resource scheduling method and device for task

A resource scheduling and task technology, applied in the field of data processing, can solve the problems that affect the demand front-end data presentation, task failure, and high importance

Active Publication Date: 2017-10-24
ALIBABA GRP HLDG LTD
View PDF8 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a resource scheduling method and device for tasks, which are used to solve the problem that tasks corresponding to high-importance requirements cannot be calculated in time and affect the presentation of front-end data of the requirements when executing tasks according to the first-come-first-calculated rule

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource scheduling method and device for task
  • Resource scheduling method and device for task
  • Resource scheduling method and device for task

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Such as figure 1 As shown in FIG. 1 , it is a schematic flow chart of the task resource scheduling method in Embodiment 1 of the present invention. The resource scheduling method of the task includes the following steps:

[0038] S101. Determine the priorities of multiple tasks and the specified task deadlines;

[0039] In this embodiment, each task corresponds to a priority, and different tasks may have the same priority. Different tasks can belong to the same requirement, and the priorities of tasks between different requirements can be different, but all tasks belonging to the same requirement have the same priority. Further, a task deadline is set for each requirement, and the tasks included in the requirement must be completed within the task deadline.

[0040] S102. Determine a preset resource upper limit.

[0041] In order to ensure that the machine cluster that executes the task can be efficiently allowed, it is necessary to set a resource upper limit for th...

Embodiment 2

[0051] Such as figure 2 As shown in FIG. 2 , it is a schematic flow chart of the task resource scheduling method in Embodiment 2 of the present invention. The resource scheduling method of the task includes the following steps:

[0052] S200. Use the scheduled tasks to form a scheduled task sequence.

[0053] S201. Add a first to-be-scheduled task to a scheduled task sequence.

[0054] Wherein, the priority of the task in the scheduled task sequence is higher than or equal to the priority of the first task to be scheduled, and the scheduled task sequence satisfies the first condition, wherein the first condition is that there is no time resource conflict among the tasks , in this embodiment, the time resource conflict is that the sum of the resources occupied by the overlapping parts of more than one task of the same type in time sequence is greater than the upper limit of resources corresponding to the task of this type.

[0055] In this embodiment, each task corresponds ...

Embodiment 3

[0083] Such as image 3 As shown in FIG. 2 , it is a schematic flow chart of the task resource scheduling method in Embodiment 3 of the present invention. On the basis of the second embodiment above, before adding the first task to be scheduled to the scheduled task sequence, the following steps are included:

[0084] S301. Divide task groups according to dependencies between tasks.

[0085]Among them, each task group includes: the first type of task to detect the state of the data, the second type of task to calculate the data, and the third type of task to summarize the calculation results of the data; the second type of task depends on the first type of task, and the third type of task directly depends on The second type of task indirectly depends on the first type of task.

[0086] In practical applications, there is a dependency relationship between tasks with the same requirement, and tasks are grouped according to the dependency relationship between tasks. Generally,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a resource scheduling method and a resource scheduling device for a task. The method comprises the steps of determining priorities of a plurality of tasks and a specified task ending time, determining a preset resource upper limit, scheduling the executing sequence of the plurality of tasks according to the priorities of the tasks, and allowing the scheduled tasks to meet a first condition, wherein the first condition is that the tasks do not have a time resource conflict, the time resource conflict is that more than one tasks have an overlapped part on a time sequence, and the sum of the resources occupied by the overlapped part is more than the resource upper limit. According to the method and the device provided by the invention, when the plurality of tasks are executed, an existing first-in fist-out principle is not used, and scheduling is performed according to priorities of the tasks. According to abovementioned scheduling, the situation that the tasks are executed according to the priority sequence can be kept, the condition that the task corresponding to the requirement with high level acquires the resources firstly can be ensured as much as possible, and thus such task can be preferentially executed, and display of the front-end data of the requirement is facilitated.

Description

technical field [0001] The invention belongs to the field of data processing, and in particular relates to a task resource scheduling method and device. Background technique [0002] In traditional big data computing, each requirement generally includes multiple tasks. When all the tasks included in the requirement are completed, the requirement can be presented as data on the front end. [0003] Currently, the tasks corresponding to the requirements are executed according to the rule of first come first count. Often some low-importance tasks arrive first, and these tasks can occupy machine resources and start computing after they arrive. When tasks with low importance requirements take a long time to calculate and have large resources, it may have a certain impact on subsequent tasks with high importance requirements and earlier expected completion times. For example, when these high-importance tasks arrive, the computing cluster resources are already fully loaded, and th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5038G06F9/4837G06F9/4887G06F9/4881G06F9/50
Inventor 杨天洋
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products