Unlock instant, AI-driven research and patent intelligence for your innovation.

Task scheduling method, electronic equipment and computer storage medium

A technology for electronic equipment and task scheduling, which is applied in the field of information processing and can solve problems such as scheduling deep learning tasks

Pending Publication Date: 2021-08-03
EMC IP HLDG CO LLC
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] There are many popular deep learning frameworks, but whether it is data parallelization or model parallelization, these frameworks fail to schedule deep learning tasks based on resources, such as epoch and model partitioning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method, electronic equipment and computer storage medium
  • Task scheduling method, electronic equipment and computer storage medium
  • Task scheduling method, electronic equipment and computer storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0017] As used herein, the term "comprise" and its variants mean open inclusion, ie "including but not limited to". The term "or" means "and / or" unless otherwise stated. The term "based on" means "based at least in part on". The terms "one example embodiment" and "one embodiment" mean "at least one example embodiment." The term "another embodiment" means "at least one further embodiment". The terms "first", "second", etc. may refer to di...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

According to an example embodiment of the invention, a task scheduling method, electronic equipment and a computer readable storage medium are provided. The method comprises the steps that if it is determined that currently available resources of the task processing system cannot meet resource requirements of a current task set to be executed in multiple task sets, then tasks, capable of being supported by the currently available resources, in the current task set are scheduled for execution, wherein the tasks in each task set are independent of one another; based on tasks which are not scheduled in the current task set, a to-be-scheduled task set for next round of scheduling is created; a subset of tasks independent of the tasks in the to-be-scheduled task set is determined in a next task set after the current task set in the plurality of task sets, wherein the next set of tasks depends at least in part on the current set of tasks; and the subset is moved from the next set of tasks into the set of tasks to be scheduled. Therefore, according to the scheme, the parallel tasks can be scheduled, and the current available resources can be utilized to the maximum extent.

Description

technical field [0001] Embodiments of the present disclosure generally relate to the field of information processing, and specifically relate to a method for task scheduling, an electronic device, and a computer storage medium. Background technique [0002] There are many popular deep learning frameworks, but whether it is data parallelization or model parallelization, these frameworks fail to schedule deep learning tasks based on resources, such as epoch and model partitioning. If such a framework is used in the cloud, the user must first create a virtual machine and specify how many computing resources are needed, without knowing whether the computing power of these resources is too much or not enough for this type of deep learning task. Contents of the invention [0003] Embodiments of the present disclosure provide a task scheduling method, an electronic device, and a computer storage medium, capable of scheduling parallel tasks in a manner that correctly maintains dep...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48
CPCG06F9/4881G06F9/5066G06N3/105G06N3/045G06N3/08G06F9/52G06F9/5005G06F9/4843G06F9/50G06F9/4806G06F9/5027G06F9/48G06F9/485
Inventor 刘金鹏李锦吴鹏飞贾真
Owner EMC IP HLDG CO LLC