Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for cluster management task scheduling

A task scheduling and cluster management technology, applied in the field of computing clusters, can solve problems such as user quota changes, task changes, cluster resource changes that cannot be responded to in a timely manner, the overall efficiency of cluster usage cannot be improved, and the scheduling module is highly coupled with other modules. Achieve the effects of improving independence, reducing waste of system resources, and improving distribution efficiency

Pending Publication Date: 2022-03-04
杭州幻方人工智能基础研究有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The traditional scheduling method has many defects. The static scheduling method means that the situation of the cluster, including changes in user quotas, task changes, and cluster resource changes, cannot be responded in time, and the situation of dynamically adjusting task scheduling
Simple first-in-first-out tends to lead to low flexibility of the scheduler, and some urgent tasks cannot be scheduled; priority scheduling will cause some tasks to occupy resources for a long time, which cannot improve the overall efficiency of the cluster
Moreover, the traditional scheduling method distinguishes between new and suspended tasks, and the scheduler is used once each time a new task is created, which logically leads to a high degree of coupling between the scheduling module and other modules, which is not conducive to the flexible expansion of the scheduling module, etc. problems to be solved

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for cluster management task scheduling
  • Method and device for cluster management task scheduling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. The components of the embodiments of the invention generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations.

[0032] In order to facilitate the implementation of the solution of this application, the system platform presets a scheduling module, and implements steps S101-S107 of the task scheduling method through the scheduling algorithm in the scheduling module, so as to realize task reception and reasonable allocation of node resources. The scheduling algorithm performs resource allocation and scheduling for all tasks submitted by users, including tasks waiting to run, running, and pending in addit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of node allocation, in particular to a cluster management task scheduling method, which can realize reasonable allocation of limited computing power resources between a user and a task as much as possible through reference and arrangement allocation of multiple dimensions such as task priority, user right number, running time length and user utilization rate. And the distribution balance of internal resources is realized. The method has the advantages that compared with traditional scheduling, the problem of butt joint coupling of a scheduling module and other modules in a traditional module is solved through independent scheduling module design, and a program is more flexible and easy to expand. A two-in-one mode of interruption and starting logic is adopted, task states, newly-built tasks, interrupted tasks or restarted tasks do not need to be concerned from the scheduling level, only results need to be calculated, the independence of a task scheduling module is improved from the bottom layer design, and the task scheduling efficiency is improved. Conditions are provided for more subsequent users, a larger cluster and a more complex platform service scene.

Description

technical field [0001] The invention relates to the field of computing clusters, in particular to a method and device for cluster management task scheduling. Background technique [0002] With the development of artificial intelligence technology, more and more companies, universities, and scientific research institutes regard artificial intelligence as a new direction and new driving force for research and exploration. At present, the main field of artificial intelligence technology development is deep learning. By combining low-level features to form more abstract high-level representation attribute categories or features, to discover the distributed feature representation of data, so as to solve many problems that traditional machine learning algorithms cannot solve in the past. The deep learning model relies on the training of large-scale samples and the support of computer hardware. With the increase of business volume and the continuous improvement of model complexity...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/48G06F9/50G06F9/455G06N20/00G06N3/08
CPCG06F9/4881G06F9/5038G06F9/45558G06N20/00G06N3/08G06F2009/45562
Inventor 梁文锋黄盼盼张浩威张文韬
Owner 杭州幻方人工智能基础研究有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products