Resource scheduling method, device and system

A resource scheduling and resource pooling technology, applied in the field of resource scheduling, can solve problems such as large limitations, poor resource utilization efficiency, and inability to schedule heterogeneous accelerators, and achieve the effect of improving utilization efficiency and reducing workload

Active Publication Date: 2020-09-01
NAT UNIV OF DEFENSE TECH
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When using such a computing system, the resource usage efficiency of the resource scheduling method adopted by the current technology is poor, and heterogeneous accelerators cannot be scheduled, which has great limitations.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Resource scheduling method, device and system
  • Resource scheduling method, device and system
  • Resource scheduling method, device and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0063] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0064] In a large-scale distributed deep learning computing system, it has become a significant trend to use multiple heterogeneous accelerators to support the simultaneous operation of different types of workloads. When using such a computing system, the resource scheduling method adopted in the current technology has poor resource utilization effici...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a resource scheduling method. The method comprises the steps of obtaining a job program of a deep learning job, and converting the job program to obtain an intermediate representation of a calculation graph; segmenting the intermediate representation of the calculation graph to obtain a sub-graph set; packaging the sub-graph set to obtain workload mirror images correspondingto various accelerators; and determining a target accelerator from the accelerator cluster according to preset accelerator capability information, the service level condition submitted by the user and the information of the resource pool, and sending a corresponding workload mirror image to the target accelerator. According to the method, unified abstraction is carried out on operation programs of different frameworks by utilizing intermediate representation of the calculation graph; and based on the intermediate representation of the calculation graph, multiple workload mirror images, comprehensive accelerator capability information, service level conditions and information of a resource pool are obtained, a target accelerator is determined, corresponding workload mirror images are allocated to the target accelerator, accelerator resources are reasonably utilized, and the use efficiency is improved. The invention provides a resource scheduling device and system with the above beneficial effects.

Description

technical field [0001] The present application relates to the technical field of resource scheduling, and in particular to a resource scheduling method, a resource scheduling device, and a resource scheduling system. Background technique [0002] Computing-intensive workloads in deep learning place extremely high demands on the computing power of the computing system. In order to improve the computing performance of various workloads in deep learning, people usually use two methods to increase the computing power of the computing system. One is to increase the number of computer nodes participating in the calculation at the same time through distributed computing to obtain higher computing power, which is commonly referred to as horizontal expansion; the other is to increase the computing power of a single computer node, including the use of higher-performance central The processor (Center Processing Unit, CPU) and the use of dedicated computing accelerators, etc., are commo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/505G06F2209/508
Inventor 梅松竹王庆林赖志权黄震李东升苏华友魏妮
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap