Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-resource scheduling method and device

A scheduling method and multi-resource technology, which is applied in the direction of multi-program device, resource allocation, program control design, etc., can solve the problems of not supporting GPU resource scheduling, difficulty in maximizing resource utilization, poor effect, etc., to achieve freedom switching effect

Active Publication Date: 2019-08-23
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When there are multiple network cards, the existing scheduling method cannot perform network adaptation and free switching well
[0005] Second, the scheduling of GPU resources is not supported
Or, even if the scheduling of GPU resources is supported, the effect of mixed scheduling of GPU and CPU is poor, making it difficult to maximize the utilization of GPU and CPU resources.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-resource scheduling method and device
  • Multi-resource scheduling method and device
  • Multi-resource scheduling method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0037] It should be noted that, in the case of no conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other.

[0038] Before introducing the embodiments of the present invention in detail, some technical terms involved in the embodiments of the present invention will be described first.

[0039]Docker: An open s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a multi-resource scheduling method and device, and relates to the technical field of computers. The method comprises the following steps: receiving a task request, wherein the task request comprises a network application parameter and a resource application parameter; according to the network application parameters, the resource application parameters andcurrent cluster available resource monitoring information, distributing resources to tasks, and running a server; and when the container on the running server is started in a host network mode, setting a network of the container according to the network application parameters, and setting resources allocated to the task as available resources of the container. Through the above steps, resources can be dynamically allocated to tasks, scheduling of multiple network cards is supported, and free switching between different network cards is achieved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a multi-resource scheduling method and device. Background technique [0002] With the development of artificial intelligence, deep learning tools such as TensorFlow and Caffe are more and more widely used. The performance of these deep learning tools is restricted by various resources such as network, memory, CPU, and GPU. [0003] Existing machine learning platforms mainly rely on yarn (a Hadoop resource manager) or kubernetes (a container cluster management system) for resource scheduling, mainly supporting the scheduling of CPU and memory resources. In the course of realizing the present invention, the inventor finds that there are at least the following problems in the prior art: [0004] First, it does not support the scheduling of multiple network cards. Most existing machine learning platforms are based on a network. When there are multiple network cards, the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F9/50
CPCH04L67/10H04L67/1008H04L67/1012G06F9/5016G06F9/5027Y02D10/00
Inventor 鲁楠王永亮王科何云龙张志强
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products