Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, apparatus, device, and storage medium for scheduling jobs in cluster

A technology for scheduling jobs and clusters, used in multi-programming devices, program control design, resource allocation, etc.

Inactive Publication Date: 2019-01-01
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 44 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the present invention provides a method, device, device, and storage medium for scheduling jobs in a cluster to solve the problem of scheduling jobs of different applications or services in the same cluster

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, apparatus, device, and storage medium for scheduling jobs in cluster
  • Method, apparatus, device, and storage medium for scheduling jobs in cluster
  • Method, apparatus, device, and storage medium for scheduling jobs in cluster

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0096] In order to make the technical solution of the present invention more clear and understandable, the solution of the present invention will be further described below with reference to the accompanying drawings and examples.

[0097] Apparently, the described embodiments are some, but not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the protection scope of the present invention.

[0098] figure 1 A schematic flowchart of a method for scheduling jobs in a cluster according to an embodiment of the present invention is shown. Such as figure 1 As shown, the method includes:

[0099] Step S110, acquiring Pod data corresponding to the job.

[0100] A container (container) can provide an independent operating environment, which is similar to a virtual machine. However, in the embodiment of the present invention, the concept of con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method, an apparatus, a device and a storage medium for scheduling jobs in a cluster. The method comprises the following steps of: acquiring pod data corresponding to a job;one or more target nodes are selected from the cluster according to the node scheduling condition in the pod data and the node state of each node in the cluster. A Pod is respectively deployed on eachtarget node according to the Pod data, job processes are run in jobs in eeployed pods. This technical solution deploys job processes in a containerized manner, as the different jobs can be deployed in each corresponding independent contain, the jobs of each application on the cluster can not affect each other, communication can be carried out in the scene needing to be interactive, the effectiveutilization of the cluster resources is realized, and stable job scheduling can be realized for projects requiring multi-application pipelined cooperation such as deep learning and the like.

Description

【Technical field】 [0001] The invention relates to the field of job scheduling, in particular to a method, device, device and storage medium for scheduling jobs in a cluster. 【Background technique】 [0002] Using multiple physical machines to form a cluster and deploying services on it is a common method for Internet companies to implement projects. Therefore, how to reasonably schedule various jobs served on the cluster has always been a problem that technicians continue to study. [0003] Taking deep learning projects as an example, technicians often want to run all parts of the project on the same infrastructure platform, and the sample data of deep learning often comes from the products of the business line, that is, it is necessary to jointly schedule multiple types of jobs in the same cluster. However, existing scheduling frameworks do not do this well. 【Content of invention】 [0004] In view of this, the present invention provides a method, device, device and storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50
CPCG06F9/5027G06F9/5083
Inventor 周倜
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com