Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Job flow scheduling method and device, electronic equipment and storage medium

A scheduling method and job flow technology, applied in the direction of multi-program device, program control design, electronic digital data processing, etc., can solve the problems of no implementation method, etc., and achieve the effect of good structure foundation, simple and clear logic

Pending Publication Date: 2020-11-13
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF3 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] The current job flow scheduling is mostly aimed at relatively simple scenarios, but there is no better way to implement complex job flow scheduling for public cloud data analysis computing platforms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Job flow scheduling method and device, electronic equipment and storage medium
  • Job flow scheduling method and device, electronic equipment and storage medium
  • Job flow scheduling method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0027] In addition, it should be understood that the term "and / or" in this article is only an association relationship describing associated objects, which means that there may be three relationships, for example, A and / or B may mean: A exists alone, and A exists at the same time. and B, there are three cases of B alone. In addition, the character " / " in this articl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a job flow scheduling method and device, electronic equipment and a storage medium, and relates to the field of big data, cloud computing and the Internet, and the method can comprise the steps: determining that any operation group meets a triggering condition through a scheduling controller, generating a job flow execution instance corresponding to the operation group, anddistributing the job flow execution instance to a scheduling executor; generating a directed acyclic graph corresponding to the job flow execution instance through a scheduling executor, triggering job nodes in the directed acyclic graph in a preset mode, generating a job execution instance of each job node for any triggered job node, and distributing the job execution instances to a job execution control center; and performing job processing on the job execution instance through the job execution control center. By applying the scheme provided by the invention, scheduling processing and thelike of various job streams can be realized.

Description

technical field [0001] This application relates to computer application technology, in particular to a job flow scheduling method, device, electronic equipment and storage medium in the fields of big data, cloud computing and the Internet. Background technique [0002] The current job flow scheduling is mostly aimed at relatively simple scenarios, but there is no better way to implement complex job flow scheduling for public cloud data analysis and computing platforms. Contents of the invention [0003] The application provides a job flow scheduling method, device, electronic equipment and storage medium. [0004] A job flow scheduling method, comprising: [0005] Determining that any job group satisfies the trigger condition by the scheduling controller, generating a job flow execution instance corresponding to the job group, and assigning the job flow execution instance to the scheduling executor; [0006] Generate a directed acyclic graph corresponding to the job flow...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50G06F16/27
CPCG06F9/4881G06F9/5038G06F16/27
Inventor 叶青李莅
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products