Docking workflow engine operation scheduling method and device based on Kubernetes system

A workflow engine and job scheduling technology, applied in the field of data processing, can solve the problems of reducing the efficiency of job execution and resource use, and lack of implementation, and achieve the effect of improving the efficiency of job execution and resource use.

Active Publication Date: 2017-08-29
UNITED ELECTRONICS
View PDF7 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the Kubernetes native system lacks a good implementation for this scenario, which makes the workflow engine unable to work with Kubernetes to complete the concurrent execution of executable units, reducing job execution efficiency and resource usage efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Docking workflow engine operation scheduling method and device based on Kubernetes system
  • Docking workflow engine operation scheduling method and device based on Kubernetes system
  • Docking workflow engine operation scheduling method and device based on Kubernetes system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in further detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0044] It should be noted that all expressions using "first" and "second" in the embodiments of the present invention are to distinguish two entities with the same name but different parameters or parameters that are not the same, see "first" and "second" It is only for the convenience of expression, and should not be construed as a limitation on the embodiments of the present invention, which will not be described one by one in the subsequent embodiments.

[0045] An embodiment of the present invention provides a job scheduling method for docking a workflow engine based on a Kubernetes system. refer to figure 1 , is a flowchart of a job scheduling method based on a Kubernetes system interconnected with a workflow engine...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a docking workflow engine operation scheduling method and device based on Kubernetes system. The methods include: receiving the executable unit submitted by the workflow engine; generating a configuration file for the Kubernetes system to create a container based on the parameters of the executable unit; sending the configuration file to the Kubernetes system so that the Kubernetes system creates the container according to the configuration file and executes the executable unit; receiving the first result of the executable unit returned by the Kubernetes system; translating the first result information to generate the second result information that can be recognized by the workflow engine and sending the second result information to the workflow engine; and if the second result information is successful, receiving the next executable unit that the workflow engine submits according to the execution sequence. The invention can realize the synergistic work of the workflow engine and Kubernetes system, and effectively improve the efficiency of operation execution and the resource utilization.

Description

technical field [0001] The present invention relates to the technical field of data processing, in particular to a job scheduling method and device for docking a workflow engine based on a Kubernetes system. Background technique [0002] A workflow engine is an application that manages business processes or data analysis process jobs, and it manages and monitors the status of job execution. According to the job process definition, the job can be divided into several executable units with sequential execution order, and the executable units can be assigned to the corresponding computing resources for execution, and the execution results of the executable units can be monitored until the entire job execution is completed or fails to exit. [0003] In workflow engine applications, there will be a large number of scenarios where executable units are executed concurrently, such as multiple jobs running at the same time or executable units executed concurrently in a single job. C...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/10H04L67/60
Inventor 王艳方巍鞠海涛薛凯吴延安
Owner UNITED ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products