Method and device for distributed workflow dispatching

A scheduling device and workflow technology, applied in the field of computer networks, can solve problems such as inability to respond to requests in a timely manner, complex dependencies, job processing scale and lack of scalability of resources.

Active Publication Date: 2017-06-20
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF5 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the existing workflow management system, all workflow jobs are executed in the form of multi-threads on one host. The disadvantage is that when faced with a large number of large-scale workflow execution requests, the host's single machine resources (CPU, memory and Due to the limited size of disk), it is unable to respond to requests in a timely manner, that is, it does not have

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for distributed workflow dispatching
  • Method and device for distributed workflow dispatching
  • Method and device for distributed workflow dispatching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0078] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe operations as sequential processing, many of the operations may be performed in parallel, concurrently, or simultaneously. In addition, the order of operations can be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure. The processing may correspond to a method, function, procedure, subroutine, subroutine, or the like.

[0079] The term "computer equipment" in this context, also referred to as "computer", refers to an intelligent electronic device that can perform predetermined processing procedures such as numerical calculations and / or logic calculations by running predetermined programs or instructions, which may include a processor and The memory is realized by the processor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and a device for distributed workflow dispatching. The method comprises the following steps: acquiring an operation execution instruction supplied by a user, a workflow topological relation and an inter-operation dependency; searching for a node corresponding to the operation execution instruction on the basis of the workflow topological relation and the inter-operation dependency; acquiring a prepared node; confirming a resource quota required by the prepared node by a resource management module; adopting a colony resource scheduling system for scheduling the resource corresponding to a colony resource quota to the resource management module; sending a starting instruction by the resource management module which has acquired the resource through a resource scheduling agent, thereby starting a remote operation executing module for executing the operation execution instruction. According to the invention, the topology for traversing Flow on the basis of the complex inter-operation dependency is adopted for realizing the distributed running of the workflow, the scheduling logic and the executing logic in the workflow are separated and the workflow scheduling and the resource management logic are separated.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular to a distributed workflow scheduling technology. Background technique [0002] In the existing workflow management system, all workflow jobs are executed in the form of multi-threading on one host. The disadvantage is that when faced with a large number of large-scale workflow execution requests, the host's single machine resources (CPU, memory and Due to the limited size of disk), it is unable to respond to requests in a timely manner, that is, it does not have good scalability in terms of job processing scale and resource level; and in reality, the dependencies between workflow jobs are not only sequential dependencies, but often include more complex Dependencies, and the existing workflow scheduling system cannot separate the scheduling and execution logic in the workflow, as well as the scheduling and resource management logic in the workflow. [0003] Therefore, how ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5038
Inventor 苗科展孟宪军
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products