Distributed workflow device and method for processing workflow by distributed workflow device

A workflow and distributed technology, applied in the computer field, can solve the problems of workflow system blocking, poor stability, inconvenient maintenance, etc., to achieve the effect of increasing throughput, increasing stability, and avoiding single points and bottlenecks

Active Publication Date: 2014-10-15
BEIJING QIYI CENTURY SCI & TECH CO LTD
View PDF6 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] First, the versatility is poor; the general customization system is customized for a certain characteristic requirement, and the customization work mainly includes the interface between various subsystems, the communication protocol of the message system, etc. If there is a new requirement, the new requirement cannot be implemented. Reuse existing interfaces and protocols
[0007] Second, the stability is poor; because the communication information between systems is transmitted through the message system, the scalability of the high-reliability message system is usually not good, and once the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed workflow device and method for processing workflow by distributed workflow device
  • Distributed workflow device and method for processing workflow by distributed workflow device
  • Distributed workflow device and method for processing workflow by distributed workflow device

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0044] Embodiment one

[0045] refer to figure 2 , which shows a structural block diagram of Embodiment 1 of a distributed workflow device of the present invention, which may specifically include: a master node 201 and a status node 202 in the cluster;

[0046] Wherein, the main node 201 is used to assign a corresponding state node 202 to the workflow definition submitted by the user; the workflow definition provides a task interface, and the task interface can be used to call the subsystem to execute the corresponding workflow task ;

[0047] The state node 202 can be used as a management scheduling node, compile the workflow definition into workflow tasks and corresponding task interfaces, and distribute the workflow tasks and corresponding task interfaces to corresponding state nodes;

[0048] The state node 202 can also be used as a task execution node to execute the workflow task according to invoking the corresponding subsystem through the task interface.

[0049] ma...

Example Embodiment

[0072] Embodiment two

[0073] The distributed workflow device of Embodiment 2 is described above figure 2 On the basis of the illustrated embodiments, the following optional technical solutions may be further included.

[0074] The state node 202 in the second embodiment can also be used to send heartbeat information to the master node 201, and the heartbeat information can specifically include remaining available resources, execution status of workflow tasks, and execution status of managed and scheduled workflows One or more of the amount of resources required by the workflow and the amount of resources required by the workflow.

[0075] In the second embodiment, the state node 202 can regularly send heartbeat information to the master node 201, and the master node 201 can determine which state nodes 202 are alive according to the heartbeat information. information, the master node 201 may consider that the state node 202 is down, and will rearrange the workflow and / or w...

Example Embodiment

[0082] Embodiment three

[0083] The distributed workflow device of Embodiment 3 is described above figure 2 On the basis of the illustrated embodiments, the following optional technical solutions may be further included.

[0084]The distributed workflow device in Embodiment 3 may further include: a shared storage system;

[0085] Then the state node 202 is further configured to write a checkpoint into the shared storage system during the execution of the workflow task; wherein, the checkpoint may specifically include context information of the workflow task.

[0086] The status node 202 inevitably fails during the execution of the workflow task, and the traditional way to restore the workflow task is to execute the workflow task from the beginning on other status nodes 202. When complex workflow tasks are encountered , the practice of executing from scratch will undoubtedly take a lot of time.

[0087] In the third embodiment, the state node 202 can continuously write the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a distributed workflow device and a method for processing workflow by the distributed workflow device, wherein the distributed workflow device concretely comprises a main node and state nodes in a cluster; the main node is used for allocating one corresponding state node to a workflow definition submitted by a user; the workflow definition provides a task interface, and the task interface can be used for calling a sub system for executing a corresponding workflow task; each state node is used as a management calling node for compiling the workflow definition into the workflow task and the corresponding task interface, and distributing the workflow task and the corresponding task interface to the corresponding state node; and the state nodes are also used as task executing nodes for executing the workflow task by the corresponding sub system called by the task interface. The distributed workflow device and the method provided by the embodiment have the universality, and the workflow processing stability and throughput can be improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a distributed workflow device and a method for processing workflow. Background technique [0002] Workflow is the abstraction, generalization and description of business rules between workflow and its various operation steps. Workflow modeling refers to expressing the logic and rules of how the work in the workflow is organized together with an appropriate model in the computer and performing calculations on it. Workflow modeling is usually done by a workflow engine. [0003] In the large-scale Internet content production system, there are many production systems similar to workflows. For example, a video publishing process generally includes: transcoding, non-editing, uploading, publishing and other processes. The start of a process depends on the end status of the previous process, thus forming a typical video production workflow. [0004] Unlike traditional workflows, eac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06Q10/00G06F17/30
Inventor 孙琦刘俊晖
Owner BEIJING QIYI CENTURY SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products