Distributed Scheduling System and Application Method Based on Job Flow

Abstract

The invention provides a distributed scheduling system and application method based on job flow, including: a logic scheduling module, a trigger management module, a database interaction module, a service interface module, a job distribution module, a job response module, a job flow resource library module and Execute the proxy terminal module. Among them, the logic scheduling module completes the logical processing and scheduling of the job flow and jobs, the trigger management module completes the addition, triggering and deletion of triggers for the job flow, the database interaction module completes the data interaction between the system and the database, and the service interface module provides support for jobs. The external service interface for flow and job control, the job distribution module and the job response module are used to complete the job distribution and the execution agent terminal module to receive and update the job execution results, and the job flow resource library module stores the job flow read from the database Configuration properties. Share the pressure of single-point job execution and improve the efficiency of job scheduling and execution.

Description

technical field [0001] The present invention relates to the field of job scheduling, in particular to a distributed scheduling system and method based on job flow. Background technique [0002] Most of the existing job scheduling systems are based on Quartz. The most important features are: the integration of job scheduling and execution. Although the scheduling efficiency is high, it increases the burden on the system. When the number of concurrent jobs is large, its response and scheduling efficiency are limited. big limit. Jobs are used as the scheduling unit for scheduling, and each job is configured one by one, which cannot be reused. The job flow is composed of dependencies between jobs in series, without independent attributes, it is not easy to display and control the job flow globally. Although each job in the job flow can be flexibly intervened, the lack of global control of the job flow makes the job flow scheduling prone to logic confusion. Contents of the in...

AI Technical Summary

Problems solved by technology

[0002] Most of the existing job scheduling systems are based on Quartz. The most important features are: the integration of job scheduling and execution. Although the scheduling efficiency is high, it increases the burden on the system. When the number of concurrent jobs is large, its response and scheduling efficiency are limited. big limit

Scheduling with jobs as the scheduling unit, one configuration per job, which cannot be reused

The job flow is composed of dependencies between jobs in series, without independent attributes, it is not easy to display and control the job flow globally

Although it is possible to flexibly intervene on each job in the job flow, the lack of global control over the job flow makes job flow scheduling prone to logical confusion

Images