Task scheduling real-time tracking method and system based on distributed architecture

Abstract

The invention discloses a task scheduling real-time tracking method based on a distributed architecture, and the method is characterized in that the method comprises the following steps: 1, establishing a database table used for recording a scheduling process; 2, establishing a remote monitoring interface used for monitoring the scheduling process and configuring the remote monitoring interface in a scheduling manager; 3, after a scheduling task is started, monitoring the receiving condition of the executor on the scheduling task; 4, according to whether task issuing succeeds or not, reporting the task issuing data in the scheduling log data table and the scheduling detail table; 5, monitoring execution of the executor on the task, calling a remote monitoring interface, and completing data reporting of a scheduling state and scheduling operation details; 6, performing different processing according to different execution results. The problem that the scheduling process is difficult to track by depending on a text log originally is solved, full-process tracking and real-time monitoring on each scheduling task in a cluster environment can be dealt with in a low-cost mode, and the effect of service delay caused by untimely compensation is prevented.

Description

technical field [0001] The invention belongs to the field of task scheduling in the field of distributed system design, and in particular relates to a real-time tracking method and system for task scheduling based on a distributed architecture. Background technique [0002] Task scheduling refers to the process in which the system executes tasks at an agreed specific time in order to automatically complete specific tasks. With task scheduling, more manpower can be liberated and the system can automatically perform tasks. In the early stage of the software system, the timed task scheduling is generally implemented based on Quartz. The Quartz is an open source project of the OpenSymphony open source organization in the field of Job scheduling. It can be combined with J2EE and J2SE applications, and can also be used alone. Quartz can be used to create simple or complex timed task programs for running ten, hundreds, or even tens of thousands of Jobs. However, due to its single ...

AI Technical Summary

Problems solved by technology

However, whether it is a stand-alone Quartz or a mainstream distributed scheduling system, it mainly solves scheduling and execution problems. However, due to the lack of real-time tracking of the scheduling process, business exceptions cannot be sensed and processed in a timely manner, and the interests of users and enterprises are damaged.

Exception queries relying on scheduling logs can solve a small number of problems, but it is difficult to trace the source in a cluster environment, which takes a lot of time and labor costs. Therefore, how to efficiently locate the source and cause of scheduling exceptions in a cluster environment , extremely important and critical

[0005] CN201810546967 requires the use of message queues to allocate scheduling tasks, and the existence of message queues will undoubtedly bring about the complexity of architecture construction and increase the hidden dangers of problems; the monitoring of scheduling tasks only falls on the monitoring of task execution status, and does not cover scheduling The whole process, which is not conducive to problem tracking and positioning

[0006] The distributed task scheduling management method provided by CN201910411997 can reduce the risk of abnormal service and improve the stability and reliability of service. However, the monitoring data used in this method is only a representation of the survival status of the task, and the abnormality cannot be clarified during the monitoring process. Source and abnormal location; CN201910637694 solves the problem of delayed processing of scheduling tasks through time strategies, but does not mention the real-time monitoring and abnormal alarm of task delays from dispatching to execution of scheduling tasks. Such methods cannot respond comprehensively and effectively Real-time monitoring of the entire process of scheduling tasks cannot be realized because of the task execution status at each stage in the scheduling process;

[0007] CN202010939553 solves the problem that the remaining tasks to be scheduled cannot be executed in an environment without a compensation mechanism, but it is necessary to scan again to obtain unfinished scheduled tasks, and it is impossible to ensure that the scheduling compensation is started in time when the scheduling task is abnormal, and the resulting scheduling delay will bring to serve the exception

Images