A method and system for real-time tracking of task scheduling based on distributed architecture

Abstract

The invention discloses a real-time tracking method for task scheduling based on a distributed architecture, which is characterized in that it includes step 1: establishing a database table for recording the scheduling process, and step 2: establishing and configuring a remote monitoring interface for monitoring the scheduling process In the scheduling manager, step 3: After the scheduling task is started, monitor the executor’s reception of the scheduling task, and step 4: report the task delivery in the scheduling log data table and scheduling detail table according to whether the task delivery is successful or not Data; Step 5: Monitor the execution of the task by the executor, call the remote monitoring interface, and complete the data reporting of the scheduling status and scheduling operation details; Step 6: Do different processing according to the execution results. It achieves the breakthrough of the difficulty of tracking the scheduling process based on the original text log, and can cope with the full-process tracking and real-time monitoring of each scheduling task in the cluster environment in a low-cost manner, preventing service delays caused by untimely compensation.

Description

technical field [0001] The invention belongs to the field of task scheduling in the field of distributed system design, and in particular relates to a real-time tracking method and system for task scheduling based on a distributed architecture. Background technique [0002] Task scheduling refers to the process in which the system executes tasks at an agreed specific time in order to automatically complete specific tasks. With task scheduling, more manpower can be liberated and the system can automatically perform tasks. In the early stage of the software system, the timed task scheduling is generally implemented based on Quartz. The Quartz is an open source project of the OpenSymphony open source organization in the field of Job scheduling. It can be combined with J2EE and J2SE applications, and can also be used alone. Quartz can be used to create simple or complex timed task programs for running ten, hundreds, or even tens of thousands of Jobs. However, due to its single ...

AI Technical Summary

Problems solved by technology

However, whether it is a stand-alone Quartz or a mainstream distributed scheduling system, it mainly solves scheduling and execution problems. However, due to the lack of real-time tracking of the scheduling process, business exceptions cannot be sensed and processed in a timely manner, and the interests of users and enterprises are damaged.

Exception queries relying on scheduling logs can solve a small number of problems, but it is difficult to trace the source in a cluster environment, which takes a lot of time and labor costs. Therefore, how to efficiently locate the source and cause of scheduling exceptions in a cluster environment , extremely important and critical

[0005] CN201810546967 requires the use of message queues to allocate scheduling tasks, and the existence of message queues will undoubtedly bring about the complexity of architecture construction and increase the hidden dangers of problems; the monitoring of scheduling tasks only falls on the monitoring of task execution status, and does not cover scheduling The whole process, which is not conducive to problem tracking and positioning

[0006] The distributed task scheduling management method provided by CN201910411997 can reduce the risk of abnormal service and improve the stability and reliability of service. However, the monitoring data used in this method is only a representation of the survival status of the task, and the abnormality cannot be clarified during the monitoring process. Source and abnormal location; CN201910637694 solves the problem of delayed processing of scheduling tasks through time strategies, but does not mention the real-time monitoring and abnormal alarm of task delays from dispatching to execution of scheduling tasks. Such methods cannot respond comprehensively and effectively Real-time monitoring of the entire process of scheduling tasks cannot be realized because of the task execution status at each stage in the scheduling process;

[0007] CN202010939553 solves the problem that the remaining tasks to be scheduled cannot be executed in an environment without a compensation mechanism, but it is necessary to scan again to obtain unfinished scheduled tasks, and it is impossible to ensure that the scheduling compensation is started in time when the scheduling task is abnormal, and the resulting scheduling delay will bring to serve the exception

Images