Task management method, system, device and storage medium

Abstract

The invention discloses a task management method, which comprises the following steps of: when a Celery service is started, scanning a target task method; identifying each module called by the target task method, and storing a file content check value of each module in a cache; before the target task method is executed, determining a call chain module set of the target task method; calculating a file content check value of each module in the call chain module set, and respectively judging whether the file content check value is consistent with the corresponding check value in the cache; if any one of the file content verification values is not consistent, updating the file content verification value of the module in the cache, and introducing the method of the module into the cache in a module reloading mode; and executing the target task method. By applying the method of the invention, the Celery task can automatically take effect without restarting, and the stability of the system is not damaged. The invention further provides a task management system and device and a storage medium, which have corresponding technical effects.

Description

technical field [0001] The present invention relates to the technical field of task processing, in particular to a task management method, system, device and storage medium. Background technique [0002] Celery is an asynchronous task scheduling tool. It adopts the distributed task queue mode and supports high-concurrency execution of massive tasks, such as when the server memory, CPU, and Memory use data collection, or asynchronously initiates the execution of a command to a specified server. [0003] At present, Celery's task registration method is usually to add Celery task annotations to the background script method, and Celery will automatically scan out the task method name and add the method name to the memory. However, when the business logic changes, this method needs to restart the Celery service process code to take effect, that is, this method will cause the application system to restart, block the asynchronous tasks being executed, easily cause data confusion, a...

AI Technical Summary

Problems solved by technology

In this way, the application system needs to run a set of regular polling process separately, polling and detecting the time stamp of all Celery tasks, when the hardware resources of the application service are in short supply, it will affect the normal execution of the original process of Celery, and when the process appears When there is an exception or when the server time is artificially modified, the judgment of the timestamp is likely to fail, and it is easy to form a single point of failure, resulting in Celery being unable to execute the latest code

Images