Method, system, device and storage medium for task management

Abstract

The present application discloses a task management method, including: when starting the Celery service, scanning out the target task method; identifying each module called by the target task method, and storing the check value of the file content of each module in the cache; Before executing the target task method, determine the call chain module set of the target task method; calculate the file content check value of each module in the call chain module set, and judge whether it is consistent with the corresponding check value in the cache; if If any one is inconsistent, update the file content verification value of the module in the cache, and introduce the method of the module into the cache through module reloading; execute the target task method. Applying the solution of this application, the Celery task can be automatically effective without restarting, and the stability of the system will not be damaged. The present application also provides a task management system, equipment and storage medium, which have corresponding technical effects.

Description

technical field [0001] The present invention relates to the technical field of task processing, in particular to a task management method, system, device and storage medium. Background technique [0002] Celery is an asynchronous task scheduling tool. It adopts the distributed task queue mode and supports high-concurrency execution of massive tasks, such as when the server memory, CPU, and Memory use data collection, or asynchronously initiates the execution of a command to a specified server. [0003] At present, Celery's task registration method is usually to add Celery task annotations to the background script method, and Celery will automatically scan out the task method name and add the method name to the memory. However, when the business logic changes, this method needs to restart the Celery service process code to take effect, that is, this method will cause the application system to restart, block the asynchronous tasks being executed, easily cause data confusion, a...

AI Technical Summary

Problems solved by technology

In this way, the application system needs to run a set of regular polling process separately, polling and detecting the time stamp of all Celery tasks, when the hardware resources of the application service are in short supply, it will affect the normal execution of the original process of Celery, and when the process appears When there is an exception or when the server time is artificially modified, the judgment of the timestamp is likely to fail, and it is easy to form a single point of failure, resulting in Celery being unable to execute the latest code

Images