System and method for distributed asynchronous task queue execution in cloud environment

Abstract

The invention provides a system and a method for distributed asynchronous task queue execution in a cloud environment. The system comprises an interface device, a task queue device and a plurality of task execution devices. The interface device is used for receiving a task execution request submitted by a user, verifying whether the quota of the user is overrun, and receiving tasks submitted by the user and writing the basic information of the tasks into a database under the condition that the quota of the user is not overrun. The task queue device is used for judging whether the tasks submitted by the user are tasks needing to be executed in a parallel mode or tasks needing to be executed in a serial mode, and correspondingly putting the tasks submitted by the user in a parallel task queue and a serial task queue. The task execution devices are used for executing parallel tasks and serial tasks pushed by the task queue device, the task execution devices judge whether the degree of concurrency exceeds the limit of the user when the task queue device pushes parallel tasks, and the task execution devices execute the parallel tasks when the degree of concurrency does not exceed the limit of the user. The system of the invention has the advantages of high task execution efficiency and good performance.

Description

Technical field [0001] The present invention relates to the field of Internet technology, and in particular to a distributed asynchronous task queue execution system and method in a cloud environment. Background technique [0002] In the agent cloud environment, users (such as developers) often need to perform their own tasks. Due to the time limit of the execution engine, the simultaneous execution of multiple tasks will cause task execution timeouts. Therefore, support for asynchronous submission of task queues appears to users Very important, the distributed task queue supports users to submit a series of tasks through the queue, and the system guarantees that the tasks are not lost. [0003] At present, the following problems exist in the use of distributed task queues to execute tasks: the task executor adopts the active pull mode, which is likely to cause high scanning costs in the presence of large-scale queues, affecting the overall performance of the system, and some requi...

AI Technical Summary

Problems solved by technology

[0003] At present, there are mainly the following problems in using distributed task queues to execute tasks: the task executor adopts the active pull mode, and in the case of large-scale queues, it is easy to cause high scanning costs and affect the overall performance of the system. At the same time, some requirements cannot be supported, such as Success callback, query for individual task status

Images