Task processing method and device, equipment and storage medium

Abstract

The embodiment of the invention provides a task processing method and device, equipment and a storage medium, and relates to the technical field of program design and task processing. The method comprises the steps of obtaining a plurality of to-be-processed tasks and a plurality of available processing nodes, wherein the plurality of to-be-processed tasks are tasks needing to be processed within a target time period; based on a hash algorithm, dividing the to-be-processed tasks into a plurality of to-be-processed task sets, wherein the number of the to-be-processed task sets is equal to the number of the available processing nodes; allocating a plurality of to-be-processed task sets to the corresponding available processing nodes, wherein in the target time period, one to-be-processed task set corresponds to one available processing node; and respectively processing the to-be-processed tasks in the corresponding to-be-processed task set by adopting the plurality of available processing nodes. By adopting the technical scheme provided by the embodiment of the invention, the load balance of the distributed system can be improved.

Description

technical field [0001] The embodiments of the present application relate to the technical fields of program design and task processing, and in particular, to a task processing method, device, device, and storage medium. Background technique [0002] Distributed system technology is a task processing technology often used by Internet companies to deal with high concurrency scenarios. [0003] In the related technology, a preemptive task processing solution is adopted, and each node immediately preempts the task and processes it after the preemption start time is reached. However, in the above-mentioned related technologies, due to the slight deviation of the clocks of each node, the time of the clocks in some nodes will be faster than the time of the clocks in other nodes. It is impossible to realize that each node starts to preempt tasks at the same time, which inevitably leads to some nodes preempting too many tasks, and other nodes preempting fewer or no tasks, thus causi...

AI Technical Summary

Problems solved by technology

However, in the above-mentioned related technologies, due to the slight deviation of the clocks of each node, the time of the clocks in some nodes will be faster than the time of the clocks in other nodes. It is impossible to realize that each node starts to preempt tasks at the same time, which inevitably leads to some nodes preempting too many tasks, and other nodes preempting fewer or no tasks, which leads to load imbalance in the distributed system

Images