Task scheduling method and device, computer equipment and storage medium

Abstract

The invention relates to a task scheduling method and device, computer equipment and a storage medium. The method comprises the steps of receiving a to-be-scheduled task scheduling request, wherein the to-be-scheduled task scheduling request carries a to-be-scheduled task identifier; obtaining a to-be-scheduled task corresponding to the to-be-scheduled task identifier; wherein the to-be-scheduledtasks comprise one or more single-chip task; wherein the task types corresponding to all the single-chip tasks are the same, and the processing performance indexes corresponding to all the execution machines are calculated; determining a grouping proportion according to each processing performance index, and grouping the tasks to be scheduled according to the grouping proportion to obtain a plurality of grouped tasks; and according to the processing performance index corresponding to each single-chip task in each execution machine, allocating each grouping task to the corresponding execution machine so as to instruct the execution machine to process the grouping tasks allocated in parallel according to each processing thread, wherein the corresponding number of processing threads are determined according to the allocated grouping tasks. Through the method, the task execution efficiency can be improved.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a task scheduling method, device, computer equipment and storage medium. Background technique [0002] With the rapid development of Internet technology, the demand for data in various industries continues to increase, and a large number of tasks need to be processed accordingly. For example, task data can be processed regularly, in batches, and efficiently in the form of task scheduling. For example, Quartz task scheduling is commonly used today. Quartz is an open source job scheduling architecture completely written in Java. Tasks to be scheduled are stored in the concept of jobs. Scheduling The machine invokes jobs by triggering the machine. Quartz supports a variety of scheduling and multiple storage methods of scheduling data to meet various conventional and special needs. [0003] However, in the process of task scheduling, it is deployed under multiple nodes, ...

AI Technical Summary

Problems solved by technology

[0003] However, in the process of task scheduling, it is deployed under multiple nodes, and only one task is guaranteed to be executed by competing for database locks. Although the problem of cluster high availability is solved, only one node can run the same task, resulting in task execution efficiency. low

Images