Distributed task scheduling method, device, computer equipment and storage medium

A technology of distributed tasks and scheduling methods, applied in the field of task scheduling, can solve problems such as poor matching between tasks to be processed and task execution nodes, and achieve the effect of solving transmission delays

Pending Publication Date: 2021-05-28
SHANGHAI BILIBILI TECH CO LTD
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to provide a distributed task scheduling method, device, computer equipment and storage medium to solve the problem of poor matching between pending tasks and task execution nodes existing in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed task scheduling method, device, computer equipment and storage medium
  • Distributed task scheduling method, device, computer equipment and storage medium
  • Distributed task scheduling method, device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] The present invention is applicable to a task scheduling system including a multi-node cluster, for example, a master-slave task distribution system including one master node and multiple slave nodes. Among them, the master node is used to receive tasks to be processed, manage the running status of multiple slave nodes, and realize the overall scheduling of received tasks to be processed among multiple slave nodes. As the task execution subject, the slave node is used to report its own running status to the master node in real time, and perform substantive processing on the received pending tasks.

[0039] see figure 1 , this embodiment proposes a distributed task scheduling method, which specifically includes the following steps:

[0040] S1: The master node receives a task to be executed, and acquires a resource consumption object corresponding to the task to be executed, wherein the resource consumption object is used to represent a resource object that consumes the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a distributed task scheduling method, a device, computer equipment and a computer readable storage medium. The method comprises the following steps: receiving a to-be-executed task by a main node, and obtaining a resource consumption object corresponding to the to-be-executed task, wherein the resource consumption object is used for representing a resource object which consumes the most when the to-be-processed task is operated; obtaining resource state information of a plurality of slave nodes, wherein the resource state information comprises the number of processes currently operated by the slave nodes and the current residual resource value of the slave nodes; based on the resource consumption object, taking a slave node of which the number of currently operated processes accords with a preset first rule and the current residual resource value accords with a preset second rule as a target slave node; and distributing the to-be-executed task to the target slave node for processing.

Description

technical field [0001] The present invention relates to the technical field of task scheduling, in particular to a distributed task scheduling method, device, computer equipment and storage medium. Background technique [0002] Distributed task scheduling is currently the research direction of many network companies. The traditional task scheduling method is generally that the scheduling platform distributes the tasks to be processed in a fixed order among multiple execution nodes in turn or randomly. The disadvantages of this method are: The task distribution strategy is simple and crude, and cannot achieve the best matching effect between pending tasks and execution nodes. At present, in the prior art, it is also disclosed that tasks are allocated according to the processing capabilities of the execution nodes. If a certain execution node processes tasks faster, the more tasks it will be allocated. However, this way of qualitatively assigning tasks based on processing spe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4881G06F9/5016G06F9/5027G06F2209/504
Inventor 张杨
Owner SHANGHAI BILIBILI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap