Task distribution method and device, storage medium, equipment and distributed task system

A distributed task and task allocation technology, applied in the Internet field, can solve problems such as task blocking, other tasks cannot be allocated, and the resource utilization rate of sub-nodes in the concurrent processing capacity of distributed task system tasks is reduced.

Inactive Publication Date: 2018-01-16
NEUSOFT CORP
View PDF3 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

That is to say, when there is no sub-node that can satisfy all the resources required by the task to be allocated, the master node will always traverse the resource configuration information of each sub-node, even if there are resources required by other tasks in the task queue. Wh

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task distribution method and device, storage medium, equipment and distributed task system
  • Task distribution method and device, storage medium, equipment and distributed task system
  • Task distribution method and device, storage medium, equipment and distributed task system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] Specific embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to illustrate and explain the present disclosure, and are not intended to limit the present disclosure.

[0054] The present disclosure provides a distributed task system, and the distributed task system may include at least one client, a master node, and multiple sub-nodes.

[0055] In the present disclosure, the master node can store queues to be allocated and queues waiting for resources, and connect to each client and each sub-node respectively. After the client submits the task to the master node, the master node can add the received task to the queue of tasks to be assigned, and assign the tasks in the queue of tasks to be assigned to each sub-node to execute the corresponding tasks on each sub-node Task. In addition, the clients and sub-nodes in the dist...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a task distribution method, a task distribution device, a storage medium, equipment and a distributed task system. The method comprises the steps of determining a current taskto be distributed from a queue to be distributed; traversing resource configuration information of each sub-node on a main node according to a preset first traversal time according to resources needed by a current task to be distributed to determine whether the sub-node which can meet the resources needed by the current task to be distributed exists; when the sub-node capable of meeting the resources needed by the current task to be distributed does not exist, transferring the current task to be distributed to a waiting resource queue from the queue to be distributed, thus allowing the task to wait for distribution in the waiting resource queue. Therefore, the blocked task in the queue to be distributed can be timely transferred, so that the condition that the other tasks in the queue tobe distributed can be timely and sequentially distributed is ensured, task distribution efficiency in the queue to be distributed is improved, and task concurrent processing capability of the distributed task system and a resource utilization rate of each sub-node are enhanced.

Description

technical field [0001] The present disclosure relates to the technical field of the Internet, and in particular, to a task allocation method, device, storage medium, equipment, and distributed task system. Background technique [0002] A distributed task system usually consists of a master node, multiple sub-nodes, and at least one client, wherein the resources (CPU resources, graphics processing unit (Graphics Processing Unit, GPU) resources, memory resources, hard disk resources) between different sub-nodes etc.) The configuration may be different, and the resource configuration information of each sub-node is stored on the master node. When the master node allocates tasks, it usually first continuously adds tasks to the task queue of the master node, and the master node takes out the tasks to be assigned from the task queue, and finds the tasks that can meet the requirements by traversing the resource configuration information of each sub-node. The sub-nodes of the resou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50
Inventor 李向南于洋王冰倩
Owner NEUSOFT CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products