Multi-queue task scheduling method and related system and equipment

A task scheduling and multi-queue technology, applied in the communication field, can solve the problems of not supporting queue priority and inability to differentiate resource allocation of job queues, etc., and achieve the effect of optimizing resource allocation

Inactive Publication Date: 2011-06-15
CHINA MOBILE COMM GRP CO LTD
View PDF1 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a multi-queue task scheduling method, a data processing system and a scheduling node device, which are used to solve the problem that the priority of queues is not supported in the existing multi-queue task scheduling process, resulting in the inability to perform differentiated resource allocation for each job queue

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-queue task scheduling method and related system and equipment
  • Multi-queue task scheduling method and related system and equipment
  • Multi-queue task scheduling method and related system and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] The job queue sorting principles provided in this embodiment include the following:

[0043] Job queues that need to reclaim resources are prioritized over job queues that do not need to be reclaimed. If the resource usage of the job queue is less than the set usage threshold, the job queue is a queue that needs to reclaim resources. If the resource usage of the job queue is greater than or is equal to the set usage threshold, the job queue is a queue that does not need to reclaim resources;

[0044] The job queues that need to reclaim resources are sorted by resource usage from low to high;

[0045] The job queues that do not need to reclaim resources are sorted by priority from high to low, and the job queues with the same priority are sorted by resource usage from low to high.

[0046] Based on the above-mentioned job queue sorting principles, this embodiment provides a corresponding multi-queue task scheduling process, as shown in Figure 4 shown, including the fo...

Embodiment 2

[0061] The job queue sorting principles provided in this embodiment include the following:

[0062] Job queues that need to reclaim resources are prioritized over job queues that do not need to reclaim resources;

[0063] For job queues that need to reclaim resources, tasks are assigned to the job queue corresponding to the currently successfully executed task, and other job queues are sorted by resource usage from low to high;

[0064] The queues that do not need to reclaim resources are sorted by priority from high to low, and the job queues with the same priority are sorted by resource usage from low to high.

[0065] Based on the above-mentioned job queue sorting principles, this embodiment provides a corresponding multi-queue task scheduling process, as shown in Figure 5 shown, including the following steps:

[0066] S501. After the task execution node successfully executes the current task, it reports the task execution status information to the scheduling node;

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-queue task scheduling method and related system and equipment, which are used for solving the problem that differential resource allocation cannot be performed for each job queue because the priority of the queue is not supported during the conventional multi-queue task scheduling. The multi-queue task scheduling method comprises the following steps that: a scheduling node judges whether a job queue with a resource utilization ratio less than a set utilization ratio threshold exists or not when a task acquisition request transmitted by a task execution node is received; if the job queue is available, the scheduling node schedules a task to the task execution node from the job queue with the resource utilization ratio less than the utilization ratio threshold; and if the job queue is not available, the scheduling node schedules the task to the task execution node from the job queue with the highest priority.

Description

technical field [0001] The present invention relates to data processing technology in the communication field, in particular to a multi-queue task scheduling method and related systems and equipment. Background technique [0002] MapReduce is a distributed parallel programming system for processing large-scale data sets. By defining the corresponding mapping (Map) and simplification (Reduce) functions, the function of distributed data processing can be realized. The MapReduce system includes a scheduling node (JobTracker) and several task execution nodes (TaskTracker). Its network architecture is as follows: figure 1 As shown, in which: the client (Client) is used to submit the parallel processing job (Job) arranged by the user to the scheduling node; the scheduling node automatically decomposes the job submitted by the client into multiple jobs with the same processing function (but the input data may be different ) Map task and multiple Reduce tasks with the same processi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/46G06F9/50
Inventor 孙宏伟郭磊涛卢正新
Owner CHINA MOBILE COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap