Task scheduling method and task scheduling device

A task scheduling and task technology, applied in the direction of multi-program device, program control design, instrument, etc., can solve the problems of low task execution efficiency and inability to be processed in time

Active Publication Date: 2016-06-29
INSPUR BEIJING ELECTRONICS INFORMATION IND
View PDF5 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a task scheduling method and device to solve the problem in the prior

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scheduling method and task scheduling device
  • Task scheduling method and task scheduling device
  • Task scheduling method and task scheduling device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0045] see figure 1 , which shows a flowchart of a task scheduling method provided by an embodiment of the present invention, which may include the following steps:

[0046] S1: Obtain the request information of the working node, which is the information of the request task sent when the working node has an idle work slot.

[0047] The task scheduling method and device provided by the embodiments of the present invention can be specifically applied to Hadoop ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a task scheduling method and a task scheduling device, wherein the method comprises the following steps of obtaining request information of TaskTrackers, wherein the request information is task requesting information sent when the TaskTrackers have an idle work groove; calculating the resource consumption features and the rest task proportion of each task queue, wherein the resource construction feature of any one task queue is obtained through calculation according to the CPU (Central Processing Unit) occupation rate, the memory occupation rate and the bandwidth occupation rate of operating tasks in the task queue, and the rest task proportion of any one task queue is the ratio value of non-operating tasks to all of the tasks in the task queue; selecting the task array achieving the effect that the product of the resource consumption feature and the rest task proportion in the task queue is not smaller than that of other task queues as a target task queue; and processing the non-operating tasks in the target task queue by using the idle work groove. Therefore the non-operating tasks in the task queue in urgent need of being processed are preferably processed, and the task execution efficiency is greatly improved.

Description

technical field [0001] The present invention relates to the technical field of big data Hadoop cluster scheduling, and more specifically, to a task scheduling method and device. Background technique [0002] Hadoop is a distributed system infrastructure. With the application of Hadoop more and more widely, it faces more and more problems, including the problems faced when implementing task scheduling. [0003] Specifically, the default job scheduling algorithm under the Hadoop platform in the prior art is mainly the FIFO (FirstInputFirstOutput, first-in-first-out) algorithm, that is, when tasks need to be scheduled, the tasks are scheduled according to the first-in-first-out principle. The task of is the first existing task among the unprocessed tasks, thereby achieving fairness in terms of time in the process of scheduling tasks. However, the inventor found that scheduling tasks according to the first-in-first-out algorithm only considers the fairness of time, but does not...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/50G06F9/48
CPCG06F9/4881G06F9/5038
Inventor 苏志远亓开元
Owner INSPUR BEIJING ELECTRONICS INFORMATION IND
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap