Method and device for dispatching job task

A technology of job tasks and scheduling methods, applied in the computer field, can solve problems such as memory overflow, network congestion, downtime, etc., and achieve the effects of avoiding resource waste, increasing the amount of processed data, and improving throughput

Inactive Publication Date: 2013-04-03
BEIJING IZP NETWORK TECH CO LTD
View PDF3 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In the prior art, the scheduler schedules job tasks based on the CPU computing cores of the computing nodes. In this way, in some cases, although there are idle CPU computing cores on the computing nodes, when there is a large amount of data on it for computing , it is inevitable that there will be memory overflow, network congestion or direct downtime
When any of the above phenomena occurs on the computing node, the job task on the corresponding computing node will fail to process, and the failed job task needs to be reassigned to other computing nodes by the scheduler for processing. Therefore, at this time, the computer cluster The amount of data processed per unit time will be affected, that is, it will easily lead to a decrease in the throughput of the computer cluster

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for dispatching job task
  • Method and device for dispatching job task
  • Method and device for dispatching job task

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to make the above objects, features and advantages of the present application more obvious and comprehensible, the present application will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0050] refer to figure 1 , which shows a flow chart of Embodiment 1 of a job task scheduling method of the present application, which may specifically include:

[0051] Step 101, collecting hardware resource information of each computing node;

[0052] Step 102 , scheduling the job task to be allocated to a computing node whose hardware resource information is less than a preset threshold; the preset threshold is used to indicate a limit value of failure of the hardware resource of the computing node.

[0053] In this embodiment of the present application, a preset threshold value is used to represent a limit value of a hardware resource failure of a computing node. If the hardware resource information ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method and device for dispatching a job task. The method particularly comprises the steps as follows: collecting hardware resource information of compute nodes; and dispatching the job task to be distributed to the compute node with the hardware resource information less than a preset threshold value, wherein the preset threshold value is used for representing a failure occurrence limit value of the hardware resource of the compute node. According to the method, the throughput rate of a computer cluster can be increased.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a method and device for scheduling job tasks. Background technique [0002] A computer cluster is a computer system that connects multiple computers (also known as computing resources, such as software and / or hardware resources) to cooperate in completing computing tasks. These computing resources are located in the same management domain, which has a unified management policy and provides services to users as a whole. Hadoop is such a distributed system cluster architecture, which can achieve high-efficiency parallel computing and massive storage. [0003] Computer clusters can achieve higher efficiency through multiple computers completing the same job. For example, when using the MapReduce (mapping simplification) model for parallel computing of large-scale data, a MapReduce job (that is, a computing request from a user) needs to be split into multiple Map tasks ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
Inventor 高印会罗峰黄苏支李娜
Owner BEIJING IZP NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap