Supercharge Your Innovation With Domain-Expert AI Agents!

Job scheduling method and apparatus

A job scheduling and job technology, applied in the Internet field, can solve the problems of reducing computing efficiency, resource occupancy, time waste, etc., and achieve the effect of improving computing efficiency

Inactive Publication Date: 2018-07-10
BEIJING GRIDSUM TECH CO LTD
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When the workload is large, it is possible that other non-local host resources will be fully occupied, which will cause the local host to calculate non-local jobs, while local jobs cannot be calculated on the local host.
However, due to the existence of data migration in non-localized computing, data migration will cause a waste of time, so the increase in non-localized computing will inevitably reduce the efficiency of computing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Job scheduling method and apparatus
  • Job scheduling method and apparatus
  • Job scheduling method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0023] In order to solve the problem of low computing efficiency in the Hadoop cluster caused by the scheduling mode of the existing scheduler, the embodiment of the present invention provides a method for job scheduling, such as figure 1 As shown, the method includes:

[0024] First of all, it needs to be explained that the job scheduling method in this embodiment can be applied to the scheduling of computer CPU memory resources, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a job scheduling method and apparatus, relates to the technical field of the internet, and solves the problem of calculation efficiency reduction caused by time waste due to data migration in non local calculation of an existing Hadoop cluster. The method comprises the steps of selecting idle Task Tracker nodes according to usage states of Task Tracker nodes of task scheduling; selecting a target Task Tracker node meeting a preset condition from the idle Task Tracker nodes; searching for a target job for the target Task Tracker node; and scheduling the target job to thetarget Task Tracker node for performing calculation. The job scheduling method and apparatus is suitably applied to the job scheduling process of the Hadoop cluster.

Description

technical field [0001] The present invention relates to the technical field of the Internet, in particular to a method and device for job scheduling. Background technique [0002] In the Hadoop cluster, the scheduler is a very important component, its function is to ensure the effective scheduling and execution of jobs in the entire cluster. There are usually multiple queues in a Hadoop cluster, each queue contains multiple jobs submitted by users, each job represents an application, and each job can contain multiple tasks. When the scheduler performs job scheduling, the usual scheduling method is: select a queue according to preset rules, then set priorities for jobs in the queue according to preset conditions, then schedule jobs in order of priority, and select Compute nodes that match it. Usually, matching computing nodes are selected in the order of local host resources, same-rack host resources, and other rack host resources. [0003] However, the scheduling method o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50
CPCG06F9/5038
Inventor 薛戬
Owner BEIJING GRIDSUM TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com