Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A computer cluster job scheduling method and system

A job scheduling and computer technology, applied in the computer field, can solve the problems of inability to maximize the use of available computing resources to maximize benefits, inability to meet data transmission delays, network congestion, etc., to improve system resource utilization and allocation strategies. Reasonable and avoid clogging effect

Active Publication Date: 2016-12-14
LENOVO (BEIJING) LTD
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The object of the present invention is to provide a computer cluster job scheduling method and system, which is used to solve the problem that in the prior art, the allocation strategy for assigning jobs to nodes can no longer meet the delay of data transmission or network problems encountered in the large-scale computing process. problems such as congestion, and the inability to maximize the use of available computing resources to maximize benefits

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A computer cluster job scheduling method and system
  • A computer cluster job scheduling method and system
  • A computer cluster job scheduling method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] In order to make the purpose, technical features and implementation effects of the present invention clearer, the technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0022] In the embodiment provided by the present invention, a computer cluster job scheduling system is provided, such as figure 1 shown, including:

[0023] Computing unit blocks 101, each of which is connected to a core switch (InfiniBand switch) 102 for completing tasks of computing and / or transmitting data.

[0024] The core switch 102 is configured to, for a computing unit block 101, collect the working parameters of the computing unit block 101 through the connection with the computing unit block 101, set a weight for each working parameter, according to the working parameters and the corresponding The weight value is to compile the load balance index corresponding to each computing unit block 101; acc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a computer cluster job scheduling method and system, wherein the system includes: at least one computing unit block, each computing unit block is connected to a core switch for completing jobs and / or transmitting data tasks; the core switch, and The calculation unit block connection is used to collect the working parameters of the calculation unit block, set a weight value for each work parameter, and compile the load balance index corresponding to each calculation unit block according to the work parameters and corresponding weight values; according to the predetermined strategy, according to the load A balance index assigns jobs and / or transfers data tasks to blocks of computing units. Applying the above technical solution, assigning jobs to multiple computing unit blocks reduces the workload of the job system administrator for a cluster system with relatively large nodes, improves the operating efficiency of the job management system, and avoids a certain port The congestion of cross-switch port data exchange caused by too busy or idle makes the allocation strategy more reasonable.

Description

technical field [0001] The invention relates to computer technology, in particular to a method and system for computer cluster job scheduling. Background technique [0002] With the increasing demand for computing, the scale of computer clusters used for computing is also increasing. The cluster based on the diskless working mode has become an inevitable trend in the development of high-performance clusters. In the diskless cluster, all computing nodes Operations such as communication, data access, and access are all performed through the switch. The data throughput of the switch will be very large, and the interaction between ports will be very frequent. If the cluster is relatively large, there will be hundreds or thousands of computing nodes. These nodes are connected through multiple edge switches and core switches, and the network topology formed is extremely complex, so data transmission between nodes across switches will be significantly delayed. [0003] In the prio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06
Inventor 张静杨琪
Owner LENOVO (BEIJING) LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com