HPC Node Scheduling via Spatial Compactness Criteria

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High-Performance Computing (HPC) systems face challenges in scalability due to imbalanced processing, memory, and I/O bandwidth, leading to inefficiencies in cluster management and job scheduling, which affects the reliability and performance of large-scale scientific and engineering applications.

Innovation Solution

A method for scheduling in HPC systems that categorizes job requests as spatial, compact, or nonspatial and noncompact, generating and selecting node combinations that accommodate the requested number of nodes while optimizing for spatial relationships and proximity, thereby improving scheduling efficiency and reducing computational requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If conventional HPC cluster management is used with imbalanced processing, memory, and I/O bandwidth, then system complexity is reduced, but scalability and reliability deteriorate

Engineering Contradiction:
Improvecluster management complexityVSAvoidsystem reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent changes the parameter of node selection by introducing spatial and compactness criteria. Instead of arbitrary node selection, the system evaluates nodes based on their spatial relationships and compactness metrics, transforming the scheduling approach to achieve better scalability and reliability without proportionally increasing management complexity.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies asymmetry by treating different node configurations differently based on their spatial and compactness properties. Rather than using a uniform scheduling approach, the system asymmetrically evaluates and selects node combinations based on specific geometric and topological characteristics, leading to improved system performance.

Inventive Principle:
Principle #4Asymmetry

2Productivity

If spatial relationships and proximity are considered in node selection, then scheduling efficiency is improved, but computational requirements increase

Engineering Contradiction:
Improvescheduling efficiencyVSAvoidcomputational requirements
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing spatial relationships and compactness metrics for node combinations. This preparatory work allows the scheduling system to quickly evaluate and select optimal node assignments without performing complex computations during the actual scheduling moment, thus improving efficiency while managing computational load.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the scheduling problem into distinct evaluation criteria: spatial relationships, compactness metrics, and availability checks. By dividing the complex scheduling decision into separable components, the system can evaluate each aspect independently and combine results, improving overall scheduling efficiency while keeping individual computational requirements manageable.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8209395B2Scheduling in a high-performance computing (HPC) system
Publication Date: 2012.06.26 RAYTHEON CO
  • US8209395B2 patent drawing
  • US8209395B2 patent drawing
  • US8209395B2 patent drawing

AI summary

In one embodiment, a method for scheduling in a high-performance computing (HPC) system includes receiving a call from a management engine that manages a cluster of nodes in the HPC system. The call specifies a request including a job for scheduling. The method further includes determining whether the request is spatial, compact, or nonspatial and noncompact. The method further includes, if the request is spatial, generating one or more spatial combinations of nodes in the cluster and selecting one of the spatial combinations that is schedulable. The method further includes, if the request is compact, generating one or more compact combinations of nodes in the cluster and selecting one of the compact combinations that is schedulable. The method further includes, if the request is nonspatial and noncompact, identifying one or more schedulable nodes and generating a nonspatial and noncompact combination of nodes in the cluster.