Bandwidth-Aware Process Scheduling for Data Center Rack Utilization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data centers face inefficiencies due to underutilized computing resources caused by unused network bandwidth, leading to suboptimal utilization of computing devices.

Innovation Solution

Implementing a network bandwidth-aware scheduler that schedules processes based on expected network bandwidth usage values, matching them with server racks having available bandwidth closest to the required values, thereby optimizing network bandwidth utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If processes are scheduled without considering network bandwidth usage, then scheduling simplicity is maintained, but network bandwidth utilization becomes inefficient

Engineering Contradiction:
Improvescheduling system complexityVSAvoidnetwork bandwidth utilization
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The scheduling system incorporates network bandwidth usage as an additional parameter for process scheduling decisions. The system determines expected network bandwidth usage values for processes and matches them with server racks having corresponding available bandwidth, transforming the scheduling approach from simple to bandwidth-aware while improving utilization efficiency

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs preliminary determination of expected network bandwidth usage values for processes before scheduling them. By pre-calculating bandwidth requirements and pre-identifying suitable server racks with matching available bandwidth, the system optimizes the scheduling decision-making process and improves network bandwidth utilization

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If network bandwidth usage is not monitored and matched, then system operation simplicity is maintained, but computing resource utilization deteriorates

Engineering Contradiction:
Improvesystem operation simplicityVSAvoidcomputing resource utilization
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The system introduces network bandwidth usage as a scheduling parameter and automatically matches processes with server racks based on bandwidth characteristics. This automated parameter-based matching improves computing resource utilization while maintaining ease of operation through systematic, rule-based scheduling decisions

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system implements feedback mechanisms by monitoring actual network bandwidth usage and using this information to improve future scheduling decisions. The system learns from historical bandwidth usage patterns to better match processes with appropriate server racks, enhancing computing resource utilization through continuous optimization

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12568136B2Network bandwidth-aware process scheduling in data centers
Publication Date: 2026.03.03 NVIDIA CORP
  • US12568136B2 patent drawing
  • US12568136B2 patent drawing
  • US12568136B2 patent drawing

AI summary

A computing device determines an expected network bandwidth usage value for a set of processes. The computing device further determines an available network bandwidth value for one or more server rack amongst multiple server racks, and selects a first server rack having an available network bandwidth value closest to the expected network bandwidth usage value. The first server rack includes a first set of servers, and the computing device further determines whether a first server of the first set of servers is available. Responsive to determining the first server is available, the computing device assigns the set of processes to the first server.