Container Management Workload Scheduling via Resource Ratios

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In container management systems like Kubernetes, determining the optimal workload instance for an application when no specific workload instance is indicated in the deployment specification is challenging, as there is no clear method to determine which node type (general purpose, computing optimized, memory optimized, or EBS optimized) is best suited for the application.

Innovation Solution

The system calculates the memory to CPU ratio for the application and schedules it to memory optimized instances if the ratio is high, computing optimized instances if the ratio is low, and EBS optimized instances if the ratio falls within a predetermined range, ensuring optimal node placement based on resource requirements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the system schedules applications without explicit workload specifications, then deployment simplicity is improved, but scheduling accuracy deteriorates

Engineering Contradiction:
Improvedeployment simplicityVSAvoidscheduling accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system automatically determines workload characteristics by monitoring actual resource consumption patterns of applications, eliminating the need for manual workload classification. The scheduler self-determines which node type (general purpose, computing optimized, memory optimized, or EBS optimized) to assign based on observed behavior, achieving both simplicity and accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors application resource usage and uses this feedback to refine scheduling decisions. By observing actual memory-to-CPU ratio consumption patterns and adjusting schedules accordingly, the system improves scheduling accuracy over time while maintaining ease of deployment.

Inventive Principle:
Principle #23Feedback

2Productivity

If the system monitors and calculates resource ratios for all applications, then scheduling optimization is improved, but system complexity increases

Engineering Contradiction:
Improvescheduling optimizationVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system extracts only the essential scheduling decision logic from the complex monitoring infrastructure. By separating the core scheduling function from detailed monitoring, the system achieves optimization without proportionally increasing complexity, using extracted key metrics (memory-to-CPU ratio) for decision-making.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system transforms complex multi-dimensional resource monitoring data into a single key parameter (memory-to-CPU ratio) that drives scheduling decisions. This parameter transformation simplifies the scheduling algorithm while maintaining optimization effectiveness, reducing computational complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11169856B2Container management
Publication Date: 2021.11.09 HEWLETT PACKARD ENTERPRISE DEV LP
  • US11169856B2 patent drawing
  • US11169856B2 patent drawing
  • US11169856B2 patent drawing

AI summary

In some examples, container management can include a non-transitory computer readable medium having instructions, the instructions executable by a processing resource to receive a deployment specification for operating the application within the container management system, determine whether the deployment specification includes a specified workload for scheduling the application, determine, in response to the deployment specification not including a specified workload for scheduling the application, a workload ratio associated with the application, determine a schedule in response to the determined workload ratio, and schedule the application across a plurality of nodes within the container management system based on the determined schedule.