Unified Resource Manager for Multi-Scheduler Workload Allocation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The allocation and distribution of resources among diverse workloads in managed enterprise clusters is arduous due to the need for complex and bespoke scheduler modifications to support various workload types such as containers and virtual machines, and introducing a new scheduler to the cluster is an intensive process.
Innovation Solution
A unified resource management architecture with a scheduler-agnostic standardized resource manager that performs operations for multiple schedulers using a unified interface, reducing the complexity of updates and enabling extensible resource management across different workload types.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If complex and bespoke scheduler modifications are made to support various workload types, then the capability to support diverse workloads is improved, but the device complexity increases
Solution Approach 1:
The system is segmented into distinct components: a primary scheduler for default workload management and secondary workload schedulers for specific workload types. Each scheduler operates independently with specialized responsibilities, eliminating the need for complex modifications to a single monolithic scheduler while maintaining support for diverse workloads.
Solution Approach 2:
A resource manager acts as an intermediary between the primary scheduler and secondary workload schedulers. It receives resource allocation requests from multiple schedulers, manages resource pools, and coordinates allocations to prevent conflicts. This mediator layer enables multiple schedulers to coexist without direct interactions or complex integration logic.
2Adaptability or versatility
If a new scheduler is introduced to the cluster that co-exists with the primary scheduler, then the versatility of workload support is improved, but the ease of operation deteriorates
Solution Approach 1:
The resource manager provides universal resource management capabilities that serve all workload schedulers through a common interface. It manages resource pools that can be allocated to any scheduler type, enabling the system to support multiple workload types without requiring separate management mechanisms for each scheduler.
Solution Approach 2:
The resource manager serves as an intermediary that abstracts the complexity of multi-scheduler coordination. Secondary workload schedulers interact with the resource manager through standardized interfaces rather than directly with the primary scheduler or other secondary schedulers, simplifying the integration process and making the system easier to operate.
3Adaptability or versatility
If scheduler modifications are made to support various workload types, then the adaptability is improved, but the ease of repair deteriorates
Solution Approach 1:
By segmenting the scheduling system into independent primary and secondary schedulers, each with specialized functions, updates or repairs can be applied to individual components without affecting the entire scheduling system. The resource manager similarly operates as an independent component that can be updated separately, maintaining ease of repair while supporting workload diversity.
Data Source
AI summary
Various aspects are disclosed for unified resource management for multiple workload schedulers. A resource manager receives a candidate host request from a workload scheduler. The resource manager transmits a set of candidate host snapshots for candidate hosts that match the workload resource requirements. The resource manager receives a workload allocation request for a host and reserves hardware resources on the host that match the workload resource requirements. The resource manager provides, to the workload scheduler, an indication that the hardware resources are successfully reserved for execution of the workload.