Workload Placement Special Purpose Accelerator Requirements

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing computing systems face inefficiencies in workload placement across hybrid public-private computing environments due to varying hardware capabilities and resource availability, leading to suboptimal performance and resource utilization.

Innovation Solution

An infrastructure manager system that utilizes an available infrastructure repository and performance metrics repository to identify and place workloads on infrastructure that meets special purpose hardware requirements, dynamically migrating workloads based on changing resource conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If workloads are placed on general-purpose infrastructure without considering special purpose hardware requirements, then infrastructure utilization is maintained, but workload performance is suboptimal

Engineering Contradiction:

Improveworkload performanceVSAvoidinfrastructure management complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system continuously monitors infrastructure characteristics and workload performance metrics, using this feedback to dynamically adjust workload placement decisions. The infrastructure manager collects data about special purpose hardware availability and performance, then uses this information to optimize workload distribution across the hybrid infrastructure.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system pre-identifies and catalogs special purpose hardware resources in the infrastructure before workload placement decisions are made. By maintaining an updated inventory of accelerators, FPGAs, and other specialized components, the system can proactively match workloads to appropriate hardware rather than reacting to performance issues after placement.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If workloads are dynamically migrated based on changing resource conditions, then resource utilization is optimized, but system complexity increases

Engineering Contradiction:

Improveresource allocation flexibilityVSAvoidworkload management system complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The infrastructure manager serves multiple functions within a single system: it discovers infrastructure resources, characterizes special purpose hardware, places workloads, monitors performance, and executes migrations. This multi-functional approach consolidates complexity into a unified management plane rather than requiring separate systems for each function.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically performs workload migration decisions and executions based on monitored conditions without requiring manual intervention. The infrastructure manager self-adjusts workload placement in response to changing resource availability and performance conditions, enabling the system to serve itself rather than requiring external management for each change.

Inventive Principle:

Principle #25Self-service

3Productivity

If special purpose hardware is used for workload placement, then computing efficiency improves, but infrastructure requirements become more stringent

Engineering Contradiction:

Improvecomputing efficiencyVSAvoidinfrastructure compatibility

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The system applies different placement strategies to different workloads based on their specific hardware requirements. Rather than requiring all infrastructure to have special purpose hardware, it identifies and utilizes specialized components only where needed for specific workload types, while allowing general-purpose infrastructure to handle workloads that don't require acceleration.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts workload placement parameters based on the characteristics of available infrastructure. When special purpose hardware is available and appropriate for a workload, the system changes placement decisions to utilize these resources. When such hardware is unavailable or unsuitable, the system adapts by placing workloads on general-purpose infrastructure, thus changing placement parameters based on infrastructure conditions.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS12135629B2Workload placement based on special purpose accelerator requirements and performance metrics

Publication Date: 2024.11.05 DELL PROD LP

AI summary

An infrastructure manager for placing workloads for performance across available infrastructure including on-demand infrastructure and dedicated infrastructure includes a storage device for storing an available infrastructure repository and a processor. The processor obtains a workload placement request for a workload of the workloads; makes a determination that the workload has a special purpose hardware requirement; in response to the determination: identifies, using the available infrastructure repository, potential placement locations in the available infrastructure for the workload that each meet the special purpose hardware requirement; and places the workload at one of the potential placement locations.