VM Instance Optimization Service for Heterogeneous Workloads

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Service providers face challenges in optimizing the selection and configuration of virtual machine (VM) instance types to support diverse workloads effectively, leading to underutilization or overutilization of computing resources, making it difficult for users to choose the appropriate VM instance type without a time-consuming trial-and-error process.

Innovation Solution

An optimization service that uses workload categorization based on resource utilization characteristics and performance metrics to recommend optimized VM instance types, and dynamically adjusts these recommendations as workload changes occur, ensuring efficient resource allocation and utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple different types of VM instances are offered to support diverse workloads, then workload performance and resource matching are improved, but device complexity and difficulty of selection increase for users

Engineering Contradiction:
Improveworkload support capabilityVSAvoidVM instance type selection complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically monitors workload performance metrics and resource utilization, then self-adjusts VM instance configurations without requiring manual user intervention. The optimization service continuously evaluates workload characteristics and autonomously selects or recommends appropriate VM instance types, freeing users from complex manual selection processes while maintaining adaptability to diverse workloads

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements continuous feedback loops by monitoring workload performance metrics, resource utilization patterns, and VM instance effectiveness. This feedback information is used to dynamically adjust VM instance configurations and provide intelligent recommendations, enabling the system to adapt to changing workload requirements while simplifying user decision-making through data-driven insights

Inventive Principle:
Principle #23Feedback

2Ease of operation

If VM instance configurations are manually selected without optimization guidance, then user control is maintained, but resource underutilization or overutilization occurs leading to inefficiency

Engineering Contradiction:
Improveuser control over VM selectionVSAvoidcomputing resource utilization efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

An optimization service acts as an intermediary between users and VM instance configurations. This mediator analyzes workload requirements and resource patterns, then provides intelligent recommendations that guide users toward optimal VM selections. The intermediary preserves user control and decision-making authority while incorporating expert optimization logic to improve resource utilization efficiency

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary analysis of workload characteristics, historical performance data, and resource utilization patterns before VM instance selection or configuration changes. By pre-evaluating multiple factors and preparing optimization recommendations in advance, the system enables users to make informed decisions that improve resource efficiency without sacrificing operational control

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If users undergo trial-and-error processes to select appropriate VM instance types, then customization and optimization are achieved, but time consumption and operational overhead increase

Engineering Contradiction:
ImproveVM instance workload matching precisionVSAvoidtime for VM selection and optimization
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The optimization service performs preliminary analysis of workload characteristics, performance requirements, and resource patterns before VM instance selection. By pre-evaluating multiple factors and preparing optimized recommendations in advance, the system eliminates the need for time-consuming trial-and-error processes while maintaining precise workload-VM matching

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system automatically monitors workload performance and resource utilization, then self-adjusts VM instance configurations without requiring manual trial-and-error experimentation. The optimization service continuously evaluates workload characteristics and autonomously selects appropriate VM instance types, significantly reducing the time and effort required for VM selection and optimization

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11068312B2Optimizing hardware platform utilization for heterogeneous workloads in a distributed computing environment
Publication Date: 2021.07.20 AMAZON TECH INC
  • US11068312B2 patent drawing
  • US11068312B2 patent drawing
  • US11068312B2 patent drawing

AI summary

Techniques for an optimization service of a service provider network to help optimize the selection, configuration, and utilization, of virtual machine (VM) instance types to support workloads on behalf of users. The optimization service may implement the techniques described herein at various stages in a life cycle of a workload to help optimize the performance of the workload, and reduce underutilization of computing resources. For example, the optimization service may perform techniques to help new users select an optimized VM instance type on which to initially launch their workload. Further, the optimization service may monitor a workload for the life of the workload, and determine new VM instance types, and/or configuration modifications, that optimize the performance of the workload. The optimization service may provide recommendations to users that help improve performance of their workloads, and that also increase the aggregate utilization of computing resources of the service provider network.