Gradual VM Instance Optimization for Workload Resource Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in selecting appropriate VM instance types for their workloads, often resulting in underutilization or overutilization of computing resources due to the complexity and diversity of available options, and are hesitant to accept drastic recommendations for more optimized instance types.

Innovation Solution

An optimization service provides a gradual-optimization recommendation that progressively migrates workloads to increasingly optimized VM instance types, starting with similar types and offering performance data to build user trust, allowing users to control the transition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If users select from diverse VM instance types to meet different computing needs, then workload performance and resource matching improve, but system complexity and difficulty in selecting appropriate instances increase

Engineering Contradiction:
Improveworkload performanceVSAvoidselection complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically analyzes workload characteristics and recommends optimal VM instance types without requiring users to manually evaluate diverse options. The service provider's system performs self-service by gathering workload metrics, comparing them against instance type specifications, and generating recommendations, thereby eliminating the complexity burden from users while maintaining high adaptability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback loops where workload performance data is continuously collected and used to refine instance type recommendations. By monitoring actual workload characteristics and comparing them with predicted performance on different instance types, the system learns and improves its recommendations over time, resolving the contradiction between versatility and selection complexity.

Inventive Principle:
Principle #23Feedback

2Productivity

If users choose optimized VM instance types for specific workloads, then resource utilization improves, but risk of overutilization or underutilization increases due to incorrect selection

Engineering Contradiction:
Improveresource utilizationVSAvoidselection accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary analysis of workload characteristics before making instance type recommendations. By pre-evaluating workload metrics such as CPU usage patterns, memory requirements, and I/O characteristics, and comparing them against instance type capabilities, the system reduces the risk of incorrect selection. This preliminary action ensures that recommendations are based on thorough analysis, improving both resource utilization and selection accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously monitors workload performance on recommended instance types and uses this feedback to validate and refine future recommendations. By tracking actual resource utilization and workload performance, the system can identify patterns and adjust recommendations to avoid overutilization or underutilization, thereby improving reliability while maintaining high productivity.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If service providers offer multiple specialized VM instance types, then flexibility to meet diverse computing needs improves, but user hesitation to accept recommendations increases due to fear of drastic changes

Engineering Contradiction:
Improvecomputing resource flexibilityVSAvoiduser acceptance
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system provides partial optimization by recommending instance type changes that are incremental rather than drastic. Instead of immediately suggesting completely different instance types, the system recommends changes that maintain familiar characteristics while improving performance, or provides a range of options from conservative to aggressive optimizations. This partial action reduces user hesitation while still delivering the benefits of specialized instance types.

Inventive Principle:
Principle #16Partial or excessive action

4Productivity

If virtualization technologies are used to host multiple VM instances on single physical devices, then resource utilization increases, but complexity of managing and optimizing instance types increases

Engineering Contradiction:
Improveresource utilizationVSAvoidmanagement complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service automation for managing VM instance type optimization across virtualized environments. By automatically gathering resource utilization data from multiple VM instances on physical devices, analyzing workload characteristics, and generating coordinated recommendations, the system eliminates the manual management complexity. The self-service approach maintains high resource utilization through virtualization while removing the burden of managing instance type diversity.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12373231B1Gradual optimization of compute platforms for a workload
Publication Date: 2025.07.29 AMAZON TECH INC
  • US12373231B1 patent drawing
  • US12373231B1 patent drawing
  • US12373231B1 patent drawing

AI summary

Techniques for an optimization service to gradually host workloads of users on more optimized virtual machine (VM) instance types to allow users to gain confidence in recommendations provided by the optimization service. The techniques include providing users with a recommended order of VM instance types that gradually move from a current VM instance type towards more optimal VM instance types. The recommended order may initially recommend that the workload be hosted to a VM instance type that is slightly more optimized that the current VM instance type, but is fairly similar to the current VM instance type. The optimization service may then provide the user with performance data that illustrates how well the new VM instance type performed when hosting the workload. The user may gain trust in the recommendations by observing the performance metrics, and continue to use more optimized VM instance types in the recommended order.