VM Instance Suitability Scoring for Workload Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Service providers face challenges in determining the suitability of virtual machine (VM) instance types for workloads, leading to potential overutilization or underutilization of computing resources, which can result in performance issues and wasted resources due to the difficulty in selecting the appropriate VM instance type that is optimized for specific workload needs.

Innovation Solution

A service provider network generates suitability scores for VM instance types based on utilization data, using machine-learning models to recommend optimized VM instance types that better match the resource requirements of workloads, thereby improving resource allocation and performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If service providers offer multiple VM instance types with different resource allocations, then users gain flexibility to choose optimized instances for their needs, but determining the suitability of VM instance types becomes more complex

Engineering Contradiction:
Improveflexibility in choosing VM instance typesVSAvoiddifficulty in determining suitability
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements feedback mechanisms by collecting utilization data from workloads running on VM instances and using this data to generate suitability scores. The suitability scores provide feedback to users about how well-suited a particular VM instance type is for their workload, enabling informed decision-making. This feedback loop resolves the contradiction by making the selection process data-driven rather than complex and uncertain.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system enables self-service by automatically generating suitability scores and recommendations without requiring users to manually analyze complex resource allocation parameters. The service provider network autonomously evaluates VM instance suitability based on collected utilization data and machine learning models, allowing users to simply consume the recommendations rather than perform complex analysis themselves.

Inventive Principle:
Principle #25Self-service

2Productivity

If users select VM instance types without accurate suitability information, then resource allocation decisions are made quickly, but resource wastage occurs due to overutilization or underutilization

Engineering Contradiction:
Improvespeed of VM selectionVSAvoidresource wastage
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system performs preliminary actions by collecting utilization data and generating suitability scores before users make VM instance selection decisions. Machine learning models are trained in advance on historical utilization data to predict optimal VM instance types. This preliminary preparation enables users to make both quick and accurate selections, avoiding resource wastage without sacrificing selection speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system replaces manual resource allocation analysis with automated machine learning models. Instead of users manually evaluating resource requirements against VM specifications, the system uses trained models to automatically predict suitable VM instance types based on workload characteristics. This substitution maintains rapid decision-making while improving accuracy and reducing resource wastage.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If service providers collect and analyze utilization data to determine VM instance suitability, then resource allocation accuracy improves, but system complexity and processing requirements increase

Engineering Contradiction:
Improveaccuracy in determining VM instance suitabilityVSAvoidcomplexity of data collection and analysis system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements a universal machine learning framework that handles multiple VM instance types, workload characteristics, and resource metrics through a single unified model. This multi-functional approach improves measurement precision across diverse scenarios while avoiding the need to build separate analysis systems for each VM type or workload category, thereby controlling system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system manages complexity by dynamically adjusting parameter importance and model complexity based on available data quality and specific use cases. The machine learning models can adapt their parameter selection and processing depth, allowing high precision when data is abundant while reducing computational overhead when data is limited, thus balancing accuracy with system complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11307885B1Identifying optimized computing resources for running workloads
Publication Date: 2022.04.19 AMAZON TECH INC
  • US11307885B1 patent drawing
  • US11307885B1 patent drawing
  • US11307885B1 patent drawing

AI summary

Techniques for a service provider network to generate suitability scores that indicate how well VM instance types are performing given the workloads they are running. Using these suitability scores, users are able to easily determine the suitability of VM instance types for supporting their workloads, and diagnose potential issues with the pairings of VM instance types and workloads, such as over-utilization and under-utilization of VM instances. Further, the techniques include training a model to determine VM instance types recommended for supporting workloads. The model may receive utilization data representing resource-usage characteristics of the workload as input, and be trained to output one or more recommended VM instance types that are optimized or suitable to host the workload. Thus, the service provider network may provide users with easily-digestible suitability scores indicating the suitability of VM instance types for workloads along with VM instance types recommended for their workloads.