Predictive VM Rightsizing via Machine Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud computing systems face inefficiencies in resource management for virtual machines due to underutilization of allocated resources, as conventional rightsizing methods require monitoring for extended periods, which is not feasible for short-lived VMs, leading to suboptimal resource allocation and utilization.

Innovation Solution

A predictive rightsizing system using a machine learning model within a resource manager to generate predicted resource utilization based on past behaviors and features of previous VM deployments, allowing for instantaneous rightsizing recommendations with confidence scoring to determine deployment configurations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If conventional rightsizing methods are used to determine optimal VM resource allocation, then resource utilization efficiency is improved, but the monitoring period required is extended which is not feasible for short-lived VMs

Engineering Contradiction:
Improveresource utilization efficiencyVSAvoidmonitoring period
Core Design Contradiction:
Loss of energyVSLoss of time

Solution Approach 1:

The system performs preliminary rightsizing analysis using machine learning models trained on historical deployment data before the actual VM deployment occurs. This allows the system to predict optimal resource allocation in advance, eliminating the need for extended monitoring periods after deployment while maintaining high resource utilization efficiency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a virtual copy of the deployment environment and uses machine learning models to simulate and analyze resource utilization patterns based on historical data from similar previous deployments. This copying approach allows rightsizing determination without requiring actual extended monitoring of the specific VM instance.

Inventive Principle:
Principle #26Copying

2Reliability

If resources are allocated to VMs to ensure adequate capacity, then VM performance is maintained, but resources may be under-utilized resulting in inefficiency

Engineering Contradiction:
ImproveVM performanceVSAvoidresource utilization efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system dynamically adjusts VM resource allocation by continuously monitoring actual resource utilization patterns and comparing them against predicted values. When discrepancies are detected, the system automatically rightsizes the VM configuration, allowing resources to be optimized while maintaining performance through adaptive adjustments rather than static over-provisioning.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements a feedback mechanism where actual resource utilization data from deployed VMs is continuously collected and fed back into the machine learning models. This feedback loop enables the system to learn from real-world performance data and improve future rightsizing recommendations, balancing performance requirements with resource utilization efficiency.

Inventive Principle:
Principle #23Feedback

3Productivity

If predictive rightsizing is implemented using machine learning models, then resource allocation efficiency is improved, but system complexity increases

Engineering Contradiction:
Improveresource allocation efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements a universal machine learning-based rightsizing engine that can analyze multiple types of workloads and VM configurations through a single integrated platform. This multi-functional approach consolidates what would otherwise require multiple separate tools and processes, managing system complexity while providing comprehensive predictive rightsizing capabilities across diverse cloud computing scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10942760B2Predictive rightsizing for virtual machines in cloud computing systems
Publication Date: 2021.03.09 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10942760B2 patent drawing
  • US10942760B2 patent drawing
  • US10942760B2 patent drawing

AI summary

Various embodiments, methods, and systems for implementing a predictive rightsizing system are provided. Predicted rightsized deployment configurations are generated for virtual machine “VM” deployments having deployment configurations that are modified to predicted rightsized deployment configurations based on a prediction engine. In operation, a VM deployment, associated with a request to deploy one or more VMs on a node, is accessed at a predictive rightsizing controller. A predicted resource utilization for the VM deployment is generated at the prediction engine and accessed at the predictive rightsizing controller. The predicted resource utilization is generated based on a prediction engine that uses past behaviors and features associated with previous VM deployments. Based on the predicted resource utilization, a predicted rightsized deployment configuration is generated for the VM deployment. The predicted rightsized deployment configuration is communicated such that the request to deploy the VMs is executed based on the predicted rightsized deployment configuration.