Offload Device for Virtual Machine Instance Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The limited availability of physical computing resources in data centers due to the consumption of resources by virtual machine instances hinders the efficient utilization of computing resources, leading to increased costs and reduced availability for additional instances.

Innovation Solution

An offload device is used to manage and emulate virtual components, reducing the need for physical computing resources on the host device by instantiating virtual machines and virtual components separately, with the offload device handling I/O operations and communicating with virtual machine instances through a high-speed interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If virtual machine instances are managed using software applications on physical computing devices, then virtual machine functionality is provided, but physical computing resources are consumed limiting available capacity for additional instances

Engineering Contradiction:
Improvevirtual machine instance capacityVSAvoidphysical computing resources
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent extracts the resource-intensive virtual machine management functionality from the physical computing devices and relocates it to a dedicated virtualization appliance. This separation allows the physical computing devices to retain full resources for running virtual machine instances, while the appliance handles management operations, thereby increasing overall instance capacity without consuming additional physical computing resources on the host devices.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The virtualization appliance acts as an intermediary between the physical computing devices and the virtual machine instances. It manages the creation, configuration, and lifecycle of virtual machine instances without requiring software applications on the physical devices, thus reducing resource consumption on hosts and enabling higher virtual machine instance capacity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If hardware resources are upgraded to provide more computing resources, then virtual machine capacity increases, but costs increase considerably

Engineering Contradiction:
Improvevirtual machine instance capacityVSAvoidhardware upgrade cost
Core Design Contradiction:
ProductivityVSEase of manufacture

Solution Approach 1:

The virtualization appliance provides multi-functional capabilities including virtual machine instance management, emulated device provisioning, and resource allocation. This single device performs multiple functions that would otherwise require separate hardware upgrades, thereby increasing virtual machine capacity without the need for costly hardware upgrades to individual physical computing devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses virtual emulated devices that are software-based copies of physical hardware components. These virtual devices are instantiated on the virtualization appliance and provided to virtual machine instances, eliminating the need for physical hardware upgrades while maintaining full functionality.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If virtual machine instances consume physical computing resources, then virtualization functionality is provided, but availability of resources for additional instances is reduced

Engineering Contradiction:
Improvevirtualization functionalityVSAvoidavailable resource capacity
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system segments virtualization functionality into two parts: resource-intensive virtual machine instance execution on physical computing devices, and management operations on a dedicated virtualization appliance. This segmentation allows physical devices to focus on running instances with minimal overhead, while the appliance handles management, thereby maximizing available resource capacity for additional instances.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The virtualization appliance autonomously manages virtual machine instance creation, configuration, and resource allocation without requiring software agents on physical computing devices. This self-service approach eliminates the need for resource-consuming management software on hosts, maximizing available capacity for additional virtual machine instances.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10768972B2Managing virtual machine instances utilizing a virtual offload device
Publication Date: 2020.09.08 AMAZON TECH INC
  • US10768972B2 patent drawing
  • US10768972B2 patent drawing
  • US10768972B2 patent drawing

AI summary

Generally described, the present application relates to systems and methods for the managing virtual machines instances using a physical computing device and an offload device. The offload device can be a separate computing device that includes computing resources (e.g., processor and memory) separate from the computing resources of the physical computing device. The offload device can be connected to the physical computing device via a bus interface. The bus interface can be a high speed, high throughput, low latency interface such as a Peripheral Component Interconnect Express (PCIe) interface. The offload device can be used to offload virtualization and processing of virtual components from the physical computing device, thereby increasing the computing resources available to the virtual machine instances.