Custom Memory Modules for VM Resource Allocation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The challenge lies in efficiently managing and provisioning physical computing resources in large-scale data centers, where standard memory modules often lead to stranded resources due to mismatched processor and memory capacity ratios, resulting in inefficiencies and increased costs.

Innovation Solution

Implementing a fleet of servers with custom, non-standard sized memory modules that can host a variety of virtual computing resource instances with finer granularity in processor and memory configurations, allowing for better fitment of virtual CPU and memory capacity ratios, thereby reducing resource wastage and enhancing flexibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If standard memory modules are used in data centers, then device compatibility and ease of procurement are improved, but resource utilization efficiency deteriorates due to mismatched processor and memory capacity ratios

Engineering Contradiction:
Improveease of procurementVSAvoidresource utilization efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent changes the memory capacity parameter from standard values (8GB, 16GB, 32GB) to custom non-standard values (e.g., 12GB, 20GB, 24GB) to precisely match the processor memory capacity ratios required by different virtual machine configurations. This parameter customization eliminates the mismatch between processor and memory resources, allowing full utilization of purchased computing resources without stranded capacity.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If standard memory modules are used, then system simplicity is improved, but adaptability to diverse customer demands deteriorates

Engineering Contradiction:
Improvesystem simplicityVSAvoidadaptability to diverse customer demands
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system introduces custom memory capacity parameters (non-standard values) to adapt to diverse virtual machine configurations and customer demands. By offering memory modules in various custom capacities, the system can precisely match different processor-memory ratios required by various workloads, thereby enhancing versatility while maintaining manageable complexity through standardized custom modules.

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If standard memory modules are used, then cost efficiency in bulk purchasing is improved, but resource wastage increases due to stranded capacity

Engineering Contradiction:
Improvebulk purchasing efficiencyVSAvoidresource wastage
Core Design Contradiction:
Quantity of substanceVSLoss of substance

Solution Approach 1:

The patent changes memory capacity from standard discrete values to custom values that exactly match required ratios. This eliminates stranded memory capacity that would otherwise be purchased but unusable, ensuring that every dollar spent on memory directly contributes to usable computing resources. The custom modules reduce waste while maintaining bulk purchasing efficiency by ordering modules in the specific custom capacities needed.

Inventive Principle:
Principle #35Parameter changes

4Adaptability or versatility

If virtual machines are provisioned with varying memory capacities, then customer demand flexibility is improved, but resource allocation efficiency deteriorates due to mismatched physical resources

Engineering Contradiction:
Improvecustomer demand flexibilityVSAvoidresource allocation efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system uses custom memory modules with non-standard capacities (e.g., 12GB, 20GB, 24GB) to precisely match the memory requirements of different virtual machine configurations. This allows the physical memory resources to exactly align with the virtual machine provisions, eliminating gaps between allocated and available resources. The custom parameters enable flexible customer demands to be met while maintaining perfect resource allocation efficiency.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11509711B2Customized memory modules in multi-tenant provider systems
Publication Date: 2022.11.22 AMAZON TECH INC
  • US11509711B2 patent drawing
  • US11509711B2 patent drawing
  • US11509711B2 patent drawing

AI summary

A computing system providing virtual computing services may maintain a fleet of servers that host virtual machine instances having a wide variety of types and configurations. A service provider may rent processor and memory capacity by defining and offering various virtual machine instances to clients. Each virtual machine instance may include one or more virtual CPUs and a fixed amount of virtualized memory allocated to each virtual CPU, dependent on a predefined ratio between virtual CPU capacity and virtualized memory capacity for the instance type. Each server may include a custom, non-standard sized physical memory module containing memory devices of multiple technologies, types, or sizes on the same printed circuit board. By including custom memory modules, rather than relying only on standard memory modules, the service provider system may implement virtual machines having finer grained options for processor and memory capacity combinations, and may avoid stranding rentable resources.