Virtualization Memory Extension Using External Memory Pools
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computing systems face challenges when memory usage nearly equals or exceeds available local primary memory, leading to inefficiencies and limitations.
Innovation Solution
A scalable external memory system is introduced, allowing dynamic allocation and sharing of primary memory across multiple machines, enabling on-demand scaling without performance irregularities, and supporting migration of applications between physical machines while preserving metadata.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If local primary memory capacity is increased to handle high memory usage scenarios, then system reliability and performance are improved, but device complexity and cost increase
Solution Approach 1:
The patent extends memory capacity from a single-machine local storage dimension to a multi-machine distributed external memory dimension. Virtualization instances can allocate memory from external memory pools located on different physical machines, effectively adding a spatial dimension to memory availability without increasing local hardware complexity.
Solution Approach 2:
External memory pools serve multiple functions simultaneously: they provide extended memory capacity for virtualization instances, enable memory sharing across multiple machines, support migration of virtualization instances between hosts, and maintain persistent metadata. This multi-functionality reduces the need for separate specialized components.
2Quantity of substance
If external memory is used to extend virtualization instance memory, then memory scalability is improved, but access speed and latency may worsen
Solution Approach 1:
The patent segments memory access operations into different paths based on memory location. Frequently accessed memory pages are kept in local memory or cached, while less frequently accessed data resides in external memory. The system intelligently routes access requests through appropriate paths, maintaining high speed for critical operations while providing extended capacity for less time-sensitive data.
Solution Approach 2:
The patent introduces memory management components and caching mechanisms as intermediaries between virtualization instances and external memory pools. These intermediaries buffer and manage data transfer, reducing the direct impact of remote memory access latency on application performance while maintaining the benefits of extended memory capacity.
3Productivity
If memory is dynamically allocated across multiple machines, then resource utilization efficiency is improved, but system complexity increases
Solution Approach 1:
The patent implements feedback mechanisms where memory management components continuously monitor memory usage patterns, allocation efficiency, and system performance. Based on this feedback, the system dynamically adjusts memory allocation strategies, migrates virtualization instances between hosts, and optimizes external memory pool utilization, thereby improving resource efficiency while managing complexity through automated control loops.
Data Source
AI summary
Methods are provided comprising: mapping a portion of a local primary memory to an address space of a virtualization instance at a client device, wherein the address space is addressable by a processor of the client device, and wherein the virtualization instance is executed via the processor of the client device; mapping a first portion of external memory to the address space, wherein the external memory is memory that is external to the client device but treated as primary memory at the client device, and wherein a second portion of the external memory is not in any address space addressable by the processor of the client device; providing a performance indication data structure indicating a performance difference between the portion of the local primary memory mapped to the address space and the first portion of external memory mapped to the address space; and causing data to migrate between the external memory and the local primary memory based on the performance indication data structure by the virtualization instance, wherein the data is caused to migrate by the virtualization instance and/or a logic configured to operate with the virtualization instance.