Tiered Memory Page Migration Using Hotness Ranking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current memory management systems face challenges in efficiently migrating pages between different memory tiers due to proprietary hardware solutions that are inflexible and lack robust security, while software-only solutions suffer from lower performance and inadequate security features, especially in virtualized environments.
Innovation Solution
A hybrid hardware/software architecture utilizing a software profiling driver, hypervisor/operating system policy engine, and hardware data mover to dynamically migrate pages between memory tiers based on access frequency, ensuring secure and efficient page migration across various memory technologies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If data is migrated between storage devices using conventional methods, then data can be accessed on different devices, but the process requires manual user intervention and multiple steps which increases complexity and time consumption
Solution Approach 1:
The system automatically performs data migration by detecting when a user logs into a new device and silently transferring necessary data in the background without requiring user initiation or intervention. The migration process is self-triggered and self-managing, eliminating the need for manual user actions.
Solution Approach 2:
Data is pre-synchronized to remote storage devices before the user needs it. When a user logs into a new device, the data is already available in the cloud and can be instantly downloaded, rather than waiting for the user to initiate a migration process after noticing the need.
2Productivity
If data is migrated using conventional step-by-step methods, then data transfer can be tracked, but the process consumes excessive time and user effort
Solution Approach 1:
Data synchronization occurs continuously in the background as data is added, modified, or deleted on any device. This continuous syncing ensures data is always up-to-date across all devices without requiring discrete migration actions, making the process instantaneous and eliminating time delays.
Solution Approach 2:
The system bypasses traditional multi-step migration procedures by directly downloading data from cloud storage to the new device in a single automated action. The process skips manual selection, confirmation, and transfer steps, rushing through the migration in the background without user感知.
3Adaptability or versatility
If data is stored locally on each device, then access speed is fast, but data cannot be accessed on other devices without migration
Solution Approach 1:
Data is stored in a universal cloud-based location that serves all devices equally. Any device can access the same data set through the cloud, making the storage system multi-functional and device-agnostic. The cloud storage acts as a universal access point for all user devices.
Solution Approach 2:
Cloud storage serves as an intermediary between the user's multiple devices and their data. Instead of direct device-to-device transfer, all data access goes through the cloud mediator, which handles synchronization, storage, and retrieval, ensuring data availability across different devices reliably.
4Reliability
If automatic background synchronization is implemented, then data is always up-to-date across devices, but network bandwidth and system resources are continuously consumed
Solution Approach 1:
Instead of continuous synchronization, the system uses periodic polling and event-triggered updates. Data changes are detected and synchronized at specific intervals or when changes occur, rather than constantly. This periodic approach maintains data consistency while significantly reducing network and system resource consumption compared to continuous syncing.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods and apparatus for providing page migration of pages among tiered memories identify frequently accessed memory pages in each memory tier and generate page hotness ranking information indicating how frequently memory pages are being accessed. Methods and apparatus provide the page hotness ranking information to an operating system or hypervisor depending on which is used in the system, the operating system or hypervisor issues a page move command to a hardware data mover, based on the page hotness ranking information and the hardware data mover moves a memory page to a different memory tier in response to the page move command from the operating system.