Access Tracking Mechanism for Hybrid Memory Page Migration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In hybrid memory systems, existing technologies fail to effectively allocate memory pages between large, slow memories and small, fast memories based on access frequency, leading to suboptimal performance as frequently accessed pages may be allocated to slower memories and rarely accessed pages to faster memories.

Innovation Solution

A subsystem with an access tracking mechanism that monitors access operations and migrates memory pages between a first memory and a second memory, ensuring frequently accessed pages are allocated to the faster memory and infrequently accessed pages are allocated to the larger, slower memory, using a reference vector to track access patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If memory pages are statically allocated to large, slow memory, then storage capacity is maximized, but access latency increases for frequently accessed data

Engineering Contradiction:
Improvestorage capacityVSAvoidaccess latency
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent implements dynamic memory allocation by continuously monitoring access patterns of memory pages and automatically migrating them between fast and slow memory based on current usage. This dynamic approach allows the system to adapt to changing access patterns, ensuring frequently accessed pages reside in fast memory while maximizing the use of slow memory capacity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms through access pattern monitoring that tracks how memory pages are being used. This feedback information is used to make intelligent decisions about memory migration, allowing the system to respond to actual usage patterns rather than relying on static allocation or predictions.

Inventive Principle:
Principle #23Feedback

2Loss of time

If memory pages are migrated based on access frequency, then access latency is optimized, but system complexity increases due to monitoring and migration overhead

Engineering Contradiction:
Improveaccess latencyVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The memory management system performs self-service by automatically monitoring its own access patterns and making migration decisions without requiring external intervention or complex control logic. The system monitors itself and autonomously optimizes its memory allocation, reducing the need for additional complex management infrastructure.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If access pattern monitoring is implemented, then memory allocation accuracy improves, but computational overhead increases

Engineering Contradiction:
Improveallocation accuracyVSAvoidcomputational overhead
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system applies partial monitoring by focusing tracking efforts on memory pages that are candidates for migration rather than monitoring all memory operations uniformly. This selective approach provides sufficient accuracy for making migration decisions while reducing the overall computational overhead compared to comprehensive monitoring of every memory access.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9830262B2Access tracking mechanism for hybrid memories in a unified virtual system
Publication Date: 2017.11.28 NVIDIA CORP
  • US9830262B2 patent drawing
  • US9830262B2 patent drawing
  • US9830262B2 patent drawing

AI summary

Embodiments of the approaches disclosed herein include a subsystem that includes an access tracking mechanism configured to monitor access operations directed to a first memory and a second memory. The access tracking mechanism detects an access operation generated by a processor for accessing a first memory page residing on the second memory. The access tracking mechanism further determines that the first memory page is included in a first subset of memory pages residing on the second memory. The access tracking mechanism further locates, within a reference vector, a reference bit that corresponds to the first memory page, and sets the reference bit. One advantage of the present invention is that memory pages in a hybrid system migrate as needed to increase overall memory performance.