Memory Page Access Detection via Threshold Counting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory page replacement algorithms, such as LRU, often provide sub-optimal results due to variations in program memory access patterns and operating conditions, leading to inefficient memory management in processors.

Innovation Solution

Implementing a memory management technique that maintains access counts for each memory page and sets an indicator when the access threshold is exceeded, prioritizing pages with higher access counts for retention in the memory hierarchy, thereby altering the memory management algorithms to base decisions on a threshold number of accesses rather than a single access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional LRU-based memory page selection algorithms are used, then implementation simplicity is maintained, but memory access efficiency deteriorates due to sub-optimal page replacement decisions

Engineering Contradiction:
Improvememory access efficiencyVSAvoidmemory management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by maintaining access count registers that continuously track the number of accesses to each memory page before replacement decisions are needed. This advance tracking allows the memory management unit to make informed replacement decisions based on accumulated access history, rather than relying on simple LRU metrics, thereby improving memory access efficiency without proportionally increasing complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where access count registers continuously monitor and record memory access patterns, providing feedback to the memory management unit. This feedback loop enables dynamic adjustment of page replacement decisions based on actual access frequencies, allowing the system to retain frequently accessed pages and replace infrequently accessed ones, thus resolving the contradiction between efficiency and complexity.

Inventive Principle:
Principle #23Feedback

2Speed

If memory pages are frequently moved between memory hierarchy levels, then memory access speeds are enhanced, but memory management complexity increases due to need for optimal placement decisions

Engineering Contradiction:
Improvememory access speedVSAvoidmemory management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The memory pages essentially self-service by having their access counts automatically tracked in dedicated registers without requiring complex external management. The access count infrastructure autonomously monitors and records access patterns, providing the necessary information for memory hierarchy placement decisions while minimizing the burden on the memory management unit, thus enhancing access speed without proportionally increasing management complexity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the parameter used for memory management decisions from simple LRU metrics to access count thresholds. By monitoring the number of accesses to each page and comparing it against configurable thresholds, the system can dynamically determine optimal placement in the memory hierarchy, enabling faster access to frequently used pages while managing complexity through parameter-based control rather than complex algorithms.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If access count infrastructure is implemented for all memory pages, then page replacement accuracy is improved, but hardware overhead increases

Engineering Contradiction:
Improveaccess pattern measurement accuracyVSAvoidhardware overhead
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments the memory management approach by implementing access count registers selectively rather than uniformly for all memory pages. The memory management unit can choose to track access counts only for pages that benefit from such monitoring, allowing precise measurement of access patterns where needed while avoiding unnecessary hardware overhead for pages that do not require sophisticated management, thus resolving the contradiction between measurement accuracy and hardware overhead.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies partial action by implementing access count tracking only to the extent necessary for improving memory management. Rather than maintaining comprehensive access count infrastructure for every possible memory page, the system selectively applies the mechanism to pages where access pattern monitoring provides the greatest benefit, achieving sufficient measurement precision while controlling hardware overhead through selective deployment.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9727241B2Memory page access detection
Publication Date: 2017.08.08 ADVANCED MICRO DEVICES INC
  • US9727241B2 patent drawing
  • US9727241B2 patent drawing
  • US9727241B2 patent drawing

AI summary

A processor maintains a count of accesses to each memory page. When the accesses to a memory page exceed a threshold amount for that memory page, the processor sets an indicator for the page. Based on the indicators for the memory pages, the processor manages data at one or more levels of the processor's memory hierarchy.