Memory Module Access Counters for Low-Overhead Refresh Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory access monitoring approaches place a high demand on system resources and are inefficient for various processor applications, especially in heterogeneous memory architectures that require balancing access frequency and cost.

Innovation Solution

Implementing a memory tracking system with counters located at the memory module that adjust access counts based on page refreshes, allowing for efficient monitoring with low overhead and minimal processor involvement, using separate counters for read and write accesses and adjustable refresh cycles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional memory access monitoring approaches are used, then memory access counts can be obtained, but system resource demand is high and efficiency is low

Engineering Contradiction:
Improvememory access count accuracyVSAvoidsystem efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The memory module autonomously maintains access counters without requiring processor intervention. The counter increment logic is embedded within the memory module, allowing it to self-monitor access patterns and self-manage counter values based on refresh operations, eliminating the need for processor-based monitoring overhead

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Counters are pre-configured within the memory module structure, and the system pre-determines which pages require monitoring. The memory module proactively updates counters during normal operation and during refresh cycles, preparing access frequency data before the processor needs to make memory management decisions

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If memory access monitoring is implemented, then data access frequency can be tracked, but processor overhead is high

Engineering Contradiction:
Improveaccess frequency trackingVSAvoidprocessor overhead time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The monitoring function is extracted from the processor and relocated to the memory module. The memory module independently maintains counters and handles refresh-related counter adjustments, removing the monitoring burden from the processor and eliminating the associated time loss and overhead

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The memory module acts as an intermediary between the memory pages and the processor. It autonomously manages counter increments for accessed pages and counter decrements during refresh cycles, providing the processor with ready-made access frequency information without requiring the processor to intervene in the monitoring process

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If heterogeneous memory modules are used to balance processing efficiency with system costs, then cost efficiency improves, but monitoring complexity increases

Engineering Contradiction:
Improvesystem cost efficiencyVSAvoidmonitoring system complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The monitoring system is segmented and distributed across multiple memory modules rather than being centralized. Each memory module independently maintains its own counters and handles its own refresh operations, allowing heterogeneous memory modules to operate autonomously without requiring a complex centralized monitoring system to coordinate them

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each memory module is equipped with local counter logic tailored to its specific characteristics. The monitoring capability is localized within each memory module, allowing different types of memory modules in a heterogeneous system to maintain counters independently with different granularities or frequencies as needed, without imposing uniform complexity across the entire system

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10802977B2Memory page access counts based on page refresh
Publication Date: 2020.10.13 ADVANCED MICRO DEVICES INC
  • US10802977B2 patent drawing
  • US10802977B2 patent drawing
  • US10802977B2 patent drawing

AI summary

A processing system tracks counts of accesses to memory pages using a set of counters located at the memory module that stores the pages, wherein the counts are adjusted at least in part based on refreshes of the memory pages. This approach allows a processing system to efficiently maintain the counts with relatively small counters and with relatively low overhead. Furthermore, the rate at which the counters are adjusted, relative to the page refreshes, is adjustable, so that the access counts are useful for a wide variety of application types.