Memory Page Sampling for Access Statistics Without Added Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory devices that lack processing capability for detailed access statistics monitoring increase latency, hindering performance optimization in computing systems.

Innovation Solution

Implement a page sampling method where virtual pages are allocated to memory devices with monitoring components, allowing access statistics to be sampled and extrapolated for pages without such capability, optimizing page scheduling for improved system performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If memory devices lack processing capability for detailed access statistics monitoring, then device complexity is reduced, but measurement precision of access statistics deteriorates

Engineering Contradiction:
Improveprocessing capabilityVSAvoidaccess statistics monitoring
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces a monitoring component as an intermediary element within the memory device that specifically handles access statistics monitoring. This component acts as a mediator between the memory device's basic operations and the detailed statistics collection, allowing the memory device to maintain low complexity while still achieving precise access statistics monitoring through the dedicated monitoring component.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The monitoring component is designed to perform multiple functions: it tracks access patterns, collects statistics, and provides this information to the host system. By consolidating these diverse monitoring functions into a single component, the system achieves comprehensive access statistics capability without proportionally increasing overall device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If access statistics monitoring is implemented in memory devices, then measurement precision of access statistics is improved, but latency increases

Engineering Contradiction:
Improveaccess statistics monitoringVSAvoidlatency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the memory device into functional components, separating the monitoring component from the core memory operations. This segmentation allows access statistics monitoring to occur in parallel with memory access operations, preventing monitoring activities from blocking or delaying actual data access and thus reducing latency impact.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The monitoring component operates autonomously to collect and track access statistics without requiring intervention or processing from the host system during the monitoring process. This self-service capability allows the monitoring to proceed independently alongside normal memory operations, minimizing additional latency introduced by the monitoring function.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If virtual pages are allocated to memory devices with monitoring components for sampling, then measurement precision of access statistics is improved, but device complexity increases

Engineering Contradiction:
Improveaccess statistics samplingVSAvoidpage allocation management
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of allocating all virtual pages to memory devices with monitoring components, the patent implements partial allocation where only selected virtual pages are assigned to monitored memory devices. This partial action approach enables access statistics sampling for specific pages that benefit from detailed monitoring while avoiding the complexity overhead of managing monitoring for all pages throughout the system.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP4473385B1Memory access statistics monitoring
Publication Date: 2025.10.22 MICRON TECHNOLOGY INC
  • EP4473385B1 patent drawingFigure 1
  • EP4473385B1 patent drawingFigure 2A~2B
  • EP4473385B1 patent drawingFigure 3

AI summary

Systems, apparatuses, and methods related to memory access statistics monitoring are described. A host is configured to map pages of memory for applications to a number of memory devices coupled thereto. A first memory device comprises a monitoring component configured to monitor access statistics of pages of memory mapped to the first memory device. A second memory device does not include a monitoring component capable of monitoring access statistics of pages of memory mapped thereto. The host is configured to map a portion of pages of memory for an application to the first memory device in order to obtain access statistics corresponding to the portion of pages of memory upon execution of the application despite there being space available on the second memory device and adjust mappings of the pages of memory for the application based on the obtained access statistics corresponding to the portion of pages.