Memory Controller Scoreboard for Idle Page Timeout

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Memory access latency in computing devices is influenced by the duration of an idle page close timeout, which affects the performance of memory subsystems and associated computing systems, as it impacts the balance between page hits and misses, leading to suboptimal memory access times.

Innovation Solution

A predictive scoring mechanism is employed to evaluate candidate timeout values for idle page close timeouts, determining an optimal timeout duration that maximizes row buffer hits and minimizes misses by using a scoreboard to track page hit and miss conversions, thereby dynamically adjusting the idle page close timeout to improve memory access latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the idle page close timeout duration is increased, then row buffer hit rate is improved, but memory access latency increases due to prolonged retention of idle pages

Engineering Contradiction:
Improverow buffer hit rateVSAvoidmemory access latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies dynamics by making the idle page close timeout duration adjustable and adaptive rather than fixed. The memory controller dynamically modifies the timeout value based on observed access patterns and performance metrics, allowing the system to optimize between hit rate and latency in real-time operating conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of timeout duration from a static value to a dynamically adjustable parameter. By monitoring page access behavior and performance feedback, the system modifies the timeout parameter to achieve optimal balance between maintaining high hit rates and preventing excessive latency.

Inventive Principle:
Principle #35Parameter changes

2Loss of time

If the idle page close timeout duration is decreased, then memory access latency is reduced, but row buffer hit rate decreases leading to more page misses

Engineering Contradiction:
Improvememory access latencyVSAvoidrow buffer hit rate
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent implements feedback mechanisms where the memory controller monitors page access patterns, hit rates, and latency metrics. Based on this feedback, the system automatically adjusts the idle page close timeout duration to maintain optimal performance, preventing both excessive latency and excessive page misses.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The memory controller performs self-optimization by automatically adjusting its own timeout parameters based on observed performance. The system serves itself by monitoring its own access patterns and modifying the timeout duration without external intervention, achieving adaptive optimization.

Inventive Principle:
Principle #25Self-service

3Device complexity

If a fixed idle page close timeout value is used, then device complexity is minimized, but adaptability to different access patterns is reduced

Engineering Contradiction:
Improvetimeout management complexityVSAvoidadaptability to access patterns
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent applies preliminary action by implementing performance monitoring and analysis before making timeout adjustments. The system collects access pattern data, analyzes performance metrics, and then proactively modifies the timeout duration in advance of performance degradation, maintaining optimal operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The memory controller autonomously manages the timeout parameter by monitoring its own performance and automatically adjusting the duration based on observed access patterns. This self-service approach enables adaptability without requiring complex external control mechanisms.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10176124B2Scoreboard approach to managing idle page close timeout duration in memory
Publication Date: 2019.01.08 INTEL CORP
  • US10176124B2 patent drawing
  • US10176124B2 patent drawing
  • US10176124B2 patent drawing

AI summary

A technology is described for determining an idle page close timeout for a row buffer. An example memory controller may comprise a scoreboard buffer and a predictive timeout engine. The scoreboard buffer may be configured to store a number of page hits and a number of page misses for a plurality of candidate timeout values for an idle page close timeout. The predictive timeout engine may be configured to increment the page hits and the page misses in the scoreboard buffer according to estimated page hit results and page miss results for the candidate timeout values, and identify a candidate timeout value from the scoreboard buffer estimated to maximize the number of page hits to the number of page misses.