Indirect Memory Prefetcher Training Using Differential Address Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Indirect memory prefetchers face challenges in efficient training due to complex prediction algorithms, leading to increased hardware resources and power consumption.

Innovation Solution

A differential approach is employed to efficiently compute values for Size and baseAddress by leveraging the relationship between elements in arrays, utilizing differential indices and addresses to reduce hardware components and power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If advanced prediction algorithms are used in indirect memory prefetchers, then prefetch accuracy is improved, but hardware complexity and power consumption increase

Engineering Contradiction:
Improveprefetch accuracyVSAvoidhardware complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms the address generation problem into a parameter estimation problem by computing differential indices and addresses. Instead of using complex prediction algorithms to directly determine next memory addresses, the system estimates parameters (differential index, base address) from observed access patterns and uses mathematical relationships to generate prefetch addresses. This parameter transformation simplifies the hardware while maintaining prediction accuracy.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces complex hardware prediction mechanisms with mathematical computations. Rather than using sophisticated hardware circuits to predict memory access patterns, the system uses algebraic operations (computing differences, solving equations) to derive prefetch addresses. This substitution of mechanical/hardware complexity with mathematical simplicity reduces hardware resources while improving accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If advanced prediction algorithms are used in indirect memory prefetchers, then prefetch accuracy is improved, but power consumption increases

Engineering Contradiction:
Improveprefetch accuracyVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

By changing the approach from direct address prediction to parameter estimation, the patent reduces the computational burden on hardware circuits. The mathematical operations required to compute differential indices and solve for base addresses are less energy-intensive than complex prediction algorithms, thereby reducing power consumption while maintaining or improving prefetch accuracy.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent substitutes energy-intensive hardware prediction mechanisms with computationally lighter mathematical operations. The system uses algebraic calculations rather than complex digital logic circuits to generate prefetch addresses, resulting in lower power consumption while achieving improved prediction accuracy through better mathematical modeling of access patterns.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If more hardware resources are allocated to indirect memory prefetchers, then prediction capability is improved, but device complexity increases

Engineering Contradiction:
Improveprediction capabilityVSAvoidhardware resources
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent achieves improved prediction capability not by adding more hardware resources, but by changing the computational approach to parameter estimation. The system uses a small set of hardware components to compute differential indices and base addresses, then leverages mathematical relationships to generate accurate prefetch addresses. This approach provides strong prediction capability with minimal hardware overhead.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces hardware-intensive prediction mechanisms with mathematically-based address generation. Instead of using complex hardware circuits to analyze and predict memory access patterns, the system uses algebraic operations to compute parameters and generate addresses. This substitution provides versatile prediction capability while using significantly fewer hardware resources.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12619544B2Differential approach for indirect memory prefetcher training
Publication Date: 2026.05.05 QUALCOMM INC
  • US12619544B2 patent drawing
  • US12619544B2 patent drawing
  • US12619544B2 patent drawing

AI summary

Certain aspects of the present disclosure provide techniques and apparatus that may be used to efficiently train address generation components of an indirect memory prefetcher (IMP). In some cases, logical shift operators and comparators may be used to determine an unknown size and base address used to generate a prefetch address.