Prefetch Generation Circuitry Mode Control for Power and Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing prefetch generation techniques often result in wasted power and pollution of local storage circuitry due to inaccurate data prefetching, leading to unnecessary data being prefetched, which reduces space for required data and inefficient resource utilization.

Innovation Solution

Implementing control circuitry to switch prefetch generation circuitry between online and offline modes based on mode switching criteria, with a modified switching criterion applied after an offline period to determine future operational modes, reducing unnecessary mode transitions and optimizing prefetching efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If prefetch requests are continuously generated to improve data availability, then data access speed is improved, but power consumption increases and local storage circuitry becomes polluted with unnecessary data

Engineering Contradiction:
Improvedata access speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The prefetch generation circuitry dynamically switches between online and offline modes based on mode switching criteria. In online mode, prefetch requests are generated to improve data access speed. In offline mode, prefetch requests are suppressed to reduce power consumption. This dynamic adaptation resolves the contradiction by adjusting prefetching activity according to system conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameter of prefetch generation by switching modes. The mode switching criterion monitors system state and triggers transitions between online (high prefetching activity) and offline (low prefetching activity) modes, thereby adjusting power consumption while maintaining data access performance when needed.

Inventive Principle:
Principle #35Parameter changes

2Speed

If prefetch requests are continuously generated to improve data availability, then data access speed is improved, but local storage circuitry becomes polluted with unnecessary data

Engineering Contradiction:
Improvedata access speedVSAvoidprefetching accuracy
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The mode switching criterion uses feedback from system performance monitoring to determine when to switch between online and offline modes. By evaluating whether prefetching is achieving its intended purpose (improving data access speed) versus causing harm (polluting local storage), the system adjusts prefetching behavior accordingly, maintaining accuracy while preserving speed benefits.

Inventive Principle:
Principle #23Feedback

3Use of energy by moving object

If the prefetch generation circuitry is switched frequently between online and offline modes, then power consumption is optimized, but system complexity increases due to mode switching criteria

Engineering Contradiction:
Improvepower consumptionVSAvoidcontrol circuitry complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The control circuitry is segmented into distinct functional components: the prefetch generation circuitry that generates prefetch requests, and the mode switching criterion that controls when to switch between online and offline modes. This segmentation allows independent optimization of each component while managing overall complexity through clear separation of concerns.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250231880A1Operational modes for prefetch generation circuitry
Publication Date: 2025.07.17 ARM LTD
  • US20250231880A1 patent drawing
  • US20250231880A1 patent drawing
  • US20250231880A1 patent drawing

AI summary

There is provided an apparatus, a system, a chip containing product, a method and a medium. The apparatus comprises prefetch generation circuitry configured to generate prefetch requests. The apparatus is also provided with control circuitry configured to determine an operational mode for the prefetch generation circuitry from a plurality of operational modes comprising an offline mode in which prefetch requests are not generated and at least one online mode in which prefetch requests are generated. The control circuitry is configured to switch the prefetch generation circuitry from the online mode to the offline mode for an offline period based on a mode switching criterion. The control circuitry is responsive to a switch to the offline mode, to apply modified switching criteria to determine whether the prefetch generation circuitry should operate in the offline mode during a future period occurring subsequent to the offline period.