Cache Way Prediction for Stack Data Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In cache memory systems, accessing data requires energy that increases with the number of cache ways searched, necessitating methods to limit the number of ways accessed for efficient data retrieval.

Innovation Solution

Implementing a method that uses identifying information from a subset of recently accessed ways to predict the location of stack data blocks within the cache, allowing for faster and less resource-intensive access by routing stack data to specific cache ways and only accessing those during future requests.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If the number of cache ways is increased to improve data storage capacity, then the data storage capacity is improved, but the energy expenditure increases

Engineering Contradiction:
Improvedata storage capacityVSAvoidenergy expenditure
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The patent segments the cache way selection process by introducing way prediction mechanisms that divide the search space. Instead of searching all cache ways, the system predicts which specific ways are likely to contain the requested data and only searches those predicted ways, thereby reducing energy expenditure while maintaining storage capacity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies preliminary action through way prediction techniques that determine which cache ways to search before the actual data access occurs. By predicting the location of data in advance based on access patterns and cache state, the system prepares the search path beforehand, avoiding exhaustive searches of all cache ways and reducing energy consumption

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If the number of cache ways is increased to improve data storage capacity, then the data storage capacity is improved, but the access time increases

Engineering Contradiction:
Improvedata storage capacityVSAvoidaccess time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The patent segments the cache search process by dividing all cache ways into predicted ways (likely to contain data) and non-predicted ways. This segmentation allows the system to focus the search on a smaller subset of cache ways, reducing access time while maintaining the ability to store data across all ways

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary way prediction to identify which cache ways are most likely to contain the requested data before the actual access occurs. This preliminary determination of search targets reduces the time required for data retrieval by avoiding unnecessary searches of cache ways that do not contain the desired data

Inventive Principle:
Principle #10Preliminary action

3Reliability

If all cache ways are accessed to locate data, then the reliability of data retrieval is improved, but the energy expenditure increases

Engineering Contradiction:
Improvedata retrieval reliabilityVSAvoidenergy expenditure
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by searching only a predicted subset of cache ways rather than all cache ways. The way prediction mechanism determines that searching a specific subset of ways is sufficient to find the data with high probability, making the partial search as effective as a complete search while consuming less energy

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent substitutes the mechanical exhaustive search process with a prediction-based selection process. Instead of systematically accessing all cache ways, the system uses way prediction logic to select which ways to search, replacing the brute-force mechanical approach with a smarter selection mechanism that reduces energy consumption while maintaining retrieval reliability

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9734059B2Methods and apparatus for data cache way prediction based on classification as stack data
Publication Date: 2017.08.15 ADVANCED MICRO DEVICES INC
  • US9734059B2 patent drawing
  • US9734059B2 patent drawing
  • US9734059B2 patent drawing

AI summary

A method of way prediction for a data cache having a plurality of ways is provided. Responsive to an instruction to access a stack data block, the method accesses identifying information associated with a plurality of most recently accessed ways of a data cache to determine whether the stack data block resides in one of the plurality of most recently accessed ways of the data cache, wherein the identifying information is accessed from a subset of an array of identifying information corresponding to the plurality of most recently accessed ways; and when the stack data block resides in one of the plurality of most recently accessed ways of the data cache, the method accesses the stack data block from the data cache.