Non-Volatile Cache Replacement Policy for Wear Distribution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cache replacement policies designed for traditional memory types are unsuitable for non-volatile memory, leading to decreased lifetime and inefficient access speeds, as they do not account for the wear-out characteristics of non-volatile memory.

Innovation Solution

A method and system that maintain a write count for cache memory locations, selecting a cache replacement policy based on this count to introduce randomized selection, combining intelligent and random replacement policies to evenly distribute writes and extend non-volatile memory lifetime.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional cache replacement policies are used in non-volatile memory, then cache hit rate is improved, but memory lifetime deteriorates due to uneven wear distribution

Engineering Contradiction:
Improvecache hit rateVSAvoidmemory lifetime
Core Design Contradiction:
ProductivityVSDuration of action of stationary object

Solution Approach 1:

The patent changes the replacement policy parameter from deterministic (LRU, FIFO) to probabilistic by introducing a random component. The replacement decision is made based on a probability distribution that combines recency information with random selection, thereby altering how replacement candidates are chosen to distribute wear more evenly across memory blocks while maintaining acceptable cache hit rates.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent makes the replacement policy dynamic by adjusting the randomness parameter based on the write count of memory blocks. As blocks are written to, their replacement probability is dynamically adjusted to prevent repeated writes to the same blocks, thereby distributing wear over time and extending memory lifetime while adapting to changing workload patterns.

Inventive Principle:
Principle #15Dynamics

2Duration of action of stationary object

If wear-leveling techniques are applied to maximize non-volatile memory lifetime, then memory lifetime is improved, but access speeds deteriorate due to suboptimal cache replacement decisions

Engineering Contradiction:
Improvememory lifetimeVSAvoidaccess speed
Core Design Contradiction:
Duration of action of stationary objectVSSpeed

Solution Approach 1:

The patent changes the replacement behavior from purely wear-leveling oriented to a hybrid approach that incorporates recency information. By modifying the probability distribution to favor recently accessed blocks while still introducing randomness, the system maintains better cache hit rates and thus faster access speeds compared to traditional wear-leveling alone.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent uses feedback from access patterns and write counts to dynamically adjust replacement probabilities. The system monitors which blocks are accessed frequently and which have been written to recently, using this feedback to make informed probabilistic replacement decisions that balance both performance and wear distribution.

Inventive Principle:
Principle #23Feedback

3Duration of action of stationary object

If random replacement policy is used to distribute writes evenly, then memory lifetime is improved, but cache hit rate deteriorates due to loss of replacement intelligence

Engineering Contradiction:
Improvememory lifetimeVSAvoidcache hit rate
Core Design Contradiction:
Duration of action of stationary objectVSProductivity

Solution Approach 1:

The patent merges two replacement strategies: intelligent recency-based selection and random selection. The hybrid policy combines LRU (Least Recently Used) principles with probabilistic random replacement, where the replacement probability is a function of both the block's recency and a random component. This merging allows the system to benefit from both the intelligence of recency-aware policies and the wear-distributing effect of randomness.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The replacement policy acts as a composite of deterministic and probabilistic components. Rather than using a single pure strategy, the patent creates a composite policy where the replacement decision is formed by combining multiple factors (recency, write count, random selection) into a unified probabilistic framework that achieves both performance and reliability goals.

Inventive Principle:
Principle #40Composite materials

Data Source

PatentUS9792228B2Enhancing lifetime of non-volatile cache by injecting random replacement policy
Publication Date: 2017.10.17 ADVANCED MICRO DEVICES INC
  • US9792228B2 patent drawing
  • US9792228B2 patent drawing
  • US9792228B2 patent drawing

AI summary

A method, a system and a computer-readable medium for writing to a non-volatile cache memory are provided. The method maintains a write count associated with a set of memory locations. The method then selects a cache replacement policy based on the value of the write count and selecting a block within the set for writing data using the selected cache replacement policy. The selected cache replacement policy can introduce a randomized selection.