Memory Subsystem Cache Buffering for FeRAM Latency Compatibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Incompatibilities and inefficiencies exist between host devices and non-volatile memory systems, such as FeRAM, due to differences in latency, page sizes, and communication protocols, which hinder optimal performance and compatibility.

Innovation Solution

Incorporating a volatile memory, like DRAM, as a cache within the memory system, managed by an interface controller with buffers and set-associative mapping, to facilitate data transfer and reduce latency by storing data in the volatile memory before accessing non-volatile memory.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by stationary object

If non-volatile memory (FeRAM) is used directly without cache, then non-volatility and lower power consumption are achieved, but latency and compatibility with host devices worsen

Engineering Contradiction:
Improvepower consumptionVSAvoidlatency
Core Design Contradiction:
Use of energy by stationary objectVSLoss of time

Solution Approach 1:

A volatile memory cache is introduced as an intermediary between the host device and non-volatile FeRAM. The cache handles high-speed data access requests from the host, while the FeRAM provides non-volatile storage. This mediator resolves the contradiction by allowing the system to enjoy both low latency (through cache) and non-volatility (through FeRAM).

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Data is pre-loaded into the volatile cache memory from the non-volatile FeRAM before the host device needs it. The controller predicts which data will be needed and loads it into the cache in advance, reducing the actual access latency when the host requests the data, while maintaining the non-volatile nature of the primary storage.

Inventive Principle:
Principle #10Preliminary action

2Quantity of substance

If non-volatile memory (FeRAM) is used directly without cache, then higher capacity and lower power consumption are achieved, but compatibility and performance with host devices worsen

Engineering Contradiction:
Improvestorage capacityVSAvoidcompatibility with host devices
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The volatile cache acts as a compatibility layer between the host device and FeRAM. It translates host device protocols and access patterns into FeRAM-compatible operations, enabling the host to access large-capacity non-volatile storage without being constrained by FeRAM's native interface limitations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The memory system is segmented into two distinct layers: a smaller, fast volatile cache layer that handles protocol translation and frequent access patterns, and a larger, slower non-volatile FeRAM layer that provides bulk storage capacity. This segmentation allows each layer to be optimized for its specific function while working together to provide both high capacity and host compatibility.

Inventive Principle:
Principle #1Segmentation

3Loss of time

If volatile memory cache is added to the system, then latency is reduced and compatibility with host devices is improved, but device complexity increases

Engineering Contradiction:
ImprovelatencyVSAvoidmemory subsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The cache memory and FeRAM are merged into a unified memory subsystem managed by a single controller. The controller integrates cache management logic, protocol translation, and data transfer functions into one cohesive unit, reducing the complexity that would arise from having separate independent memory systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The memory controller is designed with multi-functionality to handle both cache operations and direct FeRAM access. It can operate in different modes (cache-enabled or cache-bypass) and supports multiple protocols, reducing the need for separate dedicated controllers and thereby managing complexity while providing versatile functionality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12572303B2Cache management in a memory subsystem
Publication Date: 2026.03.10 MICRON TECHNOLOGY INC
  • US12572303B2 patent drawing
  • US12572303B2 patent drawing
  • US12572303B2 patent drawing

AI summary

Methods, systems, and devices for cache management in a memory subsystem are described. An interface controller may include a first buffer and a second buffer. The interface controller may use the first and second buffers to facilitate operating a volatile memory as a cache for a non-volatile memory. During an access operation, the interface controller may use the buffer to transfer data between the volatile memory, non-volatile memory, and another device. In response to the access operation, the interface controller may use the second buffer to transfer second data from the volatile memory to the non-volatile memory.