Even-Odd Cache Memory Segmentation for Next-Gen Memory Speed

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Next-generation memories, such as RRAM, PCRAM, MRAM, and FRAM, face issues with operating speed, defect rates, and endurance, requiring a cache memory to support operating speeds and accommodate different data chunk sizes between hosts and memory devices.

Innovation Solution

A cache memory system with separate cache areas for even and odd addresses, including check and detection circuits to manage data allocation and storage efficiently, optimizing access times and communication between hosts and memory devices with varying data chunk sizes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If a cache memory is introduced to support next-generation memories, then operating speed is improved, but device complexity increases

Engineering Contradiction:
Improveoperating speedVSAvoiddevice complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The cache memory is divided into multiple cache sets (first cache set, second cache set, third cache set, etc.) that are further divided into cache ways. This segmentation allows parallel data storage and retrieval operations, improving operating speed while managing complexity through modular organization. Each cache set can independently store different data blocks, enabling concurrent accesses.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The cache memory structure implements a nested organization where cache sets contain multiple cache ways, and each cache way contains data blocks. This nested structure allows efficient hierarchical data access patterns, where data can be retrieved from different levels of the hierarchy simultaneously, enhancing speed without proportionally increasing overall complexity.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Productivity

If a cache memory is introduced to reduce access frequency, then productivity is improved, but device complexity increases

Engineering Contradiction:
ImproveproductivityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The cache memory performs preliminary data loading and storage before actual data requests occur. By pre-loading data into appropriate cache sets based on access patterns and predictions, the system reduces the frequency of direct memory accesses, thereby improving productivity. The check circuit and detection circuit work together to determine optimal data placement in advance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The cache memory acts as an intermediary between the host and the memory device, buffering data transfers and reducing direct access frequency to the memory device. This intermediary structure absorbs access variability and smooths out the communication pattern, improving overall system productivity while isolating the complexity of data management from the host and memory interfaces.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If separate cache areas for even and odd addresses are implemented, then data allocation efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvedata allocation efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The cache memory is segmented into separate cache areas for even addresses and odd addresses, with each area containing multiple cache sets. This segmentation enables independent data allocation and management for different address types, improving data allocation efficiency by avoiding address conflicts and enabling parallel processing. The pair field in each cache set further segments the association information, allowing efficient tracking of adjacent address locations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The cache memory employs asymmetric address mapping where even and odd addresses are handled through separate cache areas rather than a unified symmetric structure. This asymmetric design optimizes data allocation efficiency by tailoring the cache organization to the specific access patterns of even and odd addresses, allowing specialized management strategies for each address type while maintaining overall system performance.

Inventive Principle:
Principle #4Asymmetry

Data Source

PatentUS11836089B2Cache memory, memory system including the same and operating method thereof
Publication Date: 2023.12.05 SK HYNIX INC
  • US11836089B2 patent drawing
  • US11836089B2 patent drawing
  • US11836089B2 patent drawing

AI summary

A cache memory includes a first cache area corresponding to even addresses, and a second cache area corresponding to odd addresses, wherein each of the first and second cache areas includes a plurality of cache sets, and each cache set includes a data set field suitable for storing data corresponding to an address among the even and odd addresses, and a pair field suitable for storing information on a location where data corresponding to an adjacent address which is adjacent to an address corresponding to the stored data is stored.