Cache Memory Chunk Translation for Host-Memory Speed Mismatch

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Next-generation memories, such as RRAM, PCRAM, MRAM, and FRAM, have operation speed issues and high defect rates, with their lifespan shortening rapidly upon repeated access, and they often require a cache memory to assist in communication with hosts having different data chunk sizes.

Innovation Solution

A cache memory system with multiple cache sets, each containing valid bits, dirty bits, a tag, and data sets of a size matching the host's data chunk size, along with an eviction method that scores cache sets based on eviction time and evicts them accordingly, ensuring efficient communication between hosts and memories with different chunk sizes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If next-generation memories (RRAM, PCRAM, MRAM, FRAM) are used to replace traditional memories, then new functionality and storage density are improved, but operation speed deteriorates and defect rate increases

Engineering Contradiction:
Improvememory type diversityVSAvoidoperation speed
Core Design Contradiction:
Adaptability or versatilityVSSpeed

Solution Approach 1:

The patent introduces a cache memory as an intermediary component between the host and next-generation memory. The cache memory, which operates at higher speeds, buffers data transfers and masks the slow access speed of the next-generation memory, thereby resolving the speed deterioration while preserving the benefits of new memory types

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The memory system is segmented into two distinct parts: a fast cache memory for frequent access operations and a high-capacity next-generation memory for bulk storage. This segmentation allows each component to operate in its optimal performance range, with the cache handling speed-critical operations and the next-generation memory providing high-density storage

Inventive Principle:
Principle #1Segmentation

2Productivity

If next-generation memories are accessed repeatedly, then data access frequency is improved, but lifespan deteriorates rapidly

Engineering Contradiction:
Improvedata access frequencyVSAvoidmemory lifespan
Core Design Contradiction:
ProductivityVSDuration of action of stationary object

Solution Approach 1:

The cache memory serves as a mediator that absorbs repeated access operations. Frequently accessed data is kept in the cache, preventing repeated writes to the next-generation memory and thereby extending its lifespan while maintaining high data access frequency through the cache

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Data is pre-loaded into the cache memory before being accessed by the host. This preliminary action in the cache prepares the data for fast access without requiring repeated operations on the next-generation memory, thus protecting it from wear

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If cache memory is introduced to support different chunk sizes between host and memory, then adaptability is improved, but device complexity increases

Engineering Contradiction:
Improvechunk size compatibilityVSAvoidcache memory structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The cache memory acts as an intermediary buffer that performs data chunk size translation. It receives data in the memory's chunk size format and converts it to the host's chunk size format, enabling compatibility between different chunk sizes without requiring complex reconfiguration of either the host or memory

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The cache memory is designed with multi-functionality to handle various chunk size configurations. By incorporating configurable buffer depths and flexible data organization, a single cache memory design can adapt to different host and memory chunk size requirements, reducing overall system complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11221965B2Cache memory, memory system including the same, and eviction method of cache memory
Publication Date: 2022.01.11 SK HYNIX INC
  • US11221965B2 patent drawing
  • US11221965B2 patent drawing
  • US11221965B2 patent drawing

AI summary

In a cache memory used for communication between a host and a memory, the cache memory may include a plurality of cache sets, each comprising: a valid bit; N dirty bits; a tag; and N data sets respectively corresponding to the N dirty bits and each including data of a data chunk size substantially identical to a data chunk size of the host, wherein a data chunk size of the memory is N times as large as the data chunk size of the host, where N is an integer greater than or equal to 2.