Multi-Tier Stackable Cache Memory Architecture for Scalable Caching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory architectural designs face inefficiencies in caching logic, particularly when expanding to higher orders of caching operations, making it difficult to achieve high-performance caching, especially in external caching scenarios.

Innovation Solution

A multi-tier vertically expandable cache memory architecture is introduced, utilizing a 3D stacking configuration with configurable system-level cache dies and interconnect logic, allowing for dynamic configuration during manufacturing and assembly, enabling efficient caching operations across multiple semiconductor dies.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional memory architectural designs are used, then device complexity is reduced, but caching efficiency and performance deteriorate when expanding to higher orders of caching operations

Engineering Contradiction:
Improvecaching efficiencyVSAvoidcache architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent transitions from conventional 2D cache architecture to a 3D vertically-stackable architecture, enabling higher-order caching operations by adding a vertical dimension. Multiple cache tiers are stacked vertically with interconnect logic, allowing efficient access to higher-level caches without proportionally increasing device complexity through vertical integration and shared interconnect structures.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If conventional caching logic is used, then ease of manufacture is improved, but adaptability and configurability for different caching scenarios deteriorate

Engineering Contradiction:
Improvecaching configurabilityVSAvoidmanufacturing complexity
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent implements a universal cache architecture where the same vertically-stackable structure and interconnect logic can be configured for different caching scenarios (L1, L2, L3 caches, or higher orders). The modular design allows the same manufacturing process to produce different cache configurations by varying the number of stacked tiers and interconnect arrangements, achieving high adaptability without proportionally increasing manufacturing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11954040B2Cache memory architecture
Publication Date: 2024.04.09 ARM LTD
  • US11954040B2 patent drawing
  • US11954040B2 patent drawing
  • US11954040B2 patent drawing

AI summary

Various implementations described herein are directed to device. The device may include a first tier having a processor and a first cache memory that are coupled together via control logic to operate as a computing architecture. The device may include a second tier having a second cache memory that is coupled to the first cache memory. Also, the first tier and the second tier may be integrated together with the computing architecture to operate as a stackable cache memory architecture.