3D DRAM Stack Layout for Bandwidth Scaling and Thermal Relief

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing semiconductor memory devices face limitations in bandwidth scaling and thermal constraints, particularly in high-bandwidth memory (HBM) DRAM, which restrict further capacity and bandwidth expansion due to feedthrough connections and thermal limitations, making high-capacity and high-bandwidth 3D DRAM integration in standard DRAM system-in-package (SiP) challenging.

Innovation Solution

A fully cascadable 3D DRAM stack is developed, allowing for capacity and bandwidth scaling, with a base die placed on top for improved thermal performance, and compatible with existing DRAM interfaces, featuring a package substrate, through silicon vias (TSVs), and wire-bonds to physical IO interfaces, enabling high-capacity and high-bandwidth integration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If HBM DRAM is used to provide high bandwidth and capacity, then memory performance is improved, but thermal limitations and feedthrough connection constraints restrict further scaling

Engineering Contradiction:
Improvememory bandwidthVSAvoidthermal limitations
Core Design Contradiction:
ProductivityVSTemperature

Solution Approach 1:

The patent transitions from two-dimensional planar memory architectures to three-dimensional stacked memory structures. Multiple memory dies are stacked vertically and interconnected through silicon vias (TSVs), enabling significant increases in memory capacity and bandwidth without proportionally increasing the footprint area. This vertical stacking approach allows the system to scale memory capacity by adding more layers in the third dimension while maintaining efficient thermal characteristics compared to expanding in the planar direction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If HBM DRAM is used to increase capacity and bandwidth, then memory performance is improved, but device complexity increases due to feedthrough connections

Engineering Contradiction:
Improvememory capacityVSAvoidfeedthrough connection complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent introduces through silicon vias (TSVs) as intermediary structures that penetrate through the entire thickness of memory dies to establish vertical interconnections. These TSVs serve as mediators between different memory layers, enabling data and power signals to traverse through the stacked structure. By using TSVs as standardized intermediary components, the system achieves high memory capacity scaling while managing the complexity of three-dimensional interconnections through a systematic via-based approach rather than more complex feedthrough structures.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If standard DRAM package is used, then ease of manufacture and compatibility are improved, but bandwidth scaling is limited compared to HBM

Engineering Contradiction:
Improvepackage compatibilityVSAvoidbandwidth scaling
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent creates a universal memory package architecture that combines the advantages of both standard DRAM packages and HBM structures. The stacked memory design with TSV interconnections can be integrated into existing standard DRAM package formats, maintaining compatibility with conventional manufacturing processes and packaging infrastructure. Simultaneously, the three-dimensional stacking provides HBM-level bandwidth scaling capabilities. This multi-functional approach allows the same basic structure to serve both as a drop-in replacement for standard packages and as a high-performance memory solution.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20260068183A1High-capacity and high-bandwidth three-dimensional dynamic random-access memory (3d dram) integration in standard dram system-in-package (SIP)
Publication Date: 2026.03.05 QUALCOMM INC
  • US20260068183A1 patent drawing
  • US20260068183A1 patent drawing
  • US20260068183A1 patent drawing

AI summary

A three-dimensional (3D) stacked memory package is described. The 3D stacked memory package includes a first plurality of stacked memory dies. The 3D stacked memory package also includes a first base die stacked on the first plurality of stacked memory dies. The 3D stacked memory package further includes a package substrate supporting the first plurality of stacked memory dies. The 3D stacked memory package also includes a first plurality of through silicon vias (TSVs) extending between the first plurality of stacked memory dies and a first compute block on the first base die. The 3D stacked memory package further includes a first set of wire-bonds coupled between the package substrate and a first physical IO interface (PHY) on the first base die.