3D DRAM Stack Layout for Bandwidth Scaling and Thermal Relief
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing semiconductor memory devices face limitations in bandwidth scaling and thermal constraints, particularly in high-bandwidth memory (HBM) DRAM, which restrict further capacity and bandwidth expansion due to feedthrough connections and thermal limitations, making high-capacity and high-bandwidth 3D DRAM integration in standard DRAM system-in-package (SiP) challenging.
Innovation Solution
A fully cascadable 3D DRAM stack is developed, allowing for capacity and bandwidth scaling, with a base die placed on top for improved thermal performance, and compatible with existing DRAM interfaces, featuring a package substrate, through silicon vias (TSVs), and wire-bonds to physical IO interfaces, enabling high-capacity and high-bandwidth integration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If HBM DRAM is used to provide high bandwidth and capacity, then memory performance is improved, but thermal limitations and feedthrough connection constraints restrict further scaling
Solution Approach 1:
The patent transitions from two-dimensional planar memory architectures to three-dimensional stacked memory structures. Multiple memory dies are stacked vertically and interconnected through silicon vias (TSVs), enabling significant increases in memory capacity and bandwidth without proportionally increasing the footprint area. This vertical stacking approach allows the system to scale memory capacity by adding more layers in the third dimension while maintaining efficient thermal characteristics compared to expanding in the planar direction.
2Quantity of substance
If HBM DRAM is used to increase capacity and bandwidth, then memory performance is improved, but device complexity increases due to feedthrough connections
Solution Approach 1:
The patent introduces through silicon vias (TSVs) as intermediary structures that penetrate through the entire thickness of memory dies to establish vertical interconnections. These TSVs serve as mediators between different memory layers, enabling data and power signals to traverse through the stacked structure. By using TSVs as standardized intermediary components, the system achieves high memory capacity scaling while managing the complexity of three-dimensional interconnections through a systematic via-based approach rather than more complex feedthrough structures.
3Ease of manufacture
If standard DRAM package is used, then ease of manufacture and compatibility are improved, but bandwidth scaling is limited compared to HBM
Solution Approach 1:
The patent creates a universal memory package architecture that combines the advantages of both standard DRAM packages and HBM structures. The stacked memory design with TSV interconnections can be integrated into existing standard DRAM package formats, maintaining compatibility with conventional manufacturing processes and packaging infrastructure. Simultaneously, the three-dimensional stacking provides HBM-level bandwidth scaling capabilities. This multi-functional approach allows the same basic structure to serve both as a drop-in replacement for standard packages and as a high-performance memory solution.
Data Source
AI summary
A three-dimensional (3D) stacked memory package is described. The 3D stacked memory package includes a first plurality of stacked memory dies. The 3D stacked memory package also includes a first base die stacked on the first plurality of stacked memory dies. The 3D stacked memory package further includes a package substrate supporting the first plurality of stacked memory dies. The 3D stacked memory package also includes a first plurality of through silicon vias (TSVs) extending between the first plurality of stacked memory dies and a first compute block on the first base die. The 3D stacked memory package further includes a first set of wire-bonds coupled between the package substrate and a first physical IO interface (PHY) on the first base die.


