Stacked Dual-DRAM Memory Architecture for Capacity and Bandwidth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The design of dynamic random access memory (DRAM) faces a challenge in balancing high density, high bandwidth, and low power consumption, as improvements in one area often compromise the others, making it difficult to achieve ideal performance and energy efficiency in electronic systems.

Innovation Solution

A memory system incorporating two types of DRAM, one optimized for high density and capacity and the other for low latency and high bandwidth, which are integrated on separate circuits and coupled through a shared physical layer circuit, allowing for efficient energy use and scalable packaging configurations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If DRAM is optimized for high density, then capacity increases, but bandwidth decreases

Engineering Contradiction:
Improvememory capacityVSAvoidbandwidth
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The memory system is segmented into two distinct types of DRAM: high-density DRAM for capacity and low-density high-bandwidth DRAM for performance. This segmentation allows each memory type to be optimized independently for its specific function, resolving the contradiction between capacity and bandwidth by distributing different workloads to appropriate memory segments.

Inventive Principle:
Principle #1Segmentation

2Productivity

If DRAM is optimized for high bandwidth, then latency decreases, but density decreases

Engineering Contradiction:
ImprovebandwidthVSAvoidmemory capacity
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The memory system is segmented into two distinct types of DRAM: high-density DRAM for capacity and low-density high-bandwidth DRAM for performance. This segmentation allows each memory type to be optimized independently for its specific function, resolving the contradiction between capacity and bandwidth by distributing different workloads to appropriate memory segments.

Inventive Principle:
Principle #1Segmentation

3Quantity of substance

If DRAM density is increased, then capacity increases, but energy efficiency decreases

Engineering Contradiction:
Improvememory capacityVSAvoidpower consumption
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The memory system is segmented into two distinct types of DRAM: high-density DRAM for capacity and low-density high-bandwidth DRAM for performance. This segmentation allows each memory type to be optimized independently for its specific function, resolving the contradiction between capacity and bandwidth by distributing different workloads to appropriate memory segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different DRAM architectures and parameters are used for each memory type to optimize for their specific functions. The high-density DRAM uses parameters optimized for capacity while the low-density high-bandwidth DRAM uses parameters optimized for performance and energy efficiency during active operations.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11830534B2Memory system having combined high density, low bandwidth and low density, high bandwidth memories
Publication Date: 2023.11.28 APPLE INC
  • US11830534B2 patent drawing
  • US11830534B2 patent drawing
  • US11830534B2 patent drawing

AI summary

In an embodiment, a memory system may include at least two types of DRAM, which differ in at least one characteristic. For example, one DRAM type may be a high density DRAM, while another DRAM type may have lower density but may also have lower latency and higher bandwidth than the first DRAM type. DRAM of the first type may be on one or more first integrated circuits and DRAM of the second type may be on one or more second integrated circuits. In an embodiment, the first and second integrated circuits may be coupled together in a stack. The second integrated circuit may include a physical layer circuit to couple to other circuitry (e.g., an integrated circuit having a memory controller, such as a system on a chip (SOC)), and the physical layer circuit may be shared by the DRAM in the first integrated circuits.