Die-to-Die Bridge Interfaces for Flexible HBM Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The integration of High Bandwidth Memory (HBM) with Systems on a Chip (SoC) is limited by spatial constraints, leading to restricted memory bandwidth and capacity, which hampers system performance in data-intensive applications, and requires rigid design modifications that restrict flexibility and adaptability.

Innovation Solution

Incorporating a bridge circuit with optimized interfaces between SoC and HBM, allowing for extended routing lengths and embedding digital logic within the bridge circuit to support high data rates, thereby breaking design constraints and enabling flexible, high-speed data transmission without affecting the SoC.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If HBM is positioned adjacently to the SoC edge to ensure short electrical connections, then signal transmission quality is improved, but the periphery of the SoC becomes a restricting factor that limits the number of HBMs that can be integrated

Engineering Contradiction:
Improvesignal transmission qualityVSAvoidnumber of HBMs that can be integrated
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

An interposer is introduced as an intermediary component between the SoC and HBM stacks. The interposer provides a platform with multiple HBM stack attachment locations, allowing multiple HBMs to be integrated without directly constraining the SoC periphery. The interposer handles signal routing and transmission, mediating the connection between SoC and multiple HBMs while maintaining signal quality through controlled impedance pathways.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the SoC size is expanded to accommodate more HBM, then memory bandwidth and capacity are improved, but manufacturing constraints are confronted and cost escalates

Engineering Contradiction:
Improvememory bandwidth and capacityVSAvoidmanufacturing constraints and cost
Core Design Contradiction:
ProductivityVSEase of manufacture

Solution Approach 1:

The system is segmented into separate functional components: the SoC, multiple HBM stacks, and an interposer. This segmentation allows each component to be manufactured independently at optimal scales and then assembled together. The interposer acts as a modular platform that can accommodate different numbers and configurations of HBM stacks, providing manufacturing flexibility without requiring large-scale SoC expansions.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240429204A1Systems and methods for semiconductor devices with die-to-die interfaces
Publication Date: 2024.12.26 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US20240429204A1 patent drawing
  • US20240429204A1 patent drawing
  • US20240429204A1 patent drawing

AI summary

The subject technology is directed to systems and methods for semiconductor devices with die-to-die interfaces. In an embodiment, the subject technology provides an apparatus that includes a first circuit comprising a first interface. The apparatus further includes a first memory device coupled to the first circuit through a second circuit. The second circuit includes a second interface coupled to the first memory device and a third interface coupled to the first circuit. The one or more interfaces of the apparatus are optimized to support a high data rate, breaking the design constraints between the circuit and the associated memory devices. There are other embodiments as well.