3D Wafer Scale Processor-Memory Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional von Neumann architecture faces limitations in CPU-memory bandwidth, hindering the processing of large amounts of unconventional and unstructured data, such as text, video, and images, which requires high memory and communication bandwidths similar to human brain processing techniques.

Innovation Solution

A processor-memory system with specialized processors embedded in a memory area, managed by a general management processor, utilizing three-dimensional wafer scale integration (WSI) to alleviate bandwidth issues by distributing memory-intensive processing across multiple wafers with high-density Through Silicon Vias for connectivity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional von Neumann architecture is used, then system structure is simple, but CPU-memory bandwidth is insufficient for processing large amounts of unconventional data

Engineering Contradiction:
Improvememory and communication bandwidthVSAvoidsystem architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system is segmented into multiple specialized processor wafers, each handling specific processing tasks, with memory distributed across separate memory wafers. This segmentation eliminates the single bottleneck of conventional von Neumann architecture by creating parallel processing paths, thereby increasing aggregate memory and communication bandwidth while managing complexity through modular organization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from the traditional two-dimensional planar architecture to a three-dimensional stacked wafer architecture. Multiple processor wafers and memory wafers are stacked vertically and connected through high-density interconnects, adding a vertical dimension to data flow paths. This dimensional change dramatically increases bandwidth by providing multiple simultaneous data paths between processors and memory.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If multiple specialized processor wafers are stacked to increase bandwidth, then memory and communication bandwidth increases, but heat dissipation becomes a challenge

Engineering Contradiction:
Improveaggregate bandwidthVSAvoidheat dissipation
Core Design Contradiction:
ProductivityVSTemperature

Solution Approach 1:

The patent implements local quality by strategically distributing high-power specialized processors and memory components across different wafers in the stack, rather than concentrating them in one location. This spatial distribution of computational workload and memory access patterns localizes heat generation to specific regions, enabling more effective thermal management through targeted cooling solutions and improving overall heat dissipation efficiency.

Inventive Principle:
Principle #3Local quality

3Productivity

If three-dimensional wafer scale integration is implemented, then connectivity and bandwidth improve, but manufacturing precision requirements increase

Engineering Contradiction:
Improvecommunication bandwidthVSAvoidwafer stacking and alignment precision
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by pre-configuring alignment features, bonding interfaces, and interconnect structures on each wafer before stacking. Test structures and calibration patterns are fabricated in advance on the wafers, allowing for precise measurement and adjustment of alignment during the stacking process. This preliminary preparation significantly reduces the actual stacking precision requirements while maintaining high communication bandwidth through the three-dimensional interconnect architecture.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10613754B2Architecture and implementation of cortical system, and fabricating an architecture using 3D wafer scale integration
Publication Date: 2020.04.07 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10613754B2 patent drawing
  • US10613754B2 patent drawing
  • US10613754B2 patent drawing

AI summary

A processor-memory system, a stacked-wafer processor-memory system, and a method of fabricating a processor-memory system are disclosed. In an embodiment, the invention provides a processor-memory system comprising a memory area, a multitude of specialized processors, and a management processor. The specialized processors are embedded in the memory area, and each of the specialized processors is configured for performing a specified set of operations using an associated memory domain in the memory area. The management processor is provided to control operations of an associated set of the specialized processors. In one embodiment, each of the specialized processors controls a respective one associated memory domain in the memory area. In an embodiment, the processor-memory system further comprises a specialized processor wafer. The specialized processor wafer includes the memory area, and the multitude of specialized processors are embedded in the specialized processor wafer.