Parallel Computing Architecture Using 3D Stacked TSV Interconnects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional computing systems fail to effectively simulate the human brain's massive parallelism and three-dimensional structure, limiting their ability to perform advanced computing functions like artificial intelligence due to inadequate connectivity and communication bandwidth.

Innovation Solution

A general-purpose parallel computing architecture is developed, featuring multiple interconnected processing cores, coprocessors, and reducer circuits, which enable high communication bandwidth and support advanced computing functions by mimicking the human brain's neural network structure using 3D integrated circuit techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional computing systems are used to simulate the human brain, then basic computing functions can be performed, but the connectivity and communication bandwidth are insufficient to match the brain's massive parallelism and three-dimensional structure

Engineering Contradiction:
ImproveconnectivityVSAvoidcommunication bandwidth
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from conventional two-dimensional planar interconnects to three-dimensional vertical interconnects using through-silicon vias (TSVs). This dimensional change enables direct vertical communication between stacked computing cores and memory modules, dramatically increasing connectivity and communication bandwidth while maintaining a compact form factor that mimics the brain's three-dimensional neural structure.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements a stacked architecture where computing cores, coprocessors, and memory modules are vertically nested in multiple layers. Each layer is interconnected through TSVs, creating a nested three-dimensional structure that enables massive parallelism and high-bandwidth communication, similar to the nested organization of neurons and synapses in the human brain.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Productivity

If the number of processing cores is increased to match brain parallelism, then advanced computing functions are enabled, but communication bandwidth and interconnect complexity become limiting factors

Engineering Contradiction:
ImproveparallelismVSAvoidinterconnect complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent uses three-dimensional stacking with vertical TSV interconnects to enable massive parallelism without proportionally increasing interconnect complexity. Multiple computing cores are arranged in vertical stacks, each core communicating directly with dedicated memory and coprocessor units through short vertical paths, eliminating the need for complex long-range horizontal interconnects required in two-dimensional architectures.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent divides the computing system into multiple independent but interconnected segments - computing cores, coprocessors, and memory modules - each organized in vertical stacks. This segmentation allows each unit to operate independently with dedicated resources, reducing interconnect complexity while enabling scalable parallelism through the aggregation of multiple segments.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If three-dimensional integration is implemented to improve connectivity, then communication bandwidth increases, but manufacturing precision requirements become more stringent

Engineering Contradiction:
ImproveconnectivityVSAvoidalignment precision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent incorporates misalignment compensation mechanisms in the form of compliant interposer layers and self-aligning features that absorb and compensate for manufacturing tolerances before they affect electrical connections. These cushioning elements are built into the stacking process to preemptively handle alignment variations, reducing the stringency of precision requirements.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The patent uses intermediate interposer substrates that provide a buffer layer between stacked components. These interposers contain through-vias and routing layers that can accommodate misalignment, acting as mediators that transfer signals while compensating for positioning errors, thereby reducing the precision requirements for direct core-to-core alignment.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10210134B2General-purpose parallel computing architecture
Publication Date: 2019.02.19 GOLDMAN SACHS & CO LLC
  • US10210134B2 patent drawing
  • US10210134B2 patent drawing
  • US10210134B2 patent drawing

AI summary

An apparatus includes multiple parallel computing cores, where each computing core is configured to perform one or more processing operations and generate input data. The apparatus also includes multiple parallel coprocessors associated with each computing core. The apparatus further includes multiple communication lines configured to transport the input data from each computing core to a designated one of the coprocessors associated with each of the computing cores, where the coprocessors are configured to process the input data and generate output data. In addition, the apparatus includes multiple reducer circuits, where each computing core is associated with one of the reducer circuits. Each reducer circuit is configured to receive the output data from each of the coprocessors of the associated computing core, to apply one or more functions to the output data, and to provide one or more results to the associated computing core.