Stacked Memory Contact Layout for High-Bandwidth Low-Power I/O

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing power constraints of shrinking processing units limit the development of faster data transmission between computing units and memory, necessitating a solution that enhances off-chip bandwidth without sacrificing low-power performance.

Innovation Solution

A memory system is designed with a contact element connecting a data storage device and a data processing device, allowing for the data processing device to receive and transmit signals before they reach the data storage device, thereby increasing bandwidth through multiplexing and other functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data transmission speed is increased between computing units and memory, then bandwidth is improved, but power consumption increases

Engineering Contradiction:
Improvedata transmission bandwidthVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent combines the data processing device with the data storage device into a single memory package, integrating multiple functions (storage, processing, and I/O operations) into one unified system. This merging eliminates the need for separate communication channels between discrete components, thereby increasing bandwidth while reducing overall power consumption through shared infrastructure and shorter signal paths.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The data processing device within the memory package serves multiple functions: it processes data signals from the data storage device, handles I/O operations, and manages communication with external devices. This multi-functionality allows the system to achieve high bandwidth for various operations without requiring separate dedicated hardware for each function, thus improving productivity while controlling power usage.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Use of energy by stationary object

If processing units are made smaller to reduce power consumption, then power constraints are reduced, but data transmission capability deteriorates

Engineering Contradiction:
Improvepower consumptionVSAvoiddata transmission capability
Core Design Contradiction:
Use of energy by stationary objectVSProductivity

Solution Approach 1:

The patent implements a nested structure where the data processing device is disposed over the data storage device within the same package footprint. This nesting arrangement allows smaller, low-power components to be integrated in three-dimensional space, enabling the processing unit to remain small and power-efficient while still providing adequate data transmission capability through the vertical integration and direct contact elements.

Inventive Principle:
Principle #7Nested doll (Nesting)

Solution Approach 2:

The patent transitions from a traditional planar two-dimensional layout to a three-dimensional vertical integration architecture. The data processing device is positioned vertically over the data storage device, utilizing the vertical dimension to achieve close proximity and high-speed data transmission without increasing the horizontal footprint or power consumption of the processing unit.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If a contact element is added between data storage device and data processing device, then electrical connection is improved, but device complexity increases

Engineering Contradiction:
Improveelectrical connection reliabilityVSAvoidstructure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The contact element serves as an intermediary component that provides reliable electrical connection between the data storage device and the data processing device. This simple mediator structure enables direct signal transmission without requiring complex wiring harnesses or multiple connection points, thereby improving electrical connection reliability while adding minimal structural complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration enhances bandwidth between the memory and external devices while maintaining low-power performance, reducing off-chip bandwidth demands and improving latency through a short conductive path within the memory system.

Implementation Method 1

The contact element electrically connects the data storage device with the data processing device

Methodology Applied
Scientific EffectElectrical conduction: Conduction (electrical)

Data Source

PatentUS12507402B2Memory with a contact between a data storage device and a data processing device
Publication Date: 2025.12.23 NAN YA TECH
  • US12507402B2 patent drawing
  • US12507402B2 patent drawing
  • US12507402B2 patent drawing

AI summary

A memory includes a data storage device, a data processing device, and a contact element. The data processing device is disposed over the data storage device. The contact element is disposed between the data storage device and the data processing device. The contact element electrically connects the data storage device with the data processing device.