HBM Interface Die Command Control Circuit for Propagation Delay Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D memory devices face challenges in optimizing data reliability, memory access speed, power consumption, and chip size reduction, particularly in the context of High Bandwidth Memory (HBM) architectures, where propagation delays and command signal processing inefficiencies hinder optimal performance.

Innovation Solution

The implementation of a command control circuit with advanced sampling and gating mechanisms, including flip-flop circuits and delay circuits, to manage clock signals and command/address signals, ensuring precise timing and synchronization across interface and core dies, thereby reducing propagation delays and enhancing data processing efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If 3D memory devices are stacked vertically with multiple core dies, then memory capacity and bandwidth are improved, but propagation delays and command signal processing time increase

Engineering Contradiction:
Improvememory capacityVSAvoidpropagation delay
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The memory system is divided into multiple independent stack groups, each with its own command control circuit and set of core dies. This segmentation allows parallel processing of commands across different stacks, reducing overall propagation delay while maintaining high memory capacity through vertical stacking.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Command control circuits pre-process and validate commands before forwarding them to memory arrays. Address decoding and command validation are performed in advance, so that when data access is requested, the actual memory operation can begin immediately without additional processing delays.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If multiple input/output channels are implemented across stacked dies, then data transmission bandwidth is improved, but command signal synchronization complexity increases

Engineering Contradiction:
Improvedata transmission bandwidthVSAvoidcommand signal synchronization
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Interface dies serve as intermediary components between the external environment and core dies. They receive and decode commands, then distribute them to appropriate core dies through standardized I/O channels. This intermediary layer simplifies synchronization by providing a single point of command distribution rather than requiring direct coordination between multiple core dies.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The I/O channels are designed with universal protocols that can handle multiple functions including command transmission, address routing, and data transfer across all stack groups. This multi-functionality reduces the need for separate dedicated circuits for each function, thereby simplifying overall synchronization complexity while maintaining high bandwidth.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Length of moving object

If through-silicon vias are used to interconnect stacked dies, then interconnect length is reduced and power consumption decreases, but manufacturing precision requirements increase

Engineering Contradiction:
Improveinterconnect lengthVSAvoidvia alignment precision
Core Design Contradiction:
Length of moving objectVSManufacturing precision

Solution Approach 1:

The design incorporates redundant TSV pathways and flexible routing within the interface die to compensate for potential misalignments. If some TSV connections are slightly off-target, alternative pathways are already prepared to maintain connectivity, thereby reducing the stringency of manufacturing precision requirements while still achieving short interconnect lengths.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

4Reliability

If command control circuits with advanced sampling and gating mechanisms are implemented, then timing precision and data reliability are improved, but circuit complexity and power consumption increase

Engineering Contradiction:
Improvedata reliabilityVSAvoidcircuit complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The command control circuits use periodic clock signals to synchronize sampling and gating operations. By operating in discrete clock cycles rather than continuous operation, the circuits achieve precise timing control and high data reliability while reducing average power consumption compared to continuously active circuits.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The sampling and gating mechanisms are designed to operate continuously during active memory operations without requiring reset or reconfiguration between transactions. This continuous operation maintains high reliability by avoiding state transitions that could introduce errors, while the efficient design minimizes the additional power consumption that would result from continuous operation.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10424354B2Stack access control for memory device
Publication Date: 2019.09.24 MICRON TECHNOLOGY INC
  • US10424354B2 patent drawing
  • US10424354B2 patent drawing
  • US10424354B2 patent drawing

AI summary

Apparatuses and methods including an interface die that interfaces with dice through memory channels are described. An example apparatus includes a first die. The first die receives a first command including first command information and second command information provided after the first command information. The first die changes an order of providing the first command information and the second command information and provides a second command to a second die, the second command including the second command information and the first command information provided after the second command information in the changed order. The first command information is related to a command function and the second command information is related to a destination of the command function.