HBM Data Path Training via IEEE 1500 Interface Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional DDR data path training methods are challenging to implement in High Bandwidth Memory (HBM) due to its wide interface and high frequency operations, which complicate the alignment of read and write DQS signals with the data eye, increasing complexity and requiring additional command sequences.

Innovation Solution

The use of an IEEE 1500 interface to configure HBM mode registers for read and write data path training, allowing independent logic for training that interacts with the PHY core, simplifying the training process and decoupling it from normal memory access functionality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional DDR data path training methods are used in HBM, then the training process can be implemented, but the complexity increases and additional command sequences are required due to wide interface and high frequency operations

Engineering Contradiction:
Improvetraining accuracyVSAvoidtraining logic complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the training logic into independent components that interact with the PHY core through a standardized interface. The training sequence generator, delay elements, and data comparison logic are separated into distinct functional blocks, allowing independent optimization and reducing overall system complexity while maintaining training accuracy for HBM's wide interface.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary training interface layer between the host controller and the PHY core. This intermediary handles the complex signal alignment and delay calibration, translating high-level training commands into low-level PHY control signals, thereby shielding the host from HBM-specific complexity while ensuring reliable data path training.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If conventional DDR training sequences are applied to HBM, then training can be performed, but the alignment of DQS signals with data eye becomes more difficult due to wide interface architecture

Engineering Contradiction:
ImproveDQS data eye alignment precisionVSAvoidsignal alignment difficulty
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements dynamic delay adjustment mechanisms that allow the DQS signal timing to be flexibly adjusted during training. Multiple delay elements with programmable tap positions enable fine-grained timing control, allowing the system to dynamically optimize DQS alignment with the data eye across all 128 bits of the wide interface, overcoming the static limitations of conventional DDR training sequences.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback loops where the trained data path performance is continuously monitored and used to adjust delay settings. The system reads back training data, compares it with expected values, and uses this feedback to iteratively refine DQS timing alignment, achieving precise measurement and correction of signal alignment issues across the wide HBM interface.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10067689B1Method and apparatus for high bandwidth memory read and write data path training
Publication Date: 2018.09.04 CADENCE DESIGN SYST INC
  • US10067689B1 patent drawing
  • US10067689B1 patent drawing
  • US10067689B1 patent drawing

AI summary

According to certain general aspects, the present embodiments relate to methods and apparatuses for performing read and write data path training in HBMs. In accordance with some aspects, embodiments configure HBM mode registers for read and write data path training using an IEEE 1500 interface is simpler than the traditional scenario. In accordance with other aspects, the logic for performing read and write data path training is independent from normal memory access functionality in the host, capable of independently interacting with a PHY core for performing read and write data path training.