Buffer Chip Delay Calibration for High-Capacity Memory Packages

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computer systems face challenges in increasing memory capacity while maintaining low latency and high bandwidth due to issues such as latency and bandwidth limitations, making it difficult to add memory effectively.

Innovation Solution

A semiconductor package design incorporating a buffer chip with a control signal and data transmission path that includes a variable delay circuit, a ring oscillator, counter circuit, and code generation circuit to adjust delay values, ensuring consistent performance across varying temperatures and voltages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If memory capacity is increased to meet growing data processing requirements, then the amount of memory available for AI and big data applications increases, but latency increases and bandwidth decreases

Engineering Contradiction:
Improvememory capacityVSAvoidlatency
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The system is divided into multiple memory chips (first memory chip, second memory chip, etc.) that can be independently accessed. The buffer chip separates control signal processing from data storage, allowing parallel operations where different memory chips can be accessed simultaneously without interfering with each other, thus maintaining low latency while providing large total capacity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A buffer chip is introduced as an intermediary component between the memory controller and multiple memory chips. The buffer chip receives control signals from the memory controller, generates appropriate internal control signals for different memory chips, and manages data flow between them. This intermediary layer enables efficient coordination of multiple memory chips, allowing the system to achieve both high capacity and low latency through parallel access operations

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If memory capacity is increased by adding more memory chips, then the total memory available increases, but the complexity of the system increases

Engineering Contradiction:
Improvememory capacityVSAvoidsystem complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The buffer chip serves multiple functions: it acts as a signal router, control signal generator, data buffer, and timing synchronizer. By consolidating these diverse functions into a single multi-functional component, the system avoids the need for separate dedicated circuits for each function, thereby reducing overall system complexity while supporting multiple memory chips

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The buffer chip combines control signal processing, data buffering, and timing management functions into a single integrated component. Multiple memory chips are merged into a unified memory system managed by the buffer chip, which handles all communications between the memory controller and the memory chips. This consolidation reduces the number of separate control paths and simplifies system architecture

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If asynchronous delay compensation is implemented to maintain consistent performance, then performance consistency across varying temperatures and voltages improves, but the device complexity increases

Engineering Contradiction:
Improveperformance consistencyVSAvoidcircuit complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The buffer chip includes delay detection circuits that continuously monitor the actual delay of control signals and data signals. Based on the detected delay values, the buffer chip dynamically adjusts timing parameters and synchronizes signal transmission. This feedback mechanism enables the system to automatically compensate for temperature and voltage variations, maintaining consistent performance without requiring complex external calibration equipment

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The buffer chip performs self-calibration by internally detecting its own signal delays and automatically adjusting its timing parameters. The delay detection circuits within the buffer chip measure the actual delay characteristics of the circuit paths and use this information to optimize signal timing. This self-service approach eliminates the need for external calibration equipment or complex manual adjustment mechanisms

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250364031A1Buffer chip, and semiconductor package including buffer chip and memory chip
Publication Date: 2025.11.27 SK HYNIX INC
  • US20250364031A1 patent drawing
  • US20250364031A1 patent drawing
  • US20250364031A1 patent drawing

AI summary

A buffer chip includes a control signal transmission path that transmitting, to a memory chip, control signals transmitted from a memory controller; a data transmission path including a variable delay circuit having a delay value adjusted by a delay code and transmitting, to the memory controller, data transmitted from the memory chip; a ring oscillator generating a ring oscillator clock; a counter circuit configured to count the number of toggles of the ring oscillator clock while an external clock toggles a reference number of times; a reference value storage circuit configured to store a counting value of the counter circuit as a reference value; a current value storage circuit configured to store the counting value of the counter circuit as a current value in response to a comparison signal; and a code generation circuit configured to generate the delay code by comparing the reference value with the current value.