Memory I/O Rate Alignment for Full-Bandwidth Data Output

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory components with non-uniform memory core data rates struggle to achieve data throughput at the full bandwidth of external signaling links due to resource conflicts and latency issues.

Innovation Solution

Implementing rate alignment logic within memory components to equalize data rates between internal memory cores and external link interfaces, allowing concurrent data access across multiple memory banks or dies at the full bandwidth of the link interface, despite varying core bandwidths.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If memory components with non-uniform memory core data rates are used, then memory core bandwidth varies across components, but data throughput at the full bandwidth of external signaling links cannot be achieved due to resource conflicts and latency issues

Engineering Contradiction:
Improvememory core bandwidth variationVSAvoiddata throughput
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

A buffer is introduced as an intermediary component between the memory core and the external link interface. The buffer temporarily stores data during rate alignment operations, enabling the memory core to operate at its native variable data rate while the external interface maintains full bandwidth throughput. This mediator resolves the rate mismatch without requiring changes to either the memory core or the external interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements dynamic rate alignment logic that adaptively adjusts data transfer rates between the memory core and external interface based on real-time conditions. The buffer management dynamically allocates storage resources and controls data flow to accommodate varying memory core bandwidths while maintaining optimal external link utilization, allowing the system to adapt to non-uniform memory core performance across different components.

Inventive Principle:
Principle #15Dynamics

2Productivity

If rate alignment logic is implemented to equalize data rates, then data throughput at full link interface bandwidth is achieved, but device complexity increases

Engineering Contradiction:
Improvedata throughputVSAvoidrate alignment logic
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The rate alignment functionality is segmented into modular components: a buffer for temporary data storage and control logic for rate management. This segmentation allows the complexity to be distributed and managed independently, with each component having a specific function. The buffer handles data storage while the control logic manages rate alignment, making the overall system more manageable and potentially reusable across different memory configurations.

Inventive Principle:
Principle #1Segmentation

3Productivity

If concurrent data access across multiple memory banks or dies is enabled, then data throughput increases, but resource conflicts and latency issues occur

Engineering Contradiction:
Improvedata throughputVSAvoidresource conflicts
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The buffer acts as a mediator that decouples concurrent access operations from resource conflicts. Multiple memory banks or dies can access the buffer simultaneously at different rates without interfering with each other, as the buffer absorbs the timing variations and rate mismatches. This intermediary capability enables true concurrent access while preventing resource conflicts from propagating through the system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20250217070A1Memory component with input/output data rate alignment
Publication Date: 2025.07.03 RAMBUS INC
  • US20250217070A1 patent drawing
  • US20250217070A1 patent drawing
  • US20250217070A1 patent drawing

AI summary

First data is read out of a core storage array of a memory component over a first time interval constrained by data output bandwidth of the core storage array. After read out from the core storage array, the first data is output from the memory component over a second time interval that is shorter than the first time interval and that corresponds to a data transfer bandwidth greater than the data output bandwidth of the core storage array.