Active I/O Expander Serial Interface for High-Bandwidth Memory Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory sub-systems face inefficiencies when trying to match the increasing speed and bandwidth of host systems due to the limitations of parallel interfaces, which result in increased space requirements, parasitic effects, and reduced energy efficiency, making it costly and inefficient to add more channels or increase channel speeds.

Innovation Solution

Implementing a serial interface for an active input/output expander (AIOE) between the memory sub-system controller and the memory devices, allowing for increased bandwidth while maintaining a smaller footprint and energy efficiency by using differential signal lanes and reducing the number of PCB layers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If parallel interfaces are used to increase bandwidth and match host system speed, then data transfer speed is improved, but parasitic effects increase and energy efficiency decreases

Engineering Contradiction:
Improvedata transfer speedVSAvoidparasitic effects
Core Design Contradiction:
SpeedVSObject-generated harmful factors

Solution Approach 1:

The patent replaces the traditional parallel mechanical/electrical interface with a serial interface that uses differential signaling (such as PCIe or CXL protocols). This substitution transforms the data transmission mechanism from multiple simultaneous parallel channels to a serialized differential signal approach, which inherently reduces parasitic capacitance and inductance effects while maintaining high data transfer speeds through advanced encoding and clock recovery techniques.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If more channels or higher channel speeds are added to parallel interfaces, then bandwidth is improved, but space requirements and device complexity increase

Engineering Contradiction:
ImprovebandwidthVSAvoidspace requirements
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent transitions from a parallel dimension approach (multiple simultaneous channels) to a temporal dimension approach (serial transmission with high-frequency differential signaling). By encoding multiple data bits across time rather than space, the interface achieves high bandwidth equivalent to multiple parallel channels while using significantly fewer physical conductors and PCB trace layers, thereby reducing board space and component complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If parallel interfaces are used, then data transfer capability is improved, but the number of PCB layers and manufacturing complexity increase

Engineering Contradiction:
Improvedata transfer capabilityVSAvoidPCB manufacturing complexity
Core Design Contradiction:
ProductivityVSEase of manufacture

Solution Approach 1:

The patent replaces complex multi-layer PCB parallel signal routing with a simplified serial differential pair routing approach. This substitution reduces the number of required PCB layers from multiple signal layers to fewer layers, simplifies impedance control requirements, reduces via counts, and eases manufacturing tolerances while maintaining or improving data transfer capability through differential signaling integrity and equalization techniques.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Speed

If parallel interfaces are used to maintain I/O speed, then data transfer rate is preserved, but energy efficiency decreases

Engineering Contradiction:
ImproveI/O speedVSAvoidenergy efficiency
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent replaces energy-intensive parallel signal switching and driving with a more efficient serial differential signaling system. The differential pairs utilize lower voltage swings and fewer simultaneous signal transitions, reducing dynamic power consumption. Additionally, the serial interface enables more efficient clock recovery and data encoding schemes that minimize unnecessary signal activity, thereby maintaining high I/O speeds while significantly improving energy efficiency compared to traditional parallel interfaces.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12130755B2Serial interface for an active input/output expander of a memory sub-system
Publication Date: 2024.10.29 MICRON TECHNOLOGY INC
  • US12130755B2 patent drawing
  • US12130755B2 patent drawing
  • US12130755B2 patent drawing

AI summary

An input/output (I/O) command referencing a logical address of a memory sub-system is received by an active input/output expander (AIOE). The I/O command is received from a memory sub-system controller via the AIOE. The AIOE identifies a physical block address corresponding to the logical block address. The AIOE identifies, among a plurality of memory devices, a memory device associated with the physical block address. The AIOE converts the I/O command received via the serial interface to a parallel interface compliant I/O command. The AIOE sends the parallel interface compliant I/O command to the memory device.