Active I/O Expander Serial Interface for High-Bandwidth Memory Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional memory sub-systems face inefficiencies when trying to match the increasing speed and bandwidth of host systems due to the limitations of parallel interfaces, which result in increased space requirements, parasitic effects, and reduced energy efficiency, making it costly and inefficient to add more channels or increase channel speeds.
Innovation Solution
Implementing a serial interface for an active input/output expander (AIOE) between the memory sub-system controller and the memory devices, allowing for increased bandwidth while maintaining a smaller footprint and energy efficiency by using differential signal lanes and reducing the number of PCB layers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If parallel interfaces are used to increase bandwidth and match host system speed, then data transfer speed is improved, but parasitic effects increase and energy efficiency decreases
Solution Approach 1:
The patent replaces the traditional parallel mechanical/electrical interface with a serial interface that uses differential signaling (such as PCIe or CXL protocols). This substitution transforms the data transmission mechanism from multiple simultaneous parallel channels to a serialized differential signal approach, which inherently reduces parasitic capacitance and inductance effects while maintaining high data transfer speeds through advanced encoding and clock recovery techniques.
2Productivity
If more channels or higher channel speeds are added to parallel interfaces, then bandwidth is improved, but space requirements and device complexity increase
Solution Approach 1:
The patent transitions from a parallel dimension approach (multiple simultaneous channels) to a temporal dimension approach (serial transmission with high-frequency differential signaling). By encoding multiple data bits across time rather than space, the interface achieves high bandwidth equivalent to multiple parallel channels while using significantly fewer physical conductors and PCB trace layers, thereby reducing board space and component complexity.
3Productivity
If parallel interfaces are used, then data transfer capability is improved, but the number of PCB layers and manufacturing complexity increase
Solution Approach 1:
The patent replaces complex multi-layer PCB parallel signal routing with a simplified serial differential pair routing approach. This substitution reduces the number of required PCB layers from multiple signal layers to fewer layers, simplifies impedance control requirements, reduces via counts, and eases manufacturing tolerances while maintaining or improving data transfer capability through differential signaling integrity and equalization techniques.
4Speed
If parallel interfaces are used to maintain I/O speed, then data transfer rate is preserved, but energy efficiency decreases
Solution Approach 1:
The patent replaces energy-intensive parallel signal switching and driving with a more efficient serial differential signaling system. The differential pairs utilize lower voltage swings and fewer simultaneous signal transitions, reducing dynamic power consumption. Additionally, the serial interface enables more efficient clock recovery and data encoding schemes that minimize unnecessary signal activity, thereby maintaining high I/O speeds while significantly improving energy efficiency compared to traditional parallel interfaces.
Data Source
AI summary
An input/output (I/O) command referencing a logical address of a memory sub-system is received by an active input/output expander (AIOE). The I/O command is received from a memory sub-system controller via the AIOE. The AIOE identifies a physical block address corresponding to the logical block address. The AIOE identifies, among a plurality of memory devices, a memory device associated with the physical block address. The AIOE converts the I/O command received via the serial interface to a parallel interface compliant I/O command. The AIOE sends the parallel interface compliant I/O command to the memory device.


