Optical Interchange Switching for High-Bandwidth Memory–Compute Die Sharing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in efficiently fitting additional memory and computing dies onto packages for high-speed computing while maintaining efficient data transmission, as electrical transmissions are becoming limiting, and known optical systems provide inefficient utilization of memory and computing dies.
Innovation Solution
A system utilizing an optical interchange with demultiplexers and switches for high-bandwidth memory and computing units, allowing any computing unit to write to any memory unit and enabling simultaneous data broadcast from memory to multiple computing units via optical connections, with spare memory units to manage fault tolerance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If additional memory and computing dies are fitted onto packages for high-speed computing, then bandwidth and capacity increase, but electrical transmission efficiency deteriorates
Solution Approach 1:
The patent replaces electrical transmission systems with optical transmission systems. Optical interconnects use light instead of electrical signals to transmit data between memory dies and computing dies, eliminating the bottlenecks of electrical transmission while maintaining high bandwidth and capacity.
2Speed
If known optical transmission systems are used, then transmission speed improves, but memory and computing die utilization efficiency deteriorates
Solution Approach 1:
The patent implements a universal optical interconnect architecture where a single optical interface can serve multiple memory dies and computing dies. The system allows any computing die to access any memory die through the optical interconnect, enabling flexible resource allocation and improving overall utilization efficiency while maintaining high transmission speeds.
Solution Approach 2:
The patent employs dynamic resource allocation through software-controlled optical routing. The system can dynamically assign optical pathways based on real-time computational needs, allowing flexible mapping between computing dies and memory dies, thereby optimizing utilization efficiency without compromising transmission speed.
3Productivity
If optical interconnects are implemented, then bandwidth increases, but system complexity increases
Solution Approach 1:
The patent introduces an optical bridge or optical switch as an intermediary component that manages the optical connections between memory dies and computing dies. This intermediary handles the complexity of optical signal routing, wavelength management, and connection establishment, thereby enabling high bandwidth communication while shielding the computing and memory units from optical system complexity.
Data Source
AI summary
The disclosure provides for high bandwidth processing through the sharing of memory dies over a plurality of computing dies via an optical interchange. The optical interchange may be configured so as to operate as both an optical switch and optical demultiplexer. The optical switch configuration for the optical interchange allows for data to be written from any computing die to one of a plurality of memory dies via an optical connection. The optical demultiplexer configuration allows for data to be broadcast from a memory die to a plurality of the computing dies.