Optical Interchange for Shared Memory in High-Bandwidth Computing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in efficiently fitting additional memory and computing dies onto packages for high-speed computing, with inefficient data transmission and utilization of electrical connections.
Innovation Solution
A system utilizing an optical interchange that acts as both a switch and demultiplexer for high-bandwidth data transmission between computing and memory units, allowing any computing unit to write to any memory unit and broadcast data from memory to multiple computing units via optical connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If additional memory and computing dies are integrated onto packages using electrical transmissions, then memory capacity and computing power increase, but transmission efficiency and bandwidth deteriorate
Solution Approach 1:
The patent replaces electrical transmission systems with optical transmission systems. Optical interconnects use light signals instead of electrical signals to transmit data between memory dies and computing dies, enabling higher bandwidth and faster transmission speeds while maintaining signal integrity over longer distances within the package.
Solution Approach 2:
The patent changes the transmission medium parameter from electrical conductors to optical waveguides. This parameter change enables transmission speeds and bandwidths that are orders of magnitude higher than electrical transmissions, directly resolving the contradiction between increased memory capacity and maintained transmission efficiency.
2Productivity
If optical transmission is used to connect memory and computing units, then bandwidth and transmission speed increase, but system complexity increases
Solution Approach 1:
The patent integrates multiple optical interconnect functions into a unified optical interchange structure. The optical interchange combines switching, routing, and signal distribution capabilities into a single integrated component, reducing the number of separate optical components needed and simplifying the overall system architecture while maintaining high bandwidth capabilities.
Solution Approach 2:
The optical interchange serves multiple functions simultaneously: it acts as a switch for directing data flows, a router for selecting transmission paths, and a signal distributor for broadcasting data to multiple destinations. This multi-functionality reduces system complexity by eliminating the need for separate components for each function.
3Adaptability or versatility
If memory and computing units are disaggregated across separate packages, then flexibility and scalability improve, but connection bandwidth and latency worsen
Solution Approach 1:
The patent replaces traditional electrical interconnects with optical interconnects to bridge separate packages. The optical connection medium (optical cables or waveguides) enables high-bandwidth communication between disaggregated memory and computing units, maintaining fast data transfer speeds even when components are physically separated into different packages.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The disclosure provides for high bandwidth processing through the sharing of memory dies (104) over a plurality of computing dies (102) via an optical interchange (106). The optical interchange may be configured so as to operate as both an optical switch (108) and optical demultiplexer (107). The optical switch (108) configuration for the optical interchange (106) allows for data to be written from any computing die (102) to one of a plurality of memory dies (104) via an optical connection. The optical demultiplexer (107) configuration allows for data to be broadcast from a memory die (104) to a plurality of the computing dies (102).