Electro-Optic Activation Circuit for Tunable Photonic Neural Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Photonic neural networks face challenges in implementing nonlinear activation functions due to weak optical nonlinearities, which are fixed during device fabrication, limiting their tunability and performance, especially in deep networks where signal power drops below activation thresholds, and conventional digital approaches add latency and scalability issues.

Innovation Solution

An electro-optic architecture that converts a small portion of the optical input signal into an electrical voltage to modulate the original optical signal using a phase shifter and interferometer, allowing for reconfigurable nonlinear responses and low activation thresholds without reducing operating speed or bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional optical nonlinearities are used for activation functions, then the device structure is simple, but the nonlinearity is weak and fixed during fabrication, limiting tunability and performance

Engineering Contradiction:
Improvetunability of activation functionVSAvoidcomplexity of electro-optic architecture
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary electrical domain as a mediator between optical input and optical output. A photodetector converts optical signal to electrical signal, which then passes through an electronic nonlinear activation function, and finally an electro-optic modulator converts it back to optical signal. This intermediary approach enables strong, tunable nonlinearities while maintaining optical signal processing benefits.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces weak optical nonlinearities with strong electrical nonlinearities. By converting the optical signal to electrical domain for activation processing, the system benefits from the strength and tunability of electrical nonlinear circuits, which can be easily programmed and adjusted without physical reconfiguration.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Speed

If digital approaches are used for activation functions, then nonlinear responses can be achieved, but latency increases and scalability is limited

Engineering Contradiction:
Improveoperating speed of activation functionVSAvoidlatency introduced by digital processing
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent replaces digital electronic processing with analog electro-optic processing. Instead of converting optical signals to digital format for processing and back, the system uses analog photodetection and electro-optic modulation, maintaining the analog nature of the signal throughout and avoiding the latency associated with digital conversion and processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent maintains continuous analog signal processing from optical input through photodetection, electronic activation, electro-optic modulation, and back to optical output. This continuous analog processing eliminates the discontinuities and conversion steps inherent in digital approaches, preserving operating speed and minimizing latency.

Inventive Principle:
Principle #20Continuity of useful action

3Use of energy by moving object

If optical signal power is reduced in deep networks, then energy efficiency improves, but signal power drops below activation thresholds

Engineering Contradiction:
Improveenergy efficiency of photonic neural networkVSAvoidsignal power above activation threshold
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The patent uses the electrical domain as an intermediary to amplify weak optical signals. The photodetector converts weak optical signals to electrical signals, which can then be amplified by electronic amplifiers before being converted back to optical signals by the electro-optic modulator. This electrical amplification stage enables the system to maintain signal power above activation thresholds while keeping input optical power low for energy efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables photonic neural networks to perform well on machine learning tasks with complete on-off contrast in signal transmission, varied nonlinear responses, and low activation thresholds, overcoming the limitations of traditional optical nonlinearities and digital processing methods.

Implementation Method 1

an optical-to-electrical conversion circuit, which converts an optical signal from the directional coupler to an electrical signal used to activate the phase shifter

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

the electrical signal shifts the phase of the delayed signal

Methodology Applied
Scientific EffectElectro-Optic Effect: Electro-Optic Effects

Implementation Method 3

the phase shifter is embedded in an interferometer to modulate the intensity of the delayed signal

Methodology Applied
Scientific EffectInterference: Interference

Data Source

PatentUS11460753B2Systems and methods for activation functions for photonic neural networks
Publication Date: 2022.10.04 THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIV
  • US11460753B2 patent drawing
  • US11460753B2 patent drawing
  • US11460753B2 patent drawing

AI summary

Systems and methods for activation in an optical circuit in accordance with embodiments of the invention are illustrated. One embodiment includes an optical activation circuit, wherein the circuit comprises a directional coupler, an optical-to-electrical conversion circuit, a time delay element, a nonlinear signal conditioner, and a phase shifter. The directional coupler receives an optical input and provides a first portion to the optical-to-electrical conversion circuit and a second portion to the time delay element, the time delay element provides a delayed signal to the phase shifter, and the optical-to-electrical conversion circuit converts an optical signal from the directional coupler to an electrical signal used to activate the phase shifter to shift the phase of the delayed signal.