Photonic Neural Network Accelerator Using Winograd Filtering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current neural networks face high computational overhead in performing complex AI tasks, with existing acceleration methods being insufficiently effective.

Innovation Solution

A photonic network using the Winograd filtering algorithm for convolution operations, combined with coherent all-optical matrix multiplication and memristor-based analog memory, to reduce computational complexity and power consumption, leveraging wavelength-division multiplexing and integrated photonics for accelerated CNN processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If traditional electronic computing is used to perform convolutional neural network operations, then computational accuracy can be maintained, but power consumption is high and operating speed is limited

Engineering Contradiction:
Improvepower consumptionVSAvoidoperating speed
Core Design Contradiction:
Use of energy by moving objectVSSpeed

Solution Approach 1:

The patent replaces electronic computing systems with photonic computing systems. Specifically, it uses optical fields to perform convolution operations in neural networks, substituting the traditional electronic mechanical computing approach with light-based parallel processing, thereby achieving lower power consumption and higher operating speeds

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces wavelength-division multiplexing to add a spectral dimension to the computing process. By utilizing multiple wavelengths of light simultaneously, the system performs parallel computations across different wavelength channels, dramatically increasing computational throughput and speed while maintaining energy efficiency

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Speed

If computational complexity is reduced to increase speed, then operating speed improves, but computational precision may deteriorate

Engineering Contradiction:
Improveoperating speedVSAvoidcomputational precision
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent replaces sequential electronic computation with parallel photonic computation. The optical system performs full-precision convolution operations simultaneously across all data points using light interference and diffraction, maintaining computational precision while achieving massive speedup through parallel processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent designs a universal photonic computing platform that can perform various neural network operations (convolution, matrix multiplication, activation functions) using the same optical hardware. This multi-functional system maintains precision across different computational tasks by using fundamental optical phenomena that naturally preserve computational accuracy

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If more computational resources are allocated to handle complex AI tasks, then task capability improves, but power consumption increases

Engineering Contradiction:
Improvetask capabilityVSAvoidpower consumption
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent adds the wavelength dimension to computational resources. By using wavelength-division multiplexing, the system can process multiple different AI tasks or data streams simultaneously on the same photonic hardware, each on a different wavelength channel. This increases task capability without proportionally increasing power consumption, as the same physical infrastructure handles multiple workloads in parallel

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent segments the computational process into distinct optical components (modulators, interferometers, detectors) that can be independently optimized and configured for different AI tasks. This modular photonic architecture allows the system to adapt to various computational requirements while maintaining energy efficiency through specialized hardware design for each functional segment

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly reduces power consumption and increases operating speed, enabling efficient execution of AI tasks with reduced dynamic power usage and enhanced computational parallelism.

Implementation Method 1

coherent all-optical matrix multiplication

Methodology Applied
Scientific EffectCoherent all-optical matrix multiplication: Coherent Light

Implementation Method 2

wavelength-division multiplexing

Methodology Applied
Scientific EffectWavelength-division multiplexing: Dispersion (of waves)

Implementation Method 3

microring resonator neuron

Methodology Applied
Scientific EffectMicroring resonator: Resonance

Implementation Method 4

photodetector

Methodology Applied
Scientific EffectPhotodetection: Photoelectric Effect

Data Source

PatentUS11704550B2Optical convolutional neural network accelerator
Publication Date: 2023.07.18 GEORGE WASHINGTON UNIVERSITY
  • US11704550B2 patent drawing
  • US11704550B2 patent drawing
  • US11704550B2 patent drawing

AI summary

An accelerator for modern convolutional neural networks applies the Winograd filtering algorithm in a wavelength division multiplexing integrated photonics circuit modulated by a memristor-based analog memory unit.