Photonic Neural Network Optical Fourier Convolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Convolutional neural networks face challenges with high computational demands and power consumption due to the processing of large amounts of data, which can overwhelm computational capacity and limit efficiency in pattern recognition tasks.

Innovation Solution

A photonic neural network system that employs optical Fourier transforms for convolution operations, utilizing a radial modulator and sensor-display devices to perform convolutions at the speed of light with low noise and power consumption, supporting existing convolutional neural network architectures and training methods.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If digital computational methods are used for convolution operations, then computational flexibility and adaptability are maintained, but processing speed decreases and power consumption increases

Engineering Contradiction:
Improveprocessing speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent replaces digital computational systems with optical systems to perform convolution operations. Light fields are used to represent data, and optical components (lenses, modulators, detectors) substitute for digital processors, enabling parallel processing at the speed of light with significantly reduced power consumption.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transitions from sequential digital computation to parallel optical processing by utilizing the spatial dimension of light fields. Multiple data points are encoded in the spatial distribution of light, allowing simultaneous processing of entire images or data sets rather than pixel-by-pixel computation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If larger amounts of data are processed through multiple layers, then recognition accuracy improves, but computational capacity becomes overwhelmed

Engineering Contradiction:
Improverecognition accuracyVSAvoidcomputational capacity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent uses optical fields to process entire images or data sets in parallel across multiple layers simultaneously. The spatial dimension of light allows all pixels to be processed at once, maintaining computational capacity even as data volume and layer depth increase, thereby enabling higher recognition accuracy without overwhelming the system.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If full-frame image parallelism is implemented, then processing efficiency increases, but system complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces complex digital processing architectures with simpler optical components. Instead of using multiple processors and memory units to achieve parallelism, the system uses passive optical elements (lenses, mirrors, modulators) that naturally perform parallel operations, reducing system complexity while maintaining high processing efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly enhances speed and power efficiency, enabling nearly 100% efficient full-frame image parallelism and deeper convolutional layers, outperforming traditional digital methods in terms of power consumption and processing speed.

Implementation Method 1

A photonic neural network system that employs optical Fourier transforms for convolution operations

Methodology Applied
Scientific EffectFourier transform:

Implementation Method 2

utilizing a radial modulator and sensor-display devices to perform convolutions at the speed of light

Methodology Applied
Scientific EffectLight modulation:

Implementation Method 3

utilizing a radial modulator and sensor-display devices to perform convolutions at the speed of light

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS11410028B2Photonic neural network system
Publication Date: 2022.08.09 LOOK DYNAMICS INC
  • US11410028B2 patent drawing
  • US11410028B2 patent drawing
  • US11410028B2 patent drawing

AI summary

A system (10) for convolving and adding frames of data comprises a first sensor-display device (14) and a second sensor display device (26). Each sensor display device (14, 26) comprises an array (80) of transmit-receive modules (82). Each transmit-receive module (82) comprises a light sensor element (86), a light transmitter element (84), and a memory bank (90). A radial modulator device (20) is positioned where transmission of light fields comprising frames of data are Fourier transformed. Filters implemented by modulator elements of the radial modulator device (20) convolve the fields of light comprising the frames of data, which are then sensed on a pixel-by-pixel basis by the light sensor elements (86), which accumulate charges, thus sum pixel values of sequential convolved frames of data.