Full-Analog Photonic Neural Network for Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image recognition technologies based on full-analog photonic neural networks face challenges such as complexity in neural network structure, high time and energy costs, limitations in scaling, and inefficiencies in communication between computing units, leading to restricted recognition capabilities and physical dimensions.

Innovation Solution

A device and method for image recognition using a full-analog photonic neural network that employs a 3D holographic memory to store data in the form of Fourier convolution matrices, eliminating the need for multiple matrix multiplications and sampling operations, and allowing for a single optical operation to perform image recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple layers of diffractive optical computing modules are added to perform recognition tasks by cascading optical blocks, then recognition capability is improved, but device complexity and physical dimensions increase significantly

Engineering Contradiction:
Improverecognition capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple optical computing layers into a single integrated photonic neural network chip. The neural network is directly fabricated on the photonic chip, merging what would otherwise be separate optical blocks into one unified device, thereby maintaining recognition capability while reducing system complexity and physical dimensions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from traditional multi-layer cascaded optical systems to a planar photonic neural network architecture where computation occurs in the spatial domain of the chip itself. This dimensional reorganization allows complex recognition tasks to be performed without stacking multiple physical layers, reducing the system's physical footprint and complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If continuous signals are transformed into discrete digital form using digital semiconductor electronic components, then data processing capability is improved, but spectral distortions occur and energy consumption increases

Engineering Contradiction:
Improvedata processing capabilityVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The patent replaces digital semiconductor electronic components with an all-optical processing system. Optical signals are processed directly through the photonic neural network without conversion to electrical/digital domains, eliminating the energy-intensive analog-to-digital conversion process while maintaining data processing capability through optical computation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent maintains continuous optical signals throughout the processing pipeline, avoiding discrete digital sampling and conversion. The neural network operates on continuous optical waveforms, preserving spectral information and eliminating the energy losses associated with repeated analog-to-digital and digital-to-analog conversions required in traditional hybrid systems.

Inventive Principle:
Principle #20Continuity of useful action

3Measurement precision

If sampling operations are performed before photonic computation to handle complex neural network structures, then recognition accuracy is improved, but spectral distortions are introduced and time consumption increases

Engineering Contradiction:
Improverecognition accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by directly encoding the neural network weights and structure into the photonic chip's physical architecture during fabrication. This eliminates the need for runtime sampling and digital preprocessing, as the network is pre-configured to process continuous optical signals directly, thereby maintaining accuracy while reducing time consumption.

Inventive Principle:
Principle #10Preliminary action

4Power

If multiple computing units are connected in single or intergroup communication to perform neural network operations, then computational power is improved, but communication efficiency deteriorates and time consumption increases

Engineering Contradiction:
Improvecomputational powerVSAvoidcommunication efficiency
Core Design Contradiction:
PowerVSProductivity

Solution Approach 1:

The patent merges multiple computing units into a single integrated photonic neural network chip where all neurons and synapses are fabricated together. This eliminates the need for communication between separate computing units, as all computations occur within the same photonic substrate through optical signal propagation, thereby maintaining computational power while dramatically improving communication efficiency.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly reduces the physical dimensions of the system, enhances recognition efficiency, and enables the recognition of a wide range of continuous images without the limitations of traditional machine learning methods, achieving high accuracy and energy efficiency.

Implementation Method 1

An optical system is used to perform a Fourier transform on the input image

Methodology Applied
Scientific EffectFourier transform:

Implementation Method 2

The Fourier transform of the input image is stored in a holographic memory as part of a set of images in a database

Methodology Applied
Scientific EffectHolography: Interference

Data Source

PatentUS12222680B1Device for image recognition based on full-analog photonic neural network and method thereof
Publication Date: 2025.02.11 JINAN INSTITUTE OF SUPERCOMPUTING TECHNOLOGY
  • US12222680B1 patent drawing
  • US12222680B1 patent drawing
  • US12222680B1 patent drawing

AI summary

The provided is a device for image based on FAPNN and a recognition method, comprising creating training transparent matrices corresponding to various discrete image categories in the training analog image dataset, recording each image for each image category by a Fourier convolution in one cell of the training transparent holographic matrix; generating different separate holographic cells on the 3D holographic memory matrix by simultaneously Fourier convolution of all images recorded on the training transparent holographic matrix; recording, with mechanical or optical change of the training transparent matrices, various image categories in different holographic cells of the 3D holographic memory matrix at different angles of reference beam and object beam; and receiving the analog image to be recognized, recognizing the image to be recognized and obtaining an image recognition result through values recorded in the holographic cells in the 3D holographic memory matrix.