Optical Associative Learning Element for Neural Network Scaling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current artificial neural networks using Hebbian learning-based methods face inefficiencies in training time and energy usage due to non-linear scaling with the number of connections, making them less effective for large datasets.

Innovation Solution

An optical associative learning element is developed, comprising a first and second waveguide with directional couplers and a modulating element that adjusts its state based on optical fields, allowing for efficient data association and scalable neural network implementation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional Hebbian learning-based neural networks are used, then associative learning capability is achieved, but training time and energy usage scale non-linearly with the number of connections

Engineering Contradiction:
Improvetraining speedVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent replaces conventional electronic neural network computations with an optical system that uses light propagation through waveguides and optical components to perform associative learning operations. This substitution of electronic mechanisms with optical mechanisms enables linear scaling of computational effort with the number of connections, significantly reducing training time and energy consumption compared to conventional electronic Hebbian learning networks.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the fundamental operating parameters from electronic signals to optical signals, utilizing properties such as light intensity, phase, and wavelength to encode and process information. This parameter change enables parallel processing of multiple operations simultaneously through optical interference and resonance effects, achieving linear scaling behavior in training time and energy usage.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the number of connections in the neural network is increased to handle larger datasets, then machine learning capability improves, but computational effort scales non-linearly

Engineering Contradiction:
Improvedata handling capabilityVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from sequential electronic computation to parallel optical computation by utilizing spatial dimensions for data representation. Multiple data streams can be processed simultaneously through different waveguides and optical paths, with computations performed in parallel through optical interference and resonance. This dimensional transition enables linear scaling of computational effort with the number of connections, allowing the system to handle larger datasets without proportionally increasing computational complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If optical fields are used to modulate the modulating element, then state adjustment between crystalline and amorphous phases is achieved, but control precision must be maintained

Engineering Contradiction:
Improvestate switching capabilityVSAvoidphase transition control precision
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent utilizes phase transitions in chalcogenide materials between crystalline and amorphous states to represent different operational states of the modulating element. Optical fields are used to induce these phase transitions through heating effects, enabling reversible switching between states. The phase transition characteristics of chalcogenide materials provide sharp, well-defined transitions that can be precisely controlled through optical intensity and duration parameters, maintaining control precision while achieving versatile state switching capability.

Inventive Principle:
Principle #36Phase transitions

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The optical associative learning element reduces training time and energy consumption by linearly scaling computational effort with the number of connections, enabling efficient pattern recognition and classification in machine learning applications.

Implementation Method 1

a cascaded first and second directional coupler are formed from a portion of the first and second waveguides in which the first and second waveguides are substantially parallel, evanescently coupled and separated by a gap

Methodology Applied
Scientific EffectEvanescent coupling: Waveguide (optics)

Implementation Method 2

the modulating element is evanescently coupled to the second waveguide in the second directional coupler and is arranged to modify a transmission or absorption characteristic of the second waveguide dependent on the state of the modulating element

Methodology Applied
Scientific EffectOptical absorption: Absorption (EM radiation)

Implementation Method 3

The first state may comprise a crystalline state of the modulating element. The second state may comprise a less crystalline state, e.g. an amorphous state, of the modulating element

Methodology Applied
Scientific EffectPhase change: Phase Change

Data Source

PatentUS20220300798A1Optical devices and methods
Publication Date: 2022.09.22 OXFORD UNIVERSITY INNOVATION LTD
  • US20220300798A1 patent drawing
  • US20220300798A1 patent drawing
  • US20220300798A1 patent drawing

AI summary

An optical associative learning element (200) comprising a first waveguide (202), a second waveguide (204) and a modulating element (206), wherein: a cascaded first (208) and second (210) directional coupler are formed from a portion (212) of the first (202) and second (204) waveguides in which the first (202) and second (204) waveguides are substantially parallel, evanescently coupled and separated by a gap; the modulating element (206) is evanescently coupled to the second waveguide (204) in the second directional coupler (210) and is arranged to modify a transmission or absorption characteristic of the second waveguide (204) dependent on the state of the modulating element (206); and the state of the modulating element (206) is adjustable between a first and second state by an optical field carried by the first (202) and/or second (204) waveguide.