Topological Phase Transform Lenslet Array for Low Light Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging technologies face challenges in efficiently reconstructing object features from incomplete or mixed-image signal components, particularly due to the Phase Problem where phase information is lost, leading to time-consuming iterative approaches and vulnerability to adversarial attacks.

Innovation Solution

The implementation of a hybrid optical-digital approach using a topological phase transform with a lenslet-array for high-speed and low-light imaging, which exploits the compactness of Fourier representations and edge detection from spiral-phase gradients, allowing for non-iterative, single-shot object reconstruction with dense neural networks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If iterative approaches are used to reconstruct objects from sensor data, then the Phase Problem can be addressed, but the process becomes time-consuming and requires multiple restarts

Engineering Contradiction:
Improveimage reconstruction accuracyVSAvoidreconstruction time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-training a neural network model on synthetic training data that simulates the imaging process. This pre-training enables the model to learn the mapping from intensity measurements to object features in advance, so that during actual operation, reconstruction can be performed rapidly without iterative computations. The neural network is trained offline with various initial guesses and imaging conditions, storing the learned transformations for fast online application.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If deep-learning convolutional neural networks are used for image reconstruction, then computational imaging capabilities are improved, but the systems become vulnerable to adversarial attacks and have higher computational complexity

Engineering Contradiction:
Improvecomputational imaging capabilityVSAvoidvulnerability to adversarial attacks
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent substitutes traditional deep-learning convolutional neural networks with a different computational approach that uses pre-computed transformation matrices and linear algebra operations. Instead of relying on complex non-linear neural network layers that are vulnerable to adversarial attacks, the system uses a streamlined mathematical model that maintains reconstruction capability while reducing computational complexity and improving robustness against adversarial inputs.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If iterative solutions of the Phase Problem are developed, then optimization techniques can be applied, but the process requires multiple restarts with several initial guesses until convergence

Engineering Contradiction:
Improveoptimization capabilityVSAvoidalgorithmic complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent uses copying by generating synthetic training data that replicates various imaging scenarios and object types. This synthetic data serves as a comprehensive training set that covers diverse conditions without requiring actual physical experiments. The neural network learns from these copied representations of reality, enabling it to handle real imaging tasks efficiently. This approach avoids the complexity of iterative optimization while maintaining high reconstruction accuracy across different scenarios.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances image reconstruction speed and resolution, reduces computational complexity and noise robustness, and achieves real-time processing capabilities, making it suitable for low-signal environments and potential applications in computer vision systems.

Implementation Method 1

phase modulated with the multi-vortex lens array

Methodology Applied
Scientific EffectPhase modulation: Phase Modulation

Implementation Method 2

edge detection from spiral-phase gradients

Methodology Applied
Scientific EffectSpiral-phase gradient:

Implementation Method 3

exploits the compactness of Fourier representations

Methodology Applied
Scientific EffectFourier transformation:

Implementation Method 4

edge detection from spiral-phase gradients

Methodology Applied
Scientific EffectEdge detection:

Data Source

PatentUS12298524B2Multi-lens system for imaging in low light conditions and method
Publication Date: 2025.05.13 RGT UNIV OF CALIFORNIA
  • US12298524B2 patent drawing
  • US12298524B2 patent drawing
  • US12298524B2 patent drawing

AI summary

Described herein are imaging devices and associated methods. Devices and methods are described that include a plurality of topological phase modulators. In one example, the plurality of topological phase modulators includes an array of spiral vortices. Devices and methods are described that include a neural network to reconstruct images using data from the plurality of topological phase modulators.