Neural Network Hyperspectral Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional hyperspectral imaging methods face limitations in achieving single-shot capture without sacrificing spatial resolution, and existing algorithms struggle with correcting view differences between spectrally sheared and unsheared images, leading to artifacts and lengthy reconstruction times.

Innovation Solution

A computer-implemented method using a machine learning approach, specifically a neural network with an encoder-decoder structure, to correct for view differences by determining a transform that maps spectrally sheared and unsheared images to a common basis, enabling accurate hyperspectral datacube reconstruction without the need for expensive alignment processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional scanning methods are used for hyperspectral imaging, then spectral information can be captured, but the process takes considerable time and introduces motion artefacts

Engineering Contradiction:
Improvespectral information accuracyVSAvoidimaging time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by performing view difference correction on the captured images before the hyperspectral reconstruction process. The machine learning model pre-processes the spectrally sheared and unsheared images to correct misalignments and view differences, ensuring that the subsequent reconstruction algorithm receives pre-aligned input data. This preliminary correction step eliminates motion artifacts and alignment issues before reconstruction begins, resolving the contradiction between capturing accurate spectral information and minimizing imaging time.

Inventive Principle:
Principle #10Preliminary action

2Loss of time

If multiplexing spectrometers are used to achieve single-shot hyperspectral capture, then imaging time is reduced, but spatial resolution is significantly sacrificed

Engineering Contradiction:
Improveimaging timeVSAvoidspatial resolution
Core Design Contradiction:
Loss of timeVSManufacturing precision

Solution Approach 1:

The patent introduces an intermediary machine learning-based view difference correction step that acts as a mediator between the captured spectrally sheared images and the final hyperspectral reconstruction. This intermediary process corrects view differences and aligns images without requiring complex multiplexing hardware, thereby maintaining spatial resolution while achieving single-shot capture. The correction algorithm serves as a computational intermediary that preserves spatial information while enabling time-efficient imaging.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If traditional alignment processes are used to correct view differences between sheared and unsheared images, then alignment accuracy can be improved, but the process becomes expensive and time-consuming

Engineering Contradiction:
Improvealignment accuracyVSAvoidreconstruction speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces traditional mechanical alignment processes with a machine learning-based computational approach. Instead of using physical alignment mechanisms or complex optical adjustment systems, the invention employs a neural network model that automatically learns and corrects view differences between spectrally sheared and unsheared images. This substitution of mechanical alignment with intelligent algorithms maintains high alignment accuracy while dramatically reducing processing time and cost, directly resolving the contradiction between alignment precision and reconstruction speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20240037709A1Optical Method
Publication Date: 2024.02.01 LIVING OPTICS LTD
  • US20240037709A1 patent drawing
  • US20240037709A1 patent drawing
  • US20240037709A1 patent drawing

AI summary

Computer implemented methods (600) based on artificial neural networks for determining the datacube are also disclosed.