Hyperspectral Motion Imaging via Panchromatic Video Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional hyperspectral imaging systems face challenges in capturing high-speed video data efficiently, as they often require longer frame times and lower light utilization compared to panchromatic imaging systems.
Innovation Solution
The approach combines panchromatic video and hyperspectral snapshot data to generate high-speed hyperspectral video frames using a patch dictionary built from panchromatic information, leveraging compressive sensing techniques for efficient reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional hyperspectral imaging systems use spectrometers to measure spectrum of light for each imaging pixel, then spectral information is captured, but frame rate is reduced and light utilization efficiency is lowered
Solution Approach 1:
The imaging system divides the spectral measurement task into two separate components: a panchromatic imager captures spatial and temporal information at high frame rates, while a hyperspectral imager captures spectral information. This segmentation allows each component to optimize for its specific function, resolving the contradiction between spectral information capture and high frame rate acquisition.
Solution Approach 2:
The patent merges the output of the panchromatic imager and hyperspectral imager through computational processing. The panchromatic video provides temporal information and the hyperspectral snapshot provides spectral information, which are combined to generate high-speed hyperspectral video frames, achieving both high frame rate and spectral information capture.
2Measurement precision
If conventional hyperspectral imaging systems take successive exposures for each passband, then spectral data is collected, but light utilization efficiency decreases
Solution Approach 1:
The panchromatic imager performs preliminary capture of the scene at high frame rates, establishing the temporal structure and motion information before the hyperspectral measurement. This preliminary action allows the subsequent hyperspectral snapshot to focus only on capturing spectral information without the time penalty, improving overall light utilization efficiency.
Solution Approach 2:
The system maintains continuous useful action by processing the panchromatic video and hyperspectral snapshot together to generate high-speed hyperspectral video frames. The computational reconstruction process continuously produces output at high frame rates, ensuring that light captured by the panchromatic imager is fully utilized for generating high-speed spectral video.
3Measurement precision
If a single hyperspectral imager captures all spectral information, then spectral fidelity is maintained, but processing complexity and data volume increase
Solution Approach 1:
The patent extracts the temporal processing function from the hyperspectral imager and assigns it to the panchromatic imager. By taking out the temporal dimension handling, the hyperspectral imager can focus solely on capturing spectral information with high fidelity, while the panchromatic imager handles the computationally intensive temporal processing and motion compensation.
Data Source
AI summary
High-speed hyperspectral (HSHS) video reconstruction is implemented in an imaging system. A hyperspectral snapshot is determined. A panchromatic video is determined corresponding to a frame time of the hyperspectral snapshot, the panchromatic video including a plurality of panchromatic frames. An HSHS video is generated by building a patch dictionary based at least in part on the panchromatic video and generating at least one frame of the HSHS video based at least in part on the patch dictionary, the panchromatic video, and the hyperspectral snapshot. A computing device can include a dictionary component configured to determine the patch dictionary and a reconstruction component configured to generate at least one HSHS frame based at least in part on the patch dictionary, the panchromatic video, and the hyperspectral snapshot.