Hyperspectral Imaging With Interspersed White Light Frames for Live Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing endoscopic imaging systems lack the capability to integrate multispectral or hyperspectral imaging with simultaneous white light imaging, requiring large and expensive imaging spectrometers, which are not suitable for medical scopes.
Innovation Solution
A system that provides white light illumination at a first frame rate, interspersed with narrowband illumination for individual frames, allowing the assembly of a multispectral or hyperspectral data cube at a second frame rate, using a processor to generate live video and spectral data cubes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a large and expensive imaging spectrometer is used to integrate multispectral or hyperspectral imaging capability, then measurement precision and spectral information quality are improved, but device size and cost increase significantly making it unsuitable for medical scopes
Solution Approach 1:
The illumination function is segmented into multiple independent narrowband light sources (e.g., LEDS at different wavelengths) rather than using a single broadband source. This allows the system to acquire spectral information through temporal multiplexing of discrete wavelength illuminations, eliminating the need for a complex imaging spectrometer while maintaining spectral measurement capability
Solution Approach 2:
The system uses periodic illumination sequences where narrowband light sources are activated in alternating frames or time intervals. By illuminating the scene with different narrowband wavelengths sequentially and capturing images at different time points, the system reconstructs spectral information without requiring a large spectrometer device
2Measurement precision
If narrowband illumination is provided for all frames, then multispectral or hyperspectral data quality is improved, but the live video feed is disrupted and frame rate decreases
Solution Approach 1:
The illumination sequence alternates between narrowband illumination frames and white light illumination frames in a periodic pattern. This allows the system to maintain a high overall frame rate for live video while periodically inserting spectral measurement frames, ensuring both video continuity and spectral data acquisition
Solution Approach 2:
Instead of applying narrowband illumination to all frames, the system applies it to only a subset of frames (e.g., every other frame or specific intervals). This partial application is sufficient to reconstruct spectral information while maintaining high frame rates for the majority of frames displayed in the live video feed
3Measurement precision
If narrowband illumination is used for spectral imaging, then spectral information is improved, but light intensity and signal quality may deteriorate due to reduced total light output
Solution Approach 1:
The system compensates for reduced light intensity in narrowband frames by adjusting illumination duration, intensity, or sensor integration time specifically for those frames. By modifying illumination and detection parameters dynamically based on the illumination type, the system maintains signal quality across both narrowband and white light frames
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time multispectral or hyperspectral imaging with minimal disruption to the live video feed, providing additional diagnostic information like tissue oxygenation, water index, and perfusion without altering sensor exposure settings.
Implementation Method 1
a light source adapted to provide white light illumination at a first frame rate suitable for live video, and to interrupt the white light illumination and provide narrowband illumination for individual frames
Implementation Method 2
a focal plane array sensor to receive reflected light from the tissue and generate image signals
Data Source
AI summary
A hyperspectral imaging method and system including cameras with simultaneous white light imaging capability are presented. A video system includes a camera and a light source adapted to provide white light illumination at a first frame rate suitable for live video, and to provide intermittent narrowband illumination for individual frames interspersed among the white light illuminated frames, where the spectrum of the narrowband illumination varies amongst the interspersed frames permitting a series of at least two differently illuminated narrowband interspersed frames to be assembled into a multispectral or hyperspectral data cube at a second frame rate. The system also includes a processor adapted to receive an image signal and create a live video feed based on the white light illuminated frames by replacing the narrowband illuminated frames with generated or previously collected frames.