Super Resolution and Color Motion Artifact Correction in Pulsed Fluorescence Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional endoscopes with image sensors placed in handpieces face challenges such as misalignment, damage, and limited capability to capture high-quality images in light deficient environments, especially when trying to combine color and fluorescence imaging data, due to the size constraints of the image sensor and the need for multiple pixel sensors.
Innovation Solution
The system incorporates a monochrome image sensor with minimal peripheral circuitry and logic, using super resolution and color motion artifact correction algorithms to enhance image quality, and allows for the placement of the image sensor at the distal end of the endoscope, enabling pulsing of electromagnetic radiation to capture RGB and fluorescence data simultaneously, which is then overlaid on the image frame.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple pixel sensors are used to capture color and fluorescence data, then imaging capability is improved, but device size and complexity increase
Solution Approach 1:
A single monochrome image sensor is used to perform multiple imaging functions by capturing data across different spectral bands. The sensor captures visible light for color imaging and near-infrared light for fluorescence imaging, eliminating the need for separate color and fluorescence sensors. This multi-functional approach reduces device complexity while maintaining versatile imaging capability.
Solution Approach 2:
The system extends imaging into the near-infrared spectral dimension beyond traditional visible light imaging. By detecting near-infrared wavelengths for fluorescence and combining them with visible light data, the system achieves multi-spectral imaging capabilities without requiring additional physical sensor arrays, thus reducing device size.
2Ease of manufacture
If image sensor is placed in handpiece unit, then color imaging is achieved, but mechanical robustness and optical alignment deteriorate
Solution Approach 1:
The image sensor is extracted from the handpiece unit and relocated to the distal end of the endoscope. This extraction eliminates the mechanical robustness and optical alignment problems associated with handpiece-mounted sensors, as the sensor is now protected within the distal end housing and directly positioned at the imaging location.
Solution Approach 2:
The system uses a monochrome sensor that captures intensity information, which is then processed to generate color images through computational methods. This copying approach allows color imaging capability to be achieved without requiring a complex color sensor array in the handpiece, thereby improving mechanical robustness.
3Device complexity
If monochrome image sensor is used, then device size is reduced, but image quality and dynamic range may deteriorate
Solution Approach 1:
The system uses periodic pulsing of electromagnetic radiation at different wavelengths (visible and near-infrared) to capture sequential images. By alternating between different spectral bands and combining the data, the monochrome sensor achieves the dynamic range and image quality of multi-spectral imaging while maintaining a compact sensor size.
Solution Approach 2:
The imaging system combines data from multiple spectral bands (visible and near-infrared) into a composite image. This composite approach allows the monochrome sensor to leverage information from different wavelength ranges, effectively increasing the dynamic range and image quality without requiring a larger or more complex sensor.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach improves optical simplicity, mechanical robustness, and image quality by increasing dynamic range and spatial resolution while reducing the size of the image sensor, allowing for precise identification of critical structures in a light deficient environment.
Implementation Method 1
an image sensor that is sensitive to the relaxation wavelength of the one or more reagents
Implementation Method 2
Fluorescence is the emission of light by a substance that has absorbed light or other electromagnetic radiation
Implementation Method 3
Certain fluorescent materials will cease to glow nearly immediately when the radiation source stops
Data Source
AI summary
Systems, methods, and devices for super resolution and color motion artifact correction in a pulsed fluorescence imaging system are disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor to generate a plurality of exposure frames. The method includes detecting motion across two or more sequential exposure frames of the plurality of exposure frames, compensating for the detected motion, and combining the two or more sequential exposure frames to generate an image frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 770 nm to about 790 nm.