Minimal Area Image Sensor for Endoscope Fluorescence Imaging

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are fragile, prone to misalignment, and limited to capturing only color images, making them unsuitable for fluorescence imaging and requiring multiple specialized systems for different fluorescent reagents, which is costly and inefficient.

Innovation Solution

A minimal area image sensor system is integrated into the distal end of the endoscope, enabling fluorescence and color imaging with a single sensor, using a pixel array that includes optical black columns for calibration, allowing for the generation of RGB images with overlaid fluorescence data, and pulsing electromagnetic radiation to excite fluorescent reagents for real-time imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a traditional image sensor with color filter array is placed in the handpiece unit, then color imaging is achieved, but the device becomes fragile, prone to misalignment, and cannot perform fluorescence imaging

Engineering Contradiction:

Improveimaging capabilityVSAvoidmechanical robustness

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent combines color imaging and fluorescence imaging capabilities into a single integrated sensor system located at the distal end of the endoscope. The sensor uses a single pixel array without color filters that can detect both visible light for color imaging and ultraviolet/fluorescence wavelengths, eliminating the need for separate imaging systems and improving mechanical reliability.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The image sensor is designed with universal functionality to perform multiple imaging modes including color imaging, fluorescence imaging, and hyperspectral imaging using the same sensor array. This multi-functional sensor replaces the need for specialized sensors for different imaging types, reducing system complexity and improving robustness.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple specialized imaging systems are used for different fluorescent reagents, then comprehensive fluorescence imaging is achieved, but the system becomes complex and costly

Engineering Contradiction:

Improvefluorescence imaging capabilityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs a universal image sensor that can detect multiple wavelengths including ultraviolet and visible light, enabling the imaging of various fluorescent reagents with different excitation wavelengths using a single sensor. This eliminates the need for multiple specialized imaging systems and reduces overall system complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses temporal multiplexing where the sensor alternates between different imaging modes (color imaging, fluorescence imaging with different excitation wavelengths) in periodic cycles. This allows a single sensor to capture data for multiple imaging functions by switching between modes, reducing the need for parallel specialized systems.

Inventive Principle:

Principle #19Periodic action

3Measurement precision

If optical black rows and columns are included in the pixel array, then sensor calibration is improved, but the sensor area increases

Engineering Contradiction:

Improvecalibration accuracyVSAvoidsensor area

Core Design Contradiction:

Measurement precisionVSArea of moving object

Solution Approach 1:

The patent removes the traditional optical black rows from the pixel array while retaining only the necessary optical black columns for calibration. This extraction of unnecessary elements reduces the overall sensor area while maintaining sufficient calibration capability through the remaining optical black columns, which provide reference signals for dark current compensation.

Inventive Principle:

Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration enhances mechanical robustness, allows for simultaneous fluorescence and color imaging, reduces the need for multiple imaging systems, and provides precise identification of tissues and structures within the body cavity, improving diagnostic capabilities.

Implementation Method 1

an image sensor comprising a pixel array... sensing reflected electromagnetic radiation

Methodology Applied

Scientific EffectElectromagnetic radiation detection: Photoelectric Effect

Implementation Method 2

pulsing electromagnetic radiation to excite fluorescent reagents for real-time imaging

Methodology Applied

Scientific EffectFluorescence: Fluorescence

Data Source

PatentUS11633089B2Fluorescence imaging with minimal area monolithic image sensor

Publication Date: 2023.04.25 CILAG GMBH INTERNATIONAL

AI summary

Systems, methods, and devices for fluorescence imaging with a minimal area image sensor are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises active pixels and optical black pixels. The system includes a black clamp providing offset control for data generated by the pixel array and a controller comprising a processor in electrical communication with the image sensor and the emitter. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises electromagnetic radiation having a wavelength from about 770 nm to about 790 nm.