Minimal Area Image Sensor for Endoscope Fluorescence Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are fragile, prone to misalignment, and limited to capturing only color images, making them unsuitable for fluorescence imaging and requiring multiple specialized systems for different fluorescent reagents, which is costly and inefficient.

Innovation Solution

A minimal area image sensor system is integrated into the distal end of the endoscope, enabling fluorescence and color imaging with a single sensor, using a pixel array that reduces size by removing optical black rows and incorporating optical black columns for calibration, allowing for real-time fluorescence imaging and overlay on RGB images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a traditional image sensor with color filter array is used, then color imaging capability is achieved, but the sensor size becomes too large to fit in the distal end of an endoscope

Engineering Contradiction:
Improvesensor sizeVSAvoidimaging capability
Core Design Contradiction:
Area of stationary objectVSAdaptability or versatility

Solution Approach 1:

The patent removes the color filter array from the image sensor, extracting only the necessary functional elements. This allows the sensor to fit in the distal end of the endoscope while maintaining imaging capability through sequential color capture using a single wavelength light source

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent makes the image sensor universal by enabling it to perform both color imaging and fluorescence imaging functions. This is achieved through sequential illumination with different wavelengths and capturing the reflected and emitted light with the same sensor, eliminating the need for separate specialized sensors

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If the image sensor is placed in the handpiece unit, then the sensor is protected from damage, but the endoscope becomes delicate and prone to misalignment

Engineering Contradiction:
Improvemechanical robustnessVSAvoidalignment precision
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent inverts the traditional endoscope architecture by placing the image sensor in the distal end (inside the body cavity) rather than in the handpiece unit. This reversal makes the optical path shorter and more robust, eliminating the need for long light transmission paths through the endoscope body and reducing susceptibility to misalignment from bumps or impacts

Inventive Principle:
Principle #13The other way round (Inversion)

3Adaptability or versatility

If multiple specialized imaging systems are used for different fluorescent reagents, then comprehensive fluorescence imaging is achieved, but the cost increases significantly

Engineering Contradiction:
Improvefluorescence imaging capabilityVSAvoidsystem cost
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent creates a universal imaging system that can image multiple different fluorescent reagents with a single sensor. By sequentially illuminating with different excitation wavelengths and capturing the emitted fluorescence, the same sensor can detect various reagents, eliminating the need for multiple specialized sensors and reducing overall system cost

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Area of stationary object

If a minimal area image sensor is used, then the sensor fits in the distal end of the endoscope, but the pixel array size is reduced

Engineering Contradiction:
Improvesensor areaVSAvoidimage resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent uses periodic action by sequentially illuminating the scene with different wavelengths of light and capturing multiple images over time. This allows a smaller sensor to achieve effective high-resolution imaging through temporal multiplexing, where the same physical pixels capture different spectral information at different time points, synthesizing a complete high-resolution image

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration enhances mechanical robustness, enables simultaneous fluorescence and color imaging, and reduces costs by allowing multiple fluorescent reagents to be imaged in a single session, providing precise tissue identification and improved image quality.

Implementation Method 1

a pixel array that reduces size by removing optical black rows and incorporating optical black columns for calibration

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

Certain fluorescent materials 'glow' or emit a distinct color that is visible to the human eye when the fluorescent material is subjected to ultraviolet light or other wavelengths of electromagnetic radiation

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Data Source

PatentUS11503220B2Fluorescence imaging with minimal area monolithic image sensor
Publication Date: 2022.11.15 CILAG GMBH INTERNATIONAL
  • US11503220B2 patent drawing
  • US11503220B2 patent drawing
  • US11503220B2 patent drawing

AI summary

Systems, methods, and devices for fluorescence imaging with a minimal area image sensor are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises active pixels and optical black pixels. The system includes a black clamp circuit providing offset control for data generated by the pixel array and a controller comprising a processor in electrical communication with the image sensor and the emitter. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises electromagnetic radiation having a wavelength from about 795 nm to about 815 nm.