Minimal Area Monolithic Image Sensor for Endoscope Fluorescence Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are fragile, prone to misalignment, and limited to capturing only color images, failing to effectively utilize fluorescence imaging in light-deficient environments for medical applications.

Innovation Solution

Development of a minimal area image sensor system that integrates fluorescence and color imaging capabilities within the distal end of an endoscope, utilizing a pixel array with reduced optical black pixels to fit within the constrained space, allowing for real-time fluorescence imaging and improved mechanical robustness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a conventional digital color image sensor with color filter array is used, then color image quality is improved, but the sensor area becomes too large to fit in the distal end of an endoscope

Engineering Contradiction:
Improvecolor image qualityVSAvoidsensor area
Core Design Contradiction:
Manufacturing precisionVSArea of moving object

Solution Approach 1:

The sensor is divided into two distinct types of pixels: color pixels with color filter arrays for capturing color images, and monochrome pixels without color filters for capturing fluorescence images. This segmentation allows each pixel type to be optimized for its specific function while sharing the same sensor substrate, thereby reducing the overall sensor area required compared to using separate sensors for each function.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines color imaging and fluorescence imaging capabilities into a single integrated sensor array. By merging the color pixel array and monochrome pixel array on the same sensor substrate with shared readout circuitry, the system achieves multi-functional imaging capability while minimizing the total sensor area, allowing it to fit within the constrained distal end of an endoscope.

Inventive Principle:
Principle #5Merging (Combining)

2Manufacturing precision

If the image sensor is placed in the handpiece unit, then the sensor can accommodate sufficient pixel elements for color imaging, but the endoscope becomes fragile and prone to misalignment

Engineering Contradiction:
Improveimage qualityVSAvoidmechanical robustness
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

Instead of placing the image sensor in the handpiece unit at the proximal end of the endoscope, the patent inverts the conventional configuration by placing the sensor directly in the distal end of the endoscope insert. This inversion eliminates the need for long light transmission paths through optical fibers and removes the sensor from vulnerable positions, thereby significantly improving mechanical robustness while maintaining adequate image quality through the miniaturized sensor design.

Inventive Principle:
Principle #13The other way round (Inversion)

3Manufacturing precision

If traditional endoscope configuration is used, then color imaging is achieved, but fluorescence imaging capability is lost

Engineering Contradiction:
Improvecolor image capabilityVSAvoidfluorescence imaging capability
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal sensor array that can perform both color imaging and fluorescence imaging functions. The sensor includes both color pixels with color filter arrays and monochrome pixels without color filters, allowing the same sensor to capture both types of images simultaneously or alternately. This multi-functionality eliminates the need for separate imaging systems and enables the endoscope to adapt to different imaging requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise fluorescence imaging in light-deficient environments, enhancing the identification of critical body structures and tissues, such as cancerous tumors, while improving the mechanical durability and optical simplicity of endoscopes.

Implementation Method 1

Fluorescence is the emission of light by a substance that has absorbed light or other electromagnetic radiation. Certain fluorescent materials 'glow' or emit a distinct color that is visible to the human eye when the fluorescent material is subjected to ultraviolet light or other wavelengths of electromagnetic radiation.

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 2

A digital color image includes at least three layers, or 'color channels,' that cumulatively form an image with a range of hues. Each of the color channels measures the intensity and chrominance of light for a spectral band.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11477390B2Fluorescence imaging with minimal area monolithic image sensor
Publication Date: 2022.10.18 CILAG GMBH INTERNATIONAL
  • US11477390B2 patent drawing
  • US11477390B2 patent drawing
  • US11477390B2 patent drawing

AI summary

Systems, methods, and devices for fluorescence imaging with a minimal area image sensor are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises active pixels and optical black pixels. The system includes a black clamp providing offset control for data generated by the pixel array and a controller comprising a processor in electrical communication with the image sensor and the emitter. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 770 nm to about 790 nm; or electromagnetic radiation having a wavelength from about 795 nm to about 815 nm.