Monochrome Sensor Checkerboard Pixels for Fluorescence Dynamic Range

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are fragile, prone to misalignment, and limited to capturing color images, while fluorescence imaging requires specialized systems that are costly and incapable of capturing multiple fluorescent reagents in a single session, especially in light deficient environments.

Innovation Solution

A monochrome image sensor with minimal peripheral circuitry is placed at the distal end of the endoscope, using a checkerboard pattern of long and short exposure pixels to enhance dynamic range and spatial resolution, enabling fluorescence imaging and color imaging in a single session by pulsing electromagnetic radiation across various wavelengths.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a traditional color image sensor with color filter array is used, then color image capture is enabled, but the device size increases and mechanical robustness decreases

Engineering Contradiction:
Improvecolor image capture capabilityVSAvoidmechanical robustness
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The pixel array is segmented into two distinct groups: first pixels with first color filters and second pixels with second color filters. This segmentation allows each pixel type to be optimized for specific wavelength ranges, enabling color imaging while maintaining a compact form factor that can be placed at the distal end of the endoscope, thereby improving mechanical robustness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the pixel array are assigned different filter characteristics - first pixels with first color filters for capturing specific color information and second pixels with second color filters for complementary color information. This local differentiation enables effective color imaging while keeping the overall sensor size small enough for distal placement, resolving the contradiction between color capture capability and mechanical robustness.

Inventive Principle:
Principle #3Local quality

2Adaptability or versatility

If the image sensor is placed in the handpiece unit, then color imaging is possible, but the endoscope becomes fragile and prone to misalignment

Engineering Contradiction:
Improveimaging capabilityVSAvoidalignment stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The invention transitions the image sensor placement from the proximal handpiece unit to the distal end of the endoscope - a spatial dimension change. By placing the compact pixel array at the distal end, the system eliminates the need for long light transmission paths through the endoscope body, thereby preventing misalignment and damage while maintaining full imaging capability including color and fluorescence imaging.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If a monochrome image sensor is used at the distal end, then mechanical robustness improves, but dynamic range and spatial resolution are limited

Engineering Contradiction:
Improvemechanical robustnessVSAvoidspatial resolution
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The pixel array is divided into first pixels and second pixels with different color filter characteristics. This segmentation enables the compact distal-mounted sensor to capture multiple spectral bands simultaneously, effectively increasing the information content per pixel and compensating for the reduced physical pixel count, thereby maintaining spatial resolution while improving mechanical robustness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The pixel array with dual-color-filter pixels is designed to perform multiple functions: color imaging, fluorescence imaging, and high dynamic range imaging. Each pixel type contributes to different imaging modes, allowing the compact sensor to achieve multi-functional capability that compensates for its smaller size, thus maintaining measurement precision while improving mechanical robustness.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If separate imaging systems are used for color and fluorescence imaging, then imaging quality is maintained, but system complexity and cost increase

Engineering Contradiction:
Improveimaging qualityVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The invention merges color imaging and fluorescence imaging capabilities into a single pixel array at the distal end. The first pixels with first color filters and second pixels with second color filters work together to capture both reflected light for color imaging and emitted light for fluorescence imaging, eliminating the need for separate imaging systems while maintaining imaging quality and reducing system complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The pixel array is designed with universal capability to perform both color imaging and fluorescence imaging functions. By equipping each pixel type with specific color filters that respond to both reflected and emitted light wavelengths, the system achieves multi-functionality in a single device, thereby reducing complexity while preserving the measurement precision needed for both imaging modes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration improves image quality, mechanical robustness, and allows for simultaneous fluorescence and color imaging, overcoming the limitations of traditional endoscopes by fitting a more advanced image sensor within the endoscope, enabling precise identification of structures and tissues in light deficient environments.

Implementation Method 1

A monochrome image sensor with minimal peripheral circuitry is placed at the distal end of the endoscope, using a checkerboard pattern of long and short exposure pixels to enhance dynamic range and spatial resolution

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

Fluorescence is the emission of light by a substance that has absorbed light or other electromagnetic radiation. Certain fluorescent materials 'glow' or emit a distinct color that is visible to the human eye when the fluorescent material is subjected to ultraviolet light or other wavelengths of electromagnetic radiation.

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Data Source

PatentUS11218645B2Wide dynamic range using a monochrome image sensor for fluorescence imaging
Publication Date: 2022.01.04 CILAG GMBH INTERNATIONAL
  • US11218645B2 patent drawing
  • US11218645B2 patent drawing
  • US11218645B2 patent drawing

AI summary

Systems, methods, and devices for fluorescence imaging with increased dynamic range are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises a plurality of pixels each configurable as a short exposure pixel or a long exposure pixel. The system includes a controller comprising a processor in electrical communication with the image sensor and the emitter. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises electromagnetic radiation having a wavelength from about 795 nm to about 815 nm.