Monochromatic Pixel Array for Endoscopic Hyperspectral Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional endoscopic imaging systems are limited by the need for a large image sensor, which cannot fit within the distal end of an endoscope, leading to image quality degradation and the requirement for multiple separate image sensors for fluorescence, hyperspectral, and laser mapping imaging.

Innovation Solution

The system employs a monochromatic pixel array without individual pixel filters, using pulsing electromagnetic radiation of different wavelengths to generate color information, and integrates the image sensor within the distal end of the endoscope, eliminating the need for an output clock and reducing the overall size of the image sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a traditional color image sensor with color filter array is used, then color image quality is improved, but the sensor size increases making it impossible to fit in the distal end of an endoscope

Engineering Contradiction:
Improvecolor image qualityVSAvoidsensor size
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The patent segments the imaging function by separating the color filter array from the pixel sensor array. Instead of having each pixel sensor element dedicated to a single color channel with filters, the system uses a single monochromatic pixel array that captures intensity information for all wavelengths, then reconstructs color information through software processing of sequential wavelength images.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a temporal dimension to the imaging process by sequentially capturing images at different wavelengths over time. This time-multiplexed approach allows a single pixel array to gather spectral information that would traditionally require multiple spatially-separated color-filtered sensors, effectively trading spatial complexity for temporal sequencing.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple separate image sensors are used for fluorescence, hyperspectral, and laser mapping imaging, then imaging capability is improved, but device complexity and size increase

Engineering Contradiction:
Improveimaging capabilityVSAvoidnumber of sensors
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal imaging platform where a single monochromatic pixel array can perform multiple imaging modalities including color imaging, fluorescence imaging, hyperspectral imaging, and laser mapping. By sequentially illuminating the scene with different wavelength sources and capturing the temporal sequence of images, one sensor performs the work of what would traditionally require multiple specialized sensors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges multiple imaging functions into a single integrated system. The monochromatic pixel array combines the capabilities of what would otherwise be separate color cameras, fluorescence cameras, hyperspectral cameras, and laser range finders into one unified sensor platform that captures all data types through temporal sequencing and wavelength-multiplexed illumination.

Inventive Principle:
Principle #5Merging (Combining)

3Area of stationary object

If the image sensor is placed in the handpiece unit, then sensor size constraints are relaxed, but image quality degrades due to misalignment and damage risk

Engineering Contradiction:
Improvesensor placement flexibilityVSAvoidimage quality stability
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The patent inverts the traditional endoscope architecture by placing the image sensor in the distal end tip rather than in the proximal handpiece unit. This reversal allows the sensor to be positioned where the optical path terminates, eliminating the need for long light transmission paths through the endoscope shaft and preventing misalignment issues that occur when sensors are remotely located in the handpiece.

Inventive Principle:
Principle #13The other way round (Inversion)

4Area of stationary object

If a monochromatic pixel array without individual pixel filters is used, then sensor size is reduced for distal end placement, but color information capture capability is lost

Engineering Contradiction:
Improvesensor sizeVSAvoidcolor information
Core Design Contradiction:
Area of stationary objectVSLoss of information

Solution Approach 1:

The patent performs preliminary wavelength-selective illumination before the image capture phase. By sequentially illuminating the scene with specific wavelength bands (red, green, blue, and other spectral regions) before capturing images with the monochromatic pixel array, the system pre-sorts the spectral information in time, allowing the single sensor to reconstruct full color and spectral data from the temporal sequence of monochromatic images.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables high-quality digital imaging in a light deficient environment, allowing for the capture of color, fluorescence, hyperspectral, and laser mapping data in a single imaging session, while maintaining the compactness of the endoscope.

Implementation Method 1

an image sensor, where the image sensor is configured to sense reflected electromagnetic radiation

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

an emitter, where the emitter is configured to emit pulses of electromagnetic radiation

Methodology Applied
Scientific EffectElectromagnetic radiation emission: Electromagnetic Induction

Implementation Method 3

The emitter and the pixel array are synchronized such that instances of reflected electromagnetic radiation are combined to generate an RGB image frame with specialty imaging data overlaid on the RGB image frame

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS12228516B2Image synchronization without input clock and data transmission clock in a pulsed hyperspectral, fluorescence, and laser mapping imaging system
Publication Date: 2025.02.18 CILAG GMBH INTERNATIONAL
  • US12228516B2 patent drawing
  • US12228516B2 patent drawing
  • US12228516B2 patent drawing

AI summary

Pulsed hyperspectral, fluorescence, and laser mapping imaging without input clock or data transmission clock is disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a plurality of bidirectional data pads and a controller in communication with the image sensor. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of: electromagnetic radiation having a wavelength from about 513 nm to about 545 nm, from about 565 nm to about 585 nm, from about 900 nm to about 1000 nm, an excitation wavelength of electromagnetic radiation that causes a reagent to fluoresce, or a laser mapping pattern.