Monochromatic Image Sensor with Bidirectional Pads for Endoscopic Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are fragile, prone to misalignment, and limited to capturing only color images, making them unsuitable for applications requiring fluorescence, hyperspectral, and laser mapping imaging in light deficient environments.

Innovation Solution

An endoscopic imaging system with a monochromatic pixel array and bidirectional pads that can fit within the distal end of the endoscope, capable of generating hyperspectral, fluorescence, and laser mapping data by pulsing different wavelengths of electromagnetic radiation, allowing for multiple imaging techniques in a single session.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a traditional image sensor with color filter array is used, then color imaging capability is achieved, but the sensor size becomes too large to fit in the distal end of the endoscope

Engineering Contradiction:
Improvecolor imaging capabilityVSAvoidsensor size
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent segments the imaging function by using a monochromatic pixel array that captures multiple wavelength bands separately through temporal multiplexing rather than spatial segmentation with color filter arrays. Each pixel detects intensity at different time points corresponding to different wavelength excitations, eliminating the need for large color filter arrays while maintaining spectral imaging capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from spatial dimension (color filter arrays occupying physical space at each pixel) to temporal dimension (sequential wavelength excitation over time). The monochromatic sensor captures spectral information by multiplexing wavelength excitation in time, converting a spatial problem into a temporal solution that reduces sensor area requirements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Volume of moving object

If the image sensor is placed in the handpiece unit, then the sensor has sufficient space and power, but the endoscope becomes delicate and prone to misalignment or damage

Engineering Contradiction:
Improvesensor spaceVSAvoidendoscope stability
Core Design Contradiction:
Volume of moving objectVSReliability

Solution Approach 1:

The patent extracts the image sensor from the handpiece unit and relocates it to the distal end of the endoscope. By using a monochromatic pixel array with reduced area requirements, the sensor can be placed directly at the imaging location, eliminating the need for long optical transmission paths through the endoscope shaft and improving mechanical reliability.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If multiple separate image sensors are used for fluorescence, hyperspectral, and laser mapping imaging, then comprehensive imaging capability is achieved, but the device complexity and space requirements increase significantly

Engineering Contradiction:
Improveimaging modalitiesVSAvoidnumber of sensors
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal monochromatic image sensor that can perform multiple imaging functions (color, fluorescence, hyperspectral, laser mapping) by sequentially exciting different wavelength bands. A single sensor with temporal multiplexing capability replaces multiple specialized sensors, reducing device complexity while maintaining comprehensive imaging versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the functions of multiple separate image sensors into a single monochromatic pixel array that captures all wavelength bands through temporal multiplexing. By combining color, fluorescence, hyperspectral, and laser mapping capabilities into one sensor system, the patent reduces the number of components and simplifies the overall device architecture.

Inventive Principle:
Principle #5Merging (Combining)

4Volume of moving object

If a monochromatic pixel array without color filter array is used, then the sensor area is reduced and can fit in the distal end, but color information must be captured through sequential wavelength excitation

Engineering Contradiction:
Improvesensor areaVSAvoidsequential excitation time
Core Design Contradiction:
Volume of moving objectVSLoss of time

Solution Approach 1:

The patent employs periodic sequential excitation of different wavelength bands in a repeating cycle. The monochromatic pixel array captures intensity data at different time points corresponding to periodic wavelength excitations, enabling color and spectral information reconstruction from temporal sequences of monochromatic images.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise imaging of critical structures and three-dimensional topologies in light deficient environments, reducing the need for multiple sensors and improving image quality by integrating multiple imaging techniques into a single system.

Implementation Method 1

sense reflected electromagnetic radiation

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

transmitting electromagnetic radiation through the endoscope to a scene at a distal end

Methodology Applied
Scientific EffectElectromagnetic radiation transmission: Electromagnetic Induction

Implementation Method 3

fluorescence imaging captures the emission of light by a substance that has absorbed electromagnetic radiation

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 4

Hyperspectral imaging can be used to identify different materials, biological processes, and chemical processes by emitting different partitions of electromagnetic radiation

Methodology Applied
Scientific EffectElectromagnetic radiation absorption and emission: Absorption (EM radiation)

Data Source

PatentUS12181412B2Minimizing image sensor input/output in a pulsed hyperspectral, fluorescence, and laser mapping imaging system
Publication Date: 2024.12.31 CILAG GMBH INTERNATIONAL
  • US12181412B2 patent drawing
  • US12181412B2 patent drawing
  • US12181412B2 patent drawing

AI summary

Minimizing image sensor input/output pads in a pulsed laser mapping imaging system is disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation. The system includes a plurality of bidirectional pads comprising an output state for issuing data and an input state for receiving data. The system includes a controller configured to synchronize timing of the emitter and the image sensor. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises one or more of a hyperspectral emission, a fluorescence emission, or a laser mapping pattern.