Monochrome Image Sensor for Laser Mapping and Color Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are fragile, prone to misalignment, and limited to capturing only color images, making them unsuitable for laser mapping and color imaging in small body cavies, where multiple sensors consume excessive space and degrade image quality.

Innovation Solution

A monochrome image sensor with minimal peripheral circuitry is integrated into the distal end of the endoscope, using a checkerboard pattern of long and short exposure pixels to enhance dynamic range and spatial resolution, enabling laser mapping and color imaging in a single session.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple separate imaging sensors are used for laser mapping and color imaging, then functional versatility is improved, but device size and complexity increase excessively for small body cavity applications

Engineering Contradiction:
Improvefunctional versatilityVSAvoiddevice size
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent combines laser mapping imaging and color imaging functions into a single image sensor by integrating multiple pixel types (laser mapping pixels, color pixels, and depth pixels) in a unified sensor array, eliminating the need for multiple separate sensors and reducing overall device volume

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The image sensor is designed with multi-functional pixel elements that can perform both laser mapping measurements and color imaging tasks within the same physical structure, allowing one sensor to fulfill multiple imaging roles simultaneously

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If image sensor is placed in handpiece unit, then ease of operation is improved, but mechanical robustness and alignment stability deteriorate

Engineering Contradiction:
Improveease of operationVSAvoidmechanical robustness
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent divides the endoscope into distinct functional segments: the distal end contains the image sensor for stable positioning within the body cavity, while the handpiece unit houses the light source and control systems, separating functions to improve both robustness and operational ease

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from placing the image sensor in the handpiece (proximal position) to integrating it in the distal end (distal position) of the endoscope, changing the spatial dimension of sensor placement to improve mechanical stability and alignment while maintaining ease of operation through separate handpiece controls

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Illumination intensity

If conventional color image sensor with color filter array is used, then color imaging capability is improved, but spatial resolution and dynamic range deteriorate due to pixel consumption

Engineering Contradiction:
Improvecolor imaging capabilityVSAvoidspatial resolution
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The patent applies different pixel characteristics to different regions or groups within the sensor array: color pixels with filter arrays for color imaging, laser mapping pixels without filters for high-resolution depth measurement, and depth pixels for distance measurement, optimizing local pixel properties for specific functions

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The image sensor is segmented into distinct pixel types including color pixels, laser mapping pixels, and depth pixels, each optimized for its specific function, allowing the system to achieve both color imaging and high-precision laser mapping without compromising spatial resolution

Inventive Principle:
Principle #1Segmentation

4Illumination intensity

If conventional color image sensor is used, then color imaging is improved, but dynamic range and laser mapping capability deteriorate

Engineering Contradiction:
Improvecolor imagingVSAvoiddynamic range
Core Design Contradiction:
Illumination intensityVSLoss of information

Solution Approach 1:

The patent merges color imaging pixels and laser mapping pixels into a single image sensor, enabling simultaneous capture of both color information and laser mapping data with extended dynamic range, eliminating the need for separate sensors and improving overall information retention

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This configuration improves optical simplicity, mechanical robustness, and image quality by allowing precise laser mapping and color imaging within the constrained space of a body cavity, providing accurate dimensions and topologies of critical structures.

Implementation Method 1

The pixel array may then return two exposure frames for each reading of the pixel array, including a short exposure frame and a long exposure frame

Methodology Applied
Scientific EffectElectromagnetic radiation detection: Photoelectric Effect

Implementation Method 2

segmenting the pixels of the pixel array in a checkerboard pattern. The pixel array has only monochrome pixels that are 'color agnostic' and can sense reflected electromagnetic radiation with a wide range of wavelengths

Methodology Applied
Scientific EffectPhotoelectric detection with variable exposure time: Photoelectric Effect

Data Source

PatentUS11624830B2Wide dynamic range using a monochrome image sensor for laser mapping imaging
Publication Date: 2023.04.11 CILAG GMBH INTERNATIONAL
  • US11624830B2 patent drawing
  • US11624830B2 patent drawing
  • US11624830B2 patent drawing

AI summary

Systems, methods, and devices for laser mapping and color imaging with increased dynamic range are disclosed. A system includes an emitter for emitting pulses of electromagnetic radiation and an image sensor comprising a pixel array for sensing reflected electromagnetic radiation, wherein the pixel array comprises a plurality of pixels each configurable as a short exposure pixel or a long exposure pixel. The system includes a controller comprising a processor in electrical communication with the image sensor and the emitter. The system is such that at least a portion of the pulses of electromagnetic radiation emitted by the emitter comprises a laser mapping pattern.