Hyperspectral Endoscope Imaging with Fixed Pattern Noise Cancellation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpiece units are fragile, prone to misalignment, and limited to capturing only color images, making them unsuitable for hyperspectral imaging due to space constraints and image quality degradation.

Innovation Solution

An endoscopic imaging system with a CMOS image sensor placed at the distal end, employing minimal area image sensors and pulsing electromagnetic radiation across various spectral bands to enable hyperspectral and color imaging, canceling fixed pattern noise and allowing for high-definition imaging in light-deficient environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the image sensor is placed in the handpiece unit, then the device structure is simplified, but the endoscope becomes fragile and image quality degrades due to misalignment

Engineering Contradiction:
Improvedevice structureVSAvoidimage quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent inverts the traditional endoscope structure by placing the image sensor at the distal end tip instead of in the handpiece unit. This reversal allows the sensor to be positioned within the body cavity, eliminating alignment issues and fragility associated with long light transmission paths, while maintaining structural simplicity through integrated distal-end design

Inventive Principle:
Principle #13The other way round (Inversion)

2Adaptability or versatility

If multiple distinct types of pixel sensors are used for hyperspectral imaging, then imaging capability is improved, but the device size increases and cannot fit in the distal end

Engineering Contradiction:
Improveimaging capabilityVSAvoiddevice size
Core Design Contradiction:
Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent employs a single monochrome image sensor that performs multiple functions: capturing visible light for color imaging and detecting near-infrared wavelengths for hyperspectral imaging. This multi-functional approach eliminates the need for multiple specialized sensors, reducing device size while maintaining comprehensive imaging capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the operational parameters of the image sensor by removing color filter arrays and using the sensor in monochrome mode, enabling it to detect a broader spectrum including near-infrared wavelengths. This parameter change allows one sensor to replace multiple specialized sensors

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If a color filter array is used for RGB imaging, then color image quality is improved, but the sensor area required increases significantly

Engineering Contradiction:
Improvecolor image qualityVSAvoidsensor area
Core Design Contradiction:
Manufacturing precisionVSArea of stationary object

Solution Approach 1:

The patent extracts and removes the color filter array from the image sensor design, opting instead for a monochrome sensor configuration. This extraction eliminates the need for complex color filtering structures, significantly reducing the sensor area required while maintaining sufficient image quality for both visible and near-infrared detection

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise hyperspectral imaging within the endoscope, improving image quality and diagnostic capabilities by integrating hyperspectral data with RGB images, while reducing the device's fragility and size constraints.

Implementation Method 1

The pixel array generates an exposure frame in response to each emission of electromagnetic radiation and generates a dark frame when the emitter is not emitting electromagnetic radiation

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11187657B2Hyperspectral imaging with fixed pattern noise cancellation
Publication Date: 2021.11.30 CILAG GMBH INTERNATIONAL
  • US11187657B2 patent drawing
  • US11187657B2 patent drawing
  • US11187657B2 patent drawing

AI summary

Hyperspectral imaging with reduced fixed pattern noise is disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor. The method includes reducing fixed pattern noise in an exposure frame by subtracting a reference frame from the exposure frame. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 513 nm to about 545 nm, from about 565 nm to about 585 nm, or from about 900 nm to about 1000 nm.