Noise-Aware Edge Enhancement in Pulsed Fluorescence Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional endoscopes with image sensors placed in handpieces are fragile, prone to misalignment, and limited to capturing only color images, making them unsuitable for fluorescence imaging and requiring multiple specialized systems for different fluorescent reagents, which is costly and inefficient.

Innovation Solution

An endoscopic system with a monochrome image sensor placed at the distal end, using pulsed electromagnetic radiation to capture RGB and fluorescence data, allowing for single-session imaging of multiple reagents and improved image quality through noise-aware edge enhancement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a traditional color image sensor with color filter array is used, then color image quality is maintained, but the sensor cannot fit in the distal end of the endoscope and the system becomes fragile and misaligned

Engineering Contradiction:
Improvemechanical robustnessVSAvoidsensor configuration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the color filter array from the image sensor, using a monochrome sensor instead. This simplifies the sensor configuration and enables placement in the distal end of the endoscope, improving mechanical robustness while eliminating the fragility associated with traditional color sensors

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The monochrome image sensor serves multiple functions: capturing color images through sequential RGB filtering, capturing fluorescence images, and capturing near-infrared images. This multi-functionality replaces the need for multiple specialized sensors, simplifying the overall system while maintaining versatility

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple specialized imaging systems are used for different fluorescent reagents, then imaging capability for various reagents is achieved, but cost and system complexity increase significantly

Engineering Contradiction:
Improvefluorescence imaging capabilityVSAvoidnumber of imaging systems
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal imaging system where a single monochrome sensor can capture multiple types of images (color, fluorescence, near-infrared) by sequentially applying different optical filters. This eliminates the need for multiple specialized imaging systems, reducing both cost and complexity while maintaining the ability to image various fluorescent reagents

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses dynamic filter switching during image capture, where optical filters are sequentially positioned in the optical path to enable different imaging modes. This dynamic approach allows one sensor to perform multiple functions that would otherwise require separate static systems

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If conventional edge enhancement is applied to fluorescence images, then image quality is improved, but noise is also amplified making critical structures difficult to identify

Engineering Contradiction:
Improveimage qualityVSAvoidnoise amplification
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent employs noise-aware edge enhancement that uses feedback from noise analysis to adjust enhancement parameters. The system analyzes the noise characteristics of the fluorescence image and dynamically adjusts the edge enhancement strength, applying stronger enhancement to low-noise regions and weaker enhancement to high-noise regions, thereby improving image quality without excessive noise amplification

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The edge enhancement is applied locally rather than uniformly across the entire image. The system identifies regions with different noise characteristics and applies appropriate enhancement levels to each region, preserving critical structures while minimizing noise amplification in problematic areas

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables robust, efficient, and cost-effective fluorescence imaging in a light-deficient environment with improved image quality and mechanical robustness, allowing for precise identification of critical structures within the body cavity.

Implementation Method 1

Fluorescence is the emission of light by a substance that has absorbed light or other electromagnetic radiation. Certain fluorescent materials 'glow' or emit a distinct color that is visible to the human eye when the fluorescent material is subjected to ultraviolet light or other wavelengths of electromagnetic radiation.

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 2

A digital color image includes at least three layers, or 'color channels,' that cumulatively form an image with a range of hues. Each of the color channels measures the intensity and chrominance of light for a spectral band.

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11898909B2Noise aware edge enhancement in a pulsed fluorescence imaging system
Publication Date: 2024.02.13 CILAG GMBH INTERNATIONAL
  • US11898909B2 patent drawing
  • US11898909B2 patent drawing
  • US11898909B2 patent drawing

AI summary

Fluorescence imaging with reduced fixed pattern noise is disclosed. A method includes actuating an emitter to emit a plurality of pulses of electromagnetic radiation and sensing reflected electromagnetic radiation resulting from the plurality of pulses of electromagnetic radiation with a pixel array of an image sensor to generate a plurality of exposure frames. The method includes applying edge enhancement to edges within an exposure frame of the plurality of exposure frames. The method is such that at least a portion of the plurality of pulses of electromagnetic radiation emitted by the emitter comprises one or more of electromagnetic radiation having a wavelength from about 770 nm to about 790 nm; or from about 795 nm to about 815 nm.