Imaging System Field of View Motion Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging methods face challenges in improving image quality, especially in invisible light spectra like near-infrared, due to limitations in sensor sensitivity, exposure time, and noise amplification, which result in reduced contrast and detail in fluorescence images.

Innovation Solution

The method determines changes in the image sensor's field of view using visible light information, allowing for the registration and optimization of invisible light images through motion compensation and computational photography, enhancing image quality without blurring.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If LED light sources are used to reduce heat dissipation and noise, then energy efficiency and lifespan are improved, but image signal intensity decreases requiring greater amplification which increases noise and reduces image quality

Engineering Contradiction:
Improveheat dissipationVSAvoidimage quality
Core Design Contradiction:
Loss of energyVSMeasurement precision

Solution Approach 1:

The system alternates between capturing images in the visible spectrum and images in the near-infrared spectrum. By periodically switching between these two spectral ranges, the system can use the brighter visible light images for motion estimation and the NIR images for fluorescence detection, avoiding the need for continuous high-intensity NIR illumination that would require excessive amplification and result in noisy images.

Inventive Principle:
Principle #19Periodic action

2Illumination intensity

If amplification is increased to compensate for weak LED IR light intensity, then image signal strength is improved, but noise increases causing blurriness and reduced contrast

Engineering Contradiction:
Improveimage signal strengthVSAvoidimage contrast
Core Design Contradiction:
Illumination intensityVSMeasurement precision

Solution Approach 1:

The system uses visible light images as an intermediary to estimate motion and guide the processing of NIR images. By using the brighter visible spectrum as a mediator for motion estimation, the system can process NIR images with lower amplification requirements, thereby reducing noise while maintaining signal strength.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Illumination intensity

If exposure time is extended to improve NIR image quality, then signal strength is improved, but motion blur increases reducing image sharpness

Engineering Contradiction:
Improvesignal strengthVSAvoidimage sharpness
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The system performs motion estimation using visible light images before processing the NIR images. This preliminary action of estimating motion from the brighter visible spectrum allows the system to compensate for motion in the NIR images, enabling shorter exposure times without sacrificing image sharpness.

Inventive Principle:
Principle #10Preliminary action

4Loss of information

If alternating white and fluorescent light is used to capture images, then spectral information is improved, but frame rate decreases and waiting times increase

Engineering Contradiction:
Improvespectral informationVSAvoidframe rate
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system implements periodic alternation between capturing visible light images and NIR fluorescence images. This structured periodic switching ensures that both spectral ranges are captured systematically, maintaining comprehensive spectral information while optimizing the timing to minimize waiting periods and maximize frame rate.

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves image contrast and detail in near-infrared images, facilitating better medical interpretation by accurately distinguishing perfused and poorly perfused tissue areas, and enhancing the visibility of carcinogenic tissue.

Implementation Method 1

an image sensor (114) during a change of a field of view (112) of the image sensor (114) relative to the scene (110)... a first image (41) mainly comprising first image information from the scene (110) in a visible light range... a plurality of second images (42, 42') mainly comprising second image information from the scene in an invisible light range

Methodology Applied
Scientific EffectElectromagnetic radiation detection: Photoelectric Effect

Implementation Method 2

at least one illumination device (102)... a first image (41) in the scene (110) upon a first illumination (50) of the scene (110)... a plurality of second images (42, 42') in the scene (110) upon a second illumination (52) of the scene (110)

Methodology Applied
Scientific EffectLight emission: Light

Data Source

PatentEP4184428B1Imaging method for imaging a scene and system
Publication Date: 2024.05.08 KARL STORZ SE & CO KG
  • EP4184428B1 patent drawingFigure 1
  • EP4184428B1 patent drawingFigure 2~3
  • EP4184428B1 patent drawingFigure 4

AI summary

Methods (10, 10', 10") for imaging a scene (110) during a change in the field of view (112) of an image sensor (114) relative to the scene (110) and a corresponding system (100) are disclosed.