Infrared Image Structural Enhancement via Visible Light Edge Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Infrared imaging systems used in medical procedures often lack structural details, as the infrared images, when combined with visible light images, obscure these details due to color mapping, making real-time analysis of surgical sites challenging.

Innovation Solution

An imaging system that enhances infrared images with structural data by extracting and applying edge information from visible light images using filters like bilateral filters, converting images to grayscale, and scaling enhancement signals, thereby improving the clarity of anatomical features in infrared images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If infrared images are combined with visible light images using color mapping, then tissue conditions such as blood flow and disease are visualized, but structural details are obscured

Engineering Contradiction:
Improvestructural detail visibilityVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSEase of manufacture

Solution Approach 1:

The patent segments the visible light image into structural data (edges, contours, anatomical features) separate from the infrared functional data. This segmentation allows the structural information to be extracted and applied as an overlay or enhancement layer on the infrared image, preserving structural visibility while maintaining the functional infrared information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses grayscale conversion and edge detection filters as intermediary processing steps. The visible light image is converted to grayscale and processed through filters (e.g., Sobel, Canny, or bilateral filters) to generate structural enhancement data that acts as an intermediary layer between the original visible light image and the final enhanced infrared image.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If color mapping is applied to infrared images, then tissue characteristics are enhanced, but anatomical features become less distinct

Engineering Contradiction:
Improveanatomical feature clarityVSAvoidimage contrast
Core Design Contradiction:
Loss of informationVSIllumination intensity

Solution Approach 1:

The patent applies local quality enhancement by selectively applying structural data enhancement to specific regions of the infrared image. The edge detection and structural extraction processes identify anatomical boundaries and features, then apply enhancement locally at these boundaries while preserving the functional infrared information in the interior regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent utilizes grayscale conversion of the visible light image and applies this as a luminance overlay on the infrared image. This color/luminance adjustment allows the structural information to be visible without completely replacing the infrared functional data, maintaining a balance between anatomical clarity and functional visualization.

Inventive Principle:
Principle #32Color changes

3Measurement precision

If structural data is extracted from visible light images and applied to infrared images, then anatomical features are clarified, but processing time increases

Engineering Contradiction:
Improvestructural detail resolutionVSAvoidreal-time processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies partial action by selectively extracting only the most critical structural information (edges, contours, and prominent anatomical features) rather than processing the entire visible light image in full detail. This selective extraction reduces computational load while maintaining the essential anatomical information needed for surgical guidance.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent replaces complex, time-consuming manual image processing mechanics with automated digital signal processing algorithms. Filters such as bilateral filters, Sobel operators, or Canny edge detectors automatically identify and extract structural features in real-time, eliminating the need for manual image alignment and enhancement procedures.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The enhanced infrared images provide clearer visual context of anatomical features, improving real-time analysis and surgical precision by maintaining structural detail visibility.

Implementation Method 1

The edge may be identified using known image filters which detect a contrast in the VL image frame. Such image filters illustratively include a bilateral filter

Methodology Applied
Scientific EffectEdge detection:

Implementation Method 2

the infrared light is typically used as an excitation light that excites a dye to emit light through fluorescence in the infrared spectrum

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Data Source

PatentUS12052526B2Imaging system having structural data enhancement for non-visible spectra
Publication Date: 2024.07.30 KARL STORZ IMAGING INC
  • US12052526B2 patent drawing
  • US12052526B2 patent drawing
  • US12052526B2 patent drawing

AI summary

An imaging system includes a light source for emitting visible light and infrared light and a camera head unit configured to capture visible light image data so as to generate a visible light image frame and configured to capture infrared image data so as to generate an infrared image frame. A camera control unit is configured to extract a structural data from the visible light image frame. The camera control unit is further configured to apply the structural data to the infrared image frame so as to enhance the infrared image with structural data.