Edge Marking in Thermal Imaging via Visible Light Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Thermal imaging cameras face difficulties in distinguishing edges and boundaries in thermal images, as these images often lack the contrast and clarity provided by visible light images, making it hard for operators to interpret and focus on specific features.

Innovation Solution

A method that involves a processor analyzing visible light image data to detect edges and generate a display image with emphasized edges by blending infrared and visible light image data, where edge pixels are highlighted with a predetermined color, allowing for real-time edge detection and display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If thermal imaging camera displays only infrared image, then thermal information is preserved, but edge distinction and feature recognition deteriorate

Engineering Contradiction:
Improvethermal information accuracyVSAvoidedge distinction difficulty
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent combines infrared image data and visible light image data into a single fused display image. The visible light image provides edge and boundary information that complements the thermal information, allowing operators to simultaneously recognize both thermal patterns and structural features without switching between separate displays

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses visible light image as an intermediary to enhance thermal image interpretation. The visible light component acts as a mediator that provides contextual structural information, making it easier to identify and locate thermal features within the overall scene

Inventive Principle:
Principle #24Intermediary (Mediator)

2Difficulty of detecting and measuring

If visible light image is used to improve edge detection, then edge clarity is improved, but thermal information visibility deteriorates

Engineering Contradiction:
Improveedge detection capabilityVSAvoidthermal information loss
Core Design Contradiction:
Difficulty of detecting and measuringVSLoss of information

Solution Approach 1:

The patent applies different image processing treatments to different regions and components of the image. Edge regions detected in the visible light image are enhanced and overlaid on the thermal image, while non-edge regions maintain their thermal characteristics. This allows edge enhancement locally without compromising overall thermal information

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent overlays edge detection results from the visible light dimension onto the thermal image dimension, creating a multi-layered composite image. This dimensional integration allows edge information to be superimposed without completely replacing the thermal data, preserving both types of information in a unified display

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Difficulty of detecting and measuring

If edge pixels are replaced with predetermined color, then edge emphasis is improved, but image data completeness deteriorates

Engineering Contradiction:
Improveedge detection clarityVSAvoidpixel data loss
Core Design Contradiction:
Difficulty of detecting and measuringVSLoss of information

Solution Approach 1:

The patent changes the color or intensity of pixels that are identified as edges in the visible light image. These edge pixels are highlighted with distinct visual characteristics in the fused image, making them stand out while still maintaining their spatial location and correspondence to the underlying thermal data

Inventive Principle:
Principle #32Color changes

Data Source

PatentEP2921995B1Visible light image with edge marking for enhancing IR imagery
Publication Date: 2020.11.04 FLUKE CORP
  • EP2921995B1 patent drawingFigure 1
  • EP2921995B1 patent drawingFigure 2
  • EP2921995B1 patent drawingFigure 3

AI summary

The invention relates generally to edge detection and presentation in thermal images. Infrared and visible light images comprising at least partially overlapping target scenes are analyzed. An edge detection process is performed on the visible light image to determine which pixels represent edges in the target scene. A display image is generated in which some pixels include infrared image data and in which pixels corresponding to edges in the visible light image include a predetermined color and do not include corresponding infrared image data to emphasize edges. Edge pixels in the display image can include exclusively the predetermined color, or in some examples, a blend of a predetermined color and visible light image data. Methods can include replacing one or the other of visible light edge pixels or corresponding infrared pixels with the predetermined color before combining the visible light and infrared image data to create a display image.