Multi-Spectrum Imaging Fusion for Thermal Detail

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional infrared cameras produce images with low resolution, poor contrast, and excessive noise, and suffer from misalignment errors that reduce the interpretability of imagery.

Innovation Solution

The system combines visible spectrum and infrared imaging modules with advanced processing techniques such as non-uniformity correction, true color processing, and high contrast processing to generate combined images with enhanced detail and clarity, using a small form factor infrared imaging module and a logic device to receive and process images from both modules.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional infrared imaging is used, then thermal imaging capability is provided, but the image resolution is low and detail is poor

Engineering Contradiction:
Improveimage resolutionVSAvoidimage detail
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent combines visible spectrum imaging and infrared imaging into a single system, capturing images from both spectral ranges simultaneously or sequentially. The visible spectrum image provides high-resolution structural detail while the infrared image provides thermal information, and both are processed together to produce a fused output that achieves high resolution without sacrificing thermal imaging capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent adds the visible spectrum dimension to the traditional infrared imaging approach. By incorporating images from a different spectral dimension (visible light), the system gains access to high-resolution spatial information that complements the thermal data, effectively transitioning from single-spectrum to multi-spectrum imaging

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If conventional infrared imaging is used, then thermal detection is achieved, but contrast is poor and images lack clarity

Engineering Contradiction:
Improveimage contrastVSAvoidimage clarity
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The system merges visible spectrum imagery with infrared imagery through image fusion processing. The visible spectrum component enhances contrast and clarity by providing high-contrast structural information, while the infrared component maintains thermal detection capability. The fusion algorithm combines these complementary data sources to produce an output with superior contrast and clarity

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces image fusion processing as an intermediary step between raw infrared capture and final output. This processing layer acts as a mediator that integrates visible spectrum data with infrared data, enhancing contrast and clarity while preserving thermal information through sophisticated algorithms that balance both data sources

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If conventional infrared imaging is used, then thermal imaging is provided, but noise is excessive and degrades quality

Engineering Contradiction:
Improvesignal-to-noise ratioVSAvoidimage quality
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent combines multiple image sources (visible and infrared) and multiple temporal samples to improve the signal-to-noise ratio. By fusing data from different spectral bands and averaging multiple frames, the system reduces random noise while preserving the thermal signal, achieving superior noise performance compared to conventional single-spectrum infrared imaging

Inventive Principle:
Principle #5Merging (Combining)

4Measurement precision

If conventional infrared imaging is used, then thermal detection is achieved, but misalignment errors reduce interpretability

Engineering Contradiction:
Improveimage alignmentVSAvoidinterpretability
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent performs alignment and registration operations as preliminary steps before image fusion. By pre-aligning the visible and infrared images using feature matching and transformation algorithms, the system eliminates misalignment errors before the fusion process, ensuring that corresponding features from both spectral bands are properly registered and enhancing overall interpretability

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10244190B2Compact multi-spectrum imaging with fusion
Publication Date: 2019.03.26 TELEDYNE FLIR LLC
  • US10244190B2 patent drawing
  • US10244190B2 patent drawing
  • US10244190B2 patent drawing

AI summary

Techniques using small form factor infrared imaging modules are disclosed. An imaging system may include visible spectrum imaging modules, infrared imaging modules, illumination modules, and other modules to interface with a user and/or a monitoring system. Visible spectrum imaging modules and infrared imaging modules may be positioned in proximity to a scene that will be monitored while visible spectrum-only images of the scene are either not available or less desirable than infrared images of the scene. Imaging modules may be configured to capture images of the scene at different times. Image analytics and processing may be used to generate combined images with infrared imaging features and increased detail and contrast. Selectable aspects of non-uniformity correction processing, true color processing, and high contrast processing, may be performed on the captured images. Control signals based on the combined images may be presented to a user and/or a monitoring system.