Far-Infrared Image Quality Enhancement via Visible Reference Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Far-infrared cameras capture images with lower resolution compared to visible cameras, limiting the quality of images obtained, especially in applications requiring clear and detailed imaging.

Innovation Solution

An image processing apparatus and method that combines far-infrared images with visible and near-infrared or short-wave infrared images to generate a composite signal, improving the quality of far-infrared images by adjusting the contribution ratio based on correlation amounts and using learning processes to optimize pixel corrections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If far-infrared cameras are used to capture images in low-light or nighttime conditions, then the ability to detect objects in darkness is improved, but the resolution and image quality deteriorate compared to visible cameras

Engineering Contradiction:
Improvenighttime detection capabilityVSAvoidimage resolution
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent combines far-infrared images with visible light reference images through image processing. The far-infrared image data is superimposed on the visible light image, allowing the system to maintain high resolution from the visible camera while incorporating thermal detection capabilities from the far-infrared camera, thus resolving the resolution limitation of far-infrared imaging.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If multiple cameras (visible and far-infrared) are combined to improve detection capability, then the versatility of the imaging system is improved, but the device complexity increases

Engineering Contradiction:
Improvedetection capability across different conditionsVSAvoidcamera system configuration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The image processing apparatus performs multiple functions: it processes far-infrared images, acquires visible light reference images, aligns them through coordinate transformation, and generates composite images. This multi-functional approach allows a single integrated system to handle both thermal detection and high-resolution imaging without requiring separate independent systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses visible light images as an intermediary medium. The far-infrared image data is mapped onto the visible light image coordinate system, using the visible image as a mediator to transfer and enhance the far-infrared data, thereby simplifying the integration process between the two different imaging systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If far-infrared image quality is improved through processing, then the measurement precision of temperature and object detection is improved, but the processing time and computational resources increase

Engineering Contradiction:
Improvetemperature detection accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-acquires visible light images as reference images before processing the far-infrared images. These reference images are stored and ready for immediate use when far-infrared images need enhancement, eliminating the need to capture and process visible light images in real-time, thus reducing processing time while maintaining measurement precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10880498B2Image processing apparatus and image processing method to improve quality of a low-quality image
Publication Date: 2020.12.29 SONY GROUP CORP
  • US10880498B2 patent drawing
  • US10880498B2 patent drawing
  • US10880498B2 patent drawing

AI summary

An image processing apparatus includes a first combination unit that receives a far-infrared image and multiple reference images obtained by capturing the same object as that of the far-infrared image and generates a first composite signal which is a composite signal of the multiple reference images and a second combination unit that combines the far-infrared image and the first composite signal to generate a quality-improved image of the far-infrared image. The first combination unit generates the first composite signal on the basis of a visible image-far-infrared image correlation amount and a near-infrared image-far-infrared image correlation amount. The first combination unit sets a contribution ratio of a reference image, which has a larger amount of correlation with the far-infrared image, of the two reference images, that is, the visible image and the near-infrared image to a large value and generates the first composite signal.