Thermal Object Recognition Using Stereo Matching For Distant Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object recognition systems using far-infrared imaging sensors face challenges in accurately detecting distant objects due to insufficient resolution, which results in the shape of the object being indistinguishable from surrounding environments, and this issue is exacerbated by the increased cost associated with using multiple imaging sensors.

Innovation Solution

The system employs a configuration that includes an imaging unit, stereo matching unit, specific temperature region extracting unit, center point estimating unit, area ratio estimating unit, and detection temperature range adjusting unit to calculate distances and adjust detection ranges based on environmental and object areas, allowing accurate detection without the need for multiple sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a single far-infrared imaging sensor is used, then cost is reduced, but resolution of distant objects becomes insufficient making object identification difficult

Engineering Contradiction:
Improveobject detection accuracyVSAvoidimaging sensor configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the detection task into multiple functional modules: thermal image acquisition, stereo matching for distance calculation, specific temperature region extraction, center point estimation, and area ratio estimation. This segmentation allows a single imaging sensor to provide sufficient data when processed through multiple computational stages, achieving accurate distant object detection without requiring multiple physical sensors.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from two-dimensional thermal images to three-dimensional spatial understanding by calculating distance through stereo matching and estimating area ratios based on depth information. This dimensional transformation enables accurate object identification even when resolution is insufficient, as the system leverages depth cues to distinguish objects from background.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple types of imaging sensors are used to improve distant object detection, then detection accuracy improves, but cost increases

Engineering Contradiction:
Improvedistant object detection accuracyVSAvoidnumber of imaging sensors
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent makes a single far-infrared imaging sensor perform multiple functions by processing its output through various computational units: stereo matching for distance measurement, temperature region extraction for object identification, center point estimation for localization, and area ratio calculation for object characterization. This multi-functionality eliminates the need for multiple specialized sensors while maintaining high detection accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent replaces the mechanical approach of using multiple physical sensors with a computational approach using image processing algorithms. Instead of acquiring additional data from multiple sensors, the system extracts rich spatial and thermal information from a single sensor through stereo matching, temperature region extraction, and area ratio estimation computations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Shape

If resolution is insufficient for distant objects, then object shape cannot be identified, but using higher resolution requires multiple sensors increasing cost

Engineering Contradiction:
Improveobject shape identificationVSAvoidimaging sensor configuration
Core Design Contradiction:
ShapeVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary computational processing stage that bridges the gap between low-resolution thermal images and accurate object identification. The stereo matching unit calculates distance information, the temperature region extraction unit identifies thermal characteristics, and the area ratio estimation unit determines object size relative to background. These intermediary computations enable shape and object identification without requiring high-resolution input images.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameters used for object identification from relying solely on spatial resolution to incorporating distance, temperature characteristics, and area ratio. By transforming the detection parameters to include depth information and thermal property ratios, the system achieves accurate object shape identification even when the imaging resolution is insufficient.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables precise detection of distant objects while preventing a rise in costs by optimizing detection temperature ranges and estimating object temperatures, ensuring accurate identification even in insufficient resolution conditions.

Implementation Method 1

The detected far infrared rays are converted into a thermal image showing a temperature distribution of the detection target by means of photoelectric conversion, signal processing, or the like

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Implementation Method 2

Objects emit far infrared rays when radiating heat

Methodology Applied
Scientific EffectThermal radiation: Thermal Radiation

Data Source

PatentUS12359975B2Object recognition device and object recognition method
Publication Date: 2025.07.15 HITACHI LTD
  • US12359975B2 patent drawing
  • US12359975B2 patent drawing
  • US12359975B2 patent drawing

AI summary

The problem to be solved by the invention is to accurately detect a distant object while preventing an increase in cost. An object recognition device includes: an imaging unit configured to acquire a plurality of thermal images having an object captured therein; a stereo matching unit configured to perform stereo matching using the plurality of thermal images and calculate a distance to the object; a specific temperature region extracting unit configured to extract a specific temperature region from the thermal images; and an area ratio estimating unit configured to estimate, based on the distance to the object calculated by the stereo matching unit, a ratio of an area of the object included in a pixel for the specific temperature region.