Infrared Subject Extraction via Background Illumination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in accurately extracting subjects from images when the colors of the subject and background are similar, leading to erroneous determinations and reduced precision.

Innovation Solution

An image processing device and method that utilizes invisible light images captured with an infrared camera and lamp, where the infrared light is radiated only to the background, allowing for precise differentiation between subject and background regions by calculating pixel value differences between infrared and background images, and extracting the subject region based on a predetermined threshold.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If background differentiation method is used to rapidly extract subjects from images, then extraction speed is improved, but extraction precision deteriorates when subject and background colors are similar

Engineering Contradiction:
Improveextraction speedVSAvoidextraction precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent changes the detection parameter from visible light color information to invisible light (infrared) information. By capturing images in the infrared spectrum and comparing infrared reflectance between subject and background, the system achieves both rapid extraction and high precision even when visible colors are similar, as infrared reflection properties often differ between objects and backgrounds.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces an intermediary detection layer by capturing invisible light images as an intermediate step. The subject extraction is performed by comparing the invisible light image with a background-only invisible light image, using the difference in infrared reflection as an intermediary indicator to identify subjects, thereby achieving both speed and precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If dynamic threshold control based on reference pixels is used, then processing efficiency is improved, but erroneous determination increases when colors are similar

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddetermination accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent replaces the mechanical/color-based threshold control system with an infrared-based detection system. Instead of dynamically adjusting color thresholds based on reference pixels, the system uses infrared reflectance differences, which provide more reliable differentiation between subjects and backgrounds with similar visible colors, thereby improving both efficiency and reliability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively inhibits the deterioration of subject extraction precision and reliably separates subjects from backgrounds with similar colors, improving the accuracy of subject extraction.

Implementation Method 1

an invisible light irradiation device is disposed so that invisible light is radiated to the background and the invisible light is not radiated to the subject

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

a first invisible light image of only a background in which a subject is not included and a second invisible light image in which the subject and the background are included

Methodology Applied
Scientific EffectInfrared detection: Photoelectric Effect

Data Source

PatentUS11881005B2Image processing device, image processing method, and image processing program
Publication Date: 2024.01.23 NIPPON TELEGRAPH & TELEPHONE CORP
  • US11881005B2 patent drawing
  • US11881005B2 patent drawing
  • US11881005B2 patent drawing

AI summary

It is possible to inhibit deterioration of extraction precision of a subject and reliably extract the subject even when colors of the subject and a background are the same or similar. An image processing device 1 includes an input unit 11 configured to input a first invisible light image of only a background in which a subject is not included and a second invisible light image in which the subject and the background are included and a subject region extraction unit 15 configured to calculate a difference between a pixel value of each pixel of the second invisible light image and a pixel value of a corresponding pixel of the first invisible light image, determine whether the pixel is in a subject region or a background region in accordance with whether the difference is equal to or greater than a predetermined threshold, and extract the subject region from the second invisible light image. The first and second invisible light images are images captured in an environment in which an invisible light irradiation device is disposed so that invisible light is radiated to the background and the invisible light is not radiated to the subject.