Depth Imaging Flare Correction Using Infrared and Visible Light

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional depth acquisition devices face challenges in accurately measuring depth due to issues such as flare, ghosting, and luminance saturation, particularly when imaging conditions change, leading to incorrect depth estimation.

Innovation Solution

The proposed depth acquisition device uses a combination of infrared and visible light imaging, detecting flare regions in the infrared light image and correcting depth estimates based on both images to ensure accurate depth measurement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If depth is measured using infrared light imaging alone, then depth acquisition speed is improved, but measurement precision deteriorates due to flare, ghosting, and luminance saturation

Engineering Contradiction:

Improvedepth acquisition speedVSAvoiddepth measurement accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The patent combines infrared light imaging and visible light imaging into a unified depth acquisition system. The processor integrates depth information from both imaging modes, using visible light image data to correct errors in infrared-based depth measurements, particularly in flare-affected regions, thereby resolving the contradiction between fast depth acquisition and accurate measurement

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The visible light image acts as an intermediary to correct the infrared light image's depth measurement errors. By detecting flare regions in the infrared image and comparing them with corresponding regions in the visible light image, the system uses the visible light data as a mediator to supplement missing or erroneous depth information

Inventive Principle:

Principle #24Intermediary (Mediator)

2Difficulty of detecting and measuring

If infrared light intensity is increased to improve depth detection in low-light conditions, then depth detection capability is improved, but flare and luminance saturation occur worsening measurement accuracy

Engineering Contradiction:

Improvedepth detection capabilityVSAvoiddepth estimation accuracy

Core Design Contradiction:

Difficulty of detecting and measuringVSMeasurement precision

Solution Approach 1:

The visible light image serves as an intermediary that provides accurate depth information for regions where infrared imaging fails due to flare or saturation. The processor detects problematic regions in the infrared image and uses corresponding visible light data to correct depth estimates, maintaining measurement precision even when infrared intensity is increased

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent converts the harmful effect of flare and luminance saturation into a useful correction mechanism. By detecting these artifacts in the infrared image and using visible light imaging to identify and correct the affected regions, the system turns measurement errors into opportunities for improved accuracy through multi-modal validation

Inventive Principle:

Principle #22Blessing in disguise (Convert harm into benefit)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for precise depth estimation even in regions affected by flare, by leveraging the correlation between infrared and visible light images to supplement missing information and correct depth measurements.

Implementation Method 1

The light source irradiates the subject with light. The imager images the light reflected on the subject.

Methodology Applied

Scientific EffectReflection: Reflection

Implementation Method 2

detecting a flare region from the infrared light image

Methodology Applied

Scientific EffectFlare:

Implementation Method 3

acquiring timing information indicating a timing at which a light source irradiates a subject with infrared light

Methodology Applied

Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS12361579B2Imaging device, imaging method, and information processing device

Publication Date: 2025.07.15 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD

AI summary

A depth acquisition device includes a memory and a processor. The processor performs: acquiring timing information indicating a timing at which a light source irradiates a subject with infrared light; acquiring, from the memory, an infrared light image generated by imaging a scene including the subject with the infrared light according to the timing indicated by the timing information; acquiring, from the memory, a visible light image generated by imaging a substantially same scene as the scene of the infrared light image, with visible light from a substantially same viewpoint as a viewpoint of imaging the infrared light image at a substantially same time as a time of imaging the infrared light image; detecting a flare region from the infrared light image; and estimating a depth of the flare region based on the infrared light image, the visible light image, and the flare region.