Depth Imaging Flare Correction Using Visible and Infrared Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional depth acquisition devices face challenges in accurately measuring depth due to issues like flare, ghost, and luminance saturation, especially when imaging conditions change or when viewing positions differ, leading to incorrect depth estimation.
Innovation Solution
The device employs a processor to acquire infrared and visible light images of the same scene at the same viewpoint and time, detects flare regions in the infrared image, and estimates depth using both images to correct depth measurements in flare regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If depth is measured using infrared light imaging, then depth acquisition capability is improved, but measurement precision deteriorates due to flare regions
Solution Approach 1:
The patent uses visible light images as an intermediary to identify and mask flare regions in infrared images. The visible light image serves as a reference to detect abnormal high-luminance areas in the infrared image that correspond to flare, allowing these regions to be excluded from depth calculation. This mediator approach resolves the contradiction by using one imaging modality to correct artifacts in another.
Solution Approach 2:
The patent captures a visible light image as a copy or reference image of the same scene under similar imaging conditions. This copy is then used to identify flare regions by comparing luminance patterns between the visible and infrared images. The visible light copy allows the system to recognize and exclude flare-affected areas from depth measurement without compromising the overall depth acquisition capability.
2Reliability
If imaging is performed with infrared light, then depth information can be acquired, but reliability deteriorates due to incorrect depth estimation in flare regions
Solution Approach 1:
The patent extracts and isolates flare regions from the infrared image by comparing it with the visible light image. Once identified, these problematic regions are extracted as a separate mask and excluded from the depth calculation process. This extraction principle ensures that only reliable, non-flare regions contribute to the final depth map, thereby maintaining high reliability without losing overall depth information.
Solution Approach 2:
The patent implements a feedback mechanism where the visible light image provides continuous information about flare regions, which is fed back to the depth calculation process. This feedback loop allows the system to dynamically adjust which regions are used for depth estimation, ensuring that unreliable flare-affected areas are consistently excluded while maintaining accurate depth measurement in valid regions.
3Measurement precision
If depth measurement is performed using conventional methods, then processing simplicity is maintained, but measurement precision deteriorates due to flare and ghost phenomena
Solution Approach 1:
The patent merges two imaging modalities (infrared and visible light) into a unified depth measurement system. The infrared image provides depth information while the visible light image provides flare detection capability. By combining these two images and their processing pipelines, the system achieves high measurement precision while managing complexity through integrated processing that leverages the strengths of both modalities.
Solution Approach 2:
The patent creates a multi-functional imaging system where the visible light camera serves dual purposes: capturing visible light images for reference and simultaneously acting as a flare detection mechanism for the infrared depth imaging. This universality principle allows one component to perform multiple functions, reducing overall system complexity while improving measurement precision through flare detection and exclusion.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for accurate depth estimation by leveraging the high correlation between infrared and visible light images, effectively addressing the inaccuracies caused by flare and similar phenomena.
Implementation Method 1
The light source irradiates the subject with light. The imager images the light reflected on the subject.
Implementation Method 2
detecting a flare region from the infrared light image
Data Source
AI summary
A depth acquisition device includes a memory and a processor. The processor performs: acquiring timing information indicating a timing at which a light source irradiates a subject with infrared light; acquiring, from the memory, an infrared light image generated by imaging a scene including the subject with the infrared light according to the timing indicated by the timing information; acquiring, from the memory, a visible light image generated by imaging a substantially same scene as the scene of the infrared light image, with visible light from a substantially same viewpoint as a viewpoint of imaging the infrared light image at a substantially same time as a time of imaging the infrared light image; detecting a flare region from the infrared light image; and estimating a depth of the flare region based on the infrared light image, the visible light image, and the flare region.