Imaging Apparatus Depth Map Fusion for Subject Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging apparatuses struggle to accurately recognize subjects along their shape in images, particularly in scenarios where depth measurement techniques have limited spatial resolution and accuracy.
Innovation Solution
The proposed imaging apparatus combines depth information from two different measurement methods, namely the Depth from Defocus (DFD) method and the image plane phase detection method, to generate a combined depth map with improved spatial resolution and accuracy. This combined depth map is then used to recognize subject regions along their shape in the image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single depth measurement method (DFD or phase detection) is used, then the device complexity is low, but the measurement precision and spatial resolution are insufficient
Solution Approach 1:
The patent combines two different depth measurement methods (DFD and phase detection) into a unified depth map generation system. The controller integrates depth maps from both methods to create a combined depth map that leverages the strengths of each approach, thereby improving overall measurement precision without requiring completely separate systems.
Solution Approach 2:
The image sensor is designed to perform multiple functions: it captures both color images and depth information using the same hardware components. The photoelectric converter array serves both standard imaging and depth measurement purposes through different processing modes, reducing device complexity while maintaining high measurement precision.
2Measurement precision
If DFD method is used for depth measurement, then the spatial resolution can be improved, but the measurement accuracy decreases in certain depth ranges
Solution Approach 1:
The system dynamically changes processing parameters by selecting different depth measurement methods based on the depth range of the subject. For near-field subjects, phase detection is prioritized for reliability, while for far-field subjects, DFD is used to maximize spatial resolution. This adaptive parameter selection ensures both high resolution and reliability across different scenarios.
Solution Approach 2:
The patent creates a composite depth map that integrates results from two different measurement methodologies. By combining the depth maps from DFD and phase detection methods, the system achieves a result that has both the high spatial resolution of DFD and the reliability of phase detection, similar to how composite materials combine properties of constituent materials.
3Reliability
If phase detection method is used, then the measurement reliability is high for near-field subjects, but the spatial resolution is limited
Solution Approach 1:
The system dynamically adjusts the depth measurement approach based on subject distance and scene characteristics. The controller automatically switches between relying on phase detection, DFD, or a combination of both, depending on the required balance between reliability and spatial resolution for the current imaging scenario.
Data Source
AI summary
An imaging apparatus includes: an image sensor that captures a subject image to generate image data; a depth measurer that acquires depth information indicating a depth to a subject in an image indicated by the image data; a detector that acquires subject detection information on a region where the subject is located in the image; and a recognizer that recognizes a subject region having a shape along the subject in the image, based on the depth information and the subject detection information.