Dual Aperture Camera Depth Mapping Using 2PD and Stereo Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing dual-aperture digital cameras struggle to provide accurate absolute depth maps in non-overlap regions and enhance the accuracy of depth maps in overlap regions, as current methods rely mainly on stereoscopic information and are limited by the small baseline of 2PD sensors.
Innovation Solution
The method involves calculating a stereoscopic depth map in the overlap region and using a 2PD disparity map from the first camera's image sensor to extend absolute depth information to the non-overlap region, converting disparities into calibrated physical units, and enhancing the depth map accuracy by combining stereoscopic and 2PD data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stereoscopic depth mapping is used in dual-aperture cameras, then depth information can be obtained in the overlap region, but accurate absolute depth maps cannot be provided in non-overlap regions
Solution Approach 1:
The patent combines stereoscopic depth mapping (from dual-camera baseline) with 2PD disparity mapping (from single-camera micro-lens focus detection) to merge the advantages of both methods. The 2PD method provides coverage across the entire FOV while stereoscopic mapping provides accurate baseline depth, and their combination enables accurate absolute depth maps throughout the entire field of view including non-overlap regions.
Solution Approach 2:
The patent uses 2PD disparity map as an intermediary that bridges the gap between stereoscopic depth mapping and absolute depth measurement. The 2PD disparity map, obtained from focus detection in the entire FOV, serves as a mediator to extend accurate depth information from the overlap region to non-overlap regions, enabling absolute depth mapping across the complete field of view.
2Ease of operation
If 2PD sensors with small baseline are used, then depth estimation can be performed, but the baseline is too small to provide accurate absolute depth measurements
Solution Approach 1:
The patent merges 2PD disparity mapping (using small baseline micro-lens configuration) with stereoscopic depth mapping (using larger dual-camera baseline). This combination allows the system to benefit from the ease of operation of 2PD sensors while achieving the measurement precision of stereoscopic methods with accurate absolute depth through the larger baseline geometry.
Solution Approach 2:
The patent changes the effective baseline parameter by combining two different baseline measurements: the small baseline from 2PD micro-lens separation and the larger baseline from dual-camera stereoscopic separation. This parameter change enables the system to achieve both ease of operation and measurement precision by utilizing the larger effective baseline for absolute depth calculation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for the generation of absolute depth maps across the entire field of view, improving accuracy and reliability by integrating stereoscopic and 2PD data, ensuring accurate depth information in both overlap and non-overlap regions.
Implementation Method 1
calculating a stereoscopic depth map in the overlap region using respective image information provided by the first and second cameras
Implementation Method 2
a Phase-Detection (PD) sensor... PD sensors take advantage of multiple micro-lenses (or partially covered micro-lenses) to detect pixels in and out of focus
Implementation Method 3
Micro-lenses are calibrated so that objects in focus are projected onto the sensor plane at the same location relative to the lens
Data Source
AI summary
In an imaging system having a first camera with a first field of view (FOV) and a second camera with a second FOV smaller than the first FOV, wherein the first and second FOVs overlap over an overlap region, a method for calculating a calibrated phase detection depth map over the entire first FOV comprises calculating a stereoscopic depth map in the overlap region using image information provided by the first and second cameras, obtaining a first camera phase detection (PD) disparity map in the entire first FOV, and using the stereoscopic depth map in the overlap region to provide a calibrated 2PD depth map in the entire first FOV.