Parallax Correction in Fused Array Imaging Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional array cameras with multiple lenses and image sensors face challenges in parallax correction due to physical offsets, leading to objects appearing at different positions in images, which is more pronounced for objects at varying distances, requiring both global and local parallax corrections for accurate depth mapping.
Innovation Solution
The implementation of a method that uses global parallax corrections based on horizontal and vertical projection graphs and local parallax corrections through a block matching procedure to align images captured by multiple sensors, involving edge detection, sum-of-absolute differences, and block energy differences to create a parallax correction map, which also aids in generating depth maps.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single parallax correction is applied to all objects in an image, then the correction process is simple, but objects at different distances are not corrected accurately
Solution Approach 1:
The patent divides the image into multiple depth layers based on distance from the imaging device. Each layer receives a different parallax correction value, allowing objects at different distances to be corrected accurately while maintaining a manageable correction process through systematic segmentation.
Solution Approach 2:
The patent applies different parallax correction values to different regions of the image corresponding to objects at different distances. This local differentiation ensures that each object is corrected according to its specific distance, improving overall correction accuracy without requiring a completely complex global system.
2Measurement precision
If multiple parallax corrections are applied for different depth layers, then parallax correction accuracy is improved, but the processing complexity increases
Solution Approach 1:
The patent performs depth estimation and layer segmentation before applying parallax corrections. By pre-organizing the image into depth layers and calculating correction values in advance, the system achieves high correction accuracy while streamlining the overall processing workflow and reducing computational complexity during final image synthesis.
3Object-affected harmful factors
If physical offsets between image sensors are reduced, then parallax effects are minimized, but the baseline for depth sensing is reduced
Solution Approach 1:
The patent calculates and applies different parallax correction values based on the measured physical offsets between image sensors and the estimated depth of objects. By dynamically adjusting correction parameters according to depth layer, the system compensates for parallax distortion while preserving the beneficial baseline distance for depth sensing.
Data Source
AI summary
Electronic devices may include camera modules. A camera module may include an array camera having an array of lenses and an array of corresponding image sensors. Parallax correction and depth mapping methods may be provided for array cameras. A parallax correction method may include a global and a local parallax correction. A global parallax correction may be determined based on one-dimensional horizontal and vertical projections of edge images. Local parallax corrections may be determined using a block matching procedure. Further improvements to local parallax corrections may be generated using a relative block color saturation test, a smoothing of parallax correction vectors and, if desired, using a cross-check between parallax correction vectors determined for multiple image sensors. Three dimensional depth maps may be generated based on parallax correction vectors.