Hybrid Depth Map Processing Using Orthogonal Image Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems using dual photodiode image sensors struggle to accurately determine depths for regions lacking horizontal or vertical edges, as similar image data from different perspectives lead to inaccurate disparity measurements.
Innovation Solution
A hybrid depth map processing method is introduced, utilizing a first image sensor capturing images from one direction and a second image sensor separated orthogonally to determine depth maps based on disparities, combining these to enhance depth detection for regions with and without specific types of edges.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a dual photodiode image sensor is used to capture images from multiple perspectives, then depth information can be obtained through disparity measurements, but depth accuracy deteriorates for regions lacking horizontal or vertical edges due to similar image data from different perspectives
Solution Approach 1:
The patent introduces a second image sensor positioned orthogonally to the first sensor to capture images from a different spatial dimension. This orthogonal arrangement allows the second sensor to detect depth information for regions that lack horizontal edges but possess vertical edges, thereby complementing the first sensor's capabilities and improving overall depth measurement accuracy across all image regions
2Adaptability or versatility
If a single image sensor with focus pixels is used for depth detection, then the device complexity is low, but the adaptability to detect various types of edges (horizontal and vertical) is limited
Solution Approach 1:
By positioning the second image sensor orthogonally to the first sensor, the system gains the ability to detect both horizontal and vertical edges through disparity measurements from different spatial dimensions. This multi-dimensional sensor arrangement enhances edge detection versatility without requiring complex processing of single-sensor data
Solution Approach 2:
The hybrid depth map processing system integrates depth information from multiple sensors with different orientations, creating a universal depth mapping solution that can handle various edge types (horizontal, vertical, and mixed) within a single processing framework, making the system adaptable to diverse imaging scenarios
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for more accurate depth detection by leveraging the orthogonal placement of the second image sensor to determine depths in regions with vertical edges, complementing the first sensor's ability to detect horizontal edges, thereby improving overall depth mapping accuracy.
Implementation Method 1
a first image sensor including a plurality of focus pixels, the focus pixels configured to capture images from at least a first perspective and a second perspective, a difference between the first and second perspectives associated with a first direction
Implementation Method 2
a second image sensor separated from the first image sensor in a second direction orthogonal to the first direction
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present disclosure relates to systems and methods for hybrid depth map processing. An example device includes a first sensor having a plurality of focus pixels configured to capture images from at least a first perspective and a second perspective, where a difference between the first and second perspectives is associated with a first direction. The device further includes a second image sensor separated from the first image sensor in a second direction orthogonal to the first direction. The device may be configured to receive a first image from the first image sensor, the first image including first image data captured from the first perspective and second image data captured from the second perspective. The device may be further configured to receive a second image from the second image sensor, and to generate a hybrid depth map based at least in part on the first image and the second image.