Depth Sensing Using Epipolar Line Candidate Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional depth sensing techniques require significant computational resources, making them inefficient for determining depth from images, especially in scenarios with complex scene content and noise, and misalignment issues between cameras.
Innovation Solution
The method employs an epipolar line derived from a detected dot in an infrared image to reduce the search space, improving the efficiency of stereoscopic matching and reducing computational resources by selecting candidate images based on this line for depth determination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional depth sensing techniques are used, then depth can be determined from images, but significant computational resources are required
Solution Approach 1:
The patent divides the image processing task into segments by processing only a portion of the image rather than the entire image. The epipolar line is used to identify a specific region of interest, and depth sensing is performed only on this segmented portion, significantly reducing computational resources while maintaining accuracy for the target area.
Solution Approach 2:
The patent extracts only the necessary information by using the epipolar line to isolate the critical region where depth determination is needed. Instead of processing the complete image, the system extracts and processes only the portion along the epipolar line that contains the relevant depth information, thereby reducing computational burden.
2Reliability
If conventional depth sensing techniques are used, then depth can be determined, but the process is inefficient for complex scene content and noise
Solution Approach 1:
The patent applies local quality by focusing the depth sensing algorithm on a specific local region defined by the epipolar line. This localized approach allows the system to handle complex scene content and noise more effectively by concentrating computational effort where it is most needed, rather than uniformly processing the entire image.
3Measurement precision
If conventional depth sensing techniques are used, then depth can be determined, but misalignment issues between cameras reduce effectiveness
Solution Approach 1:
The epipolar line serves as an intermediary element that mediates between the two camera views. By using the epipolar line as a reference framework, the system can accommodate misalignment issues between cameras and still accurately determine depth, as the epipolar geometry provides a robust framework that is less sensitive to precise camera calibration and alignment.
Data Source
AI summary
A method for depth sensing from an image of a projected pattern is performed at an electronic device with one or more processors and memory. The method includes receiving an image of a projection of an illumination pattern; for a portion of the image, selecting a candidate image of a plurality of candidate images by comparing the portion of the image with a plurality of candidate images; and determining a depth for the portion of the image based on depth information associated with the selected candidate image. Related electronic devices and computer readable storage medium are also disclosed.