Dual Pixel Camera Module ROI Depth Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices face challenges in accurately estimating depth information in low-light environments due to the limitations of time of flight (TOF) sensors and general RGB-based CMOS image sensors, while dual pixel systems with a short baseline struggle to provide precise depth estimation.
Innovation Solution
An electronic device equipped with a camera module that senses objects using a dual pixel system, generates stereo image data with disparity, and processes this data to detect an object of interest, generate a crop signal to focus on a region of interest (ROI), and estimate depth information based on partial stereo image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If dual pixel system with short baseline is used, then device size is reduced, but depth estimation precision deteriorates
Solution Approach 1:
The patent extracts and processes only the region of interest (ROI) from the full image data before performing depth estimation. By isolating the ROI containing the object of interest and processing only that portion, the system achieves accurate depth estimation without requiring a larger baseline, thus maintaining compact device size while improving measurement precision for the target object.
2Measurement precision
If full image data is processed for depth estimation, then depth information accuracy is improved, but data processing time increases
Solution Approach 1:
The system extracts the region of interest (ROI) containing the object of interest from the full image data and processes only this extracted portion for depth estimation. This selective processing significantly reduces the volume of data requiring computation while maintaining depth information accuracy for the target object, thereby reducing data processing time without sacrificing measurement quality.
Solution Approach 2:
The patent segments the image data into regions of interest and non-interest areas, then applies depth estimation processing only to the segmented ROI portions. This segmentation approach divides the processing task into manageable parts, reducing overall computational load and processing time while preserving depth accuracy for the objects that matter most.
3Measurement precision
If full image data is processed for depth estimation, then depth information completeness is improved, but power consumption increases
Solution Approach 1:
The patent extracts and processes only the region of interest (ROI) containing the object of interest rather than processing the entire image data set. This selective extraction approach maintains depth information completeness for the target object while significantly reducing the computational energy required, as the processing circuit consumes less power when handling smaller data volumes.
4Productivity
If ROI-based processing is applied, then data processing speed is improved, but depth information coverage decreases
Solution Approach 1:
The system extracts the region of interest (ROI) containing the object of interest and processes this extracted data for depth estimation. This approach improves data processing speed by reducing the total data volume while maintaining depth information coverage for the target object. The extraction ensures that all necessary depth information for the object of interest is captured, even though the overall coverage area is reduced.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces the amount of data processing required for depth estimation by focusing on a region of interest, thereby improving processing speed, reducing power consumption, and maintaining high resolution, even in low-light environments.
Implementation Method 1
a dual pixel that consists of a pair of two photoelectric conversion elements sharing one micro-lens is used to offer auto focusing and obtain depth information
Data Source
AI summary
Provided is an electronic device including a camera module configured to sense an object based on a plurality of photoelectric conversion elements and generate stereo image data having a disparity based on at least two of the plurality of photoelectric conversion elements sharing a micro lens, a memory configured to store at least one instruction and the stereo image data, and a processing circuit configured to execute the at least one instruction to detect an object of interest based on the stereo image data, and generate a crop signal for instructing the camera module to sense a region of interest including the object of interest; and generate depth information based on the stereo image data.