Dual Sensor Camera Synchronization for Real-Time Depth Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current electronic apparatuses with camera functions cannot simultaneously obtain high-resolution images and depth information without a time difference, as they require separate imaging sensors for each, leading to delayed image processing and inability to provide real-time image effects.
Innovation Solution
Incorporating both a depth sensor and an image sensor to obtain meta information and images simultaneously, allowing for real-time processing and application of image effects by displaying a preview screen and storing the image and depth information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If one imaging sensor is used to obtain both meta information and images, then device complexity is reduced, but the obtaining time of meta information and images cannot be synchronized
Solution Approach 1:
The imaging system is segmented into two separate sensors: a first imaging sensor dedicated to capturing meta information (depth map) and a second imaging sensor dedicated to capturing high-resolution images. This segmentation allows each sensor to operate independently and simultaneously, eliminating the time difference between obtaining meta information and images while maintaining manageable device complexity through specialized functional division.
2Manufacturing precision
If high resolution image is obtained using optics with high MTF, then image quality is improved, but Depth Of Field increases and lens movement time increases
Solution Approach 1:
The system captures a preliminary depth map using the first imaging sensor before the main image capture. This depth map serves as a copy of the depth information that would otherwise require lens movement to obtain. By having this depth information available in advance, the system eliminates the need for time-consuming lens movements during main image capture, thus maintaining high image resolution without the time penalty.
3Measurement precision
If meta information and image are obtained at different times, then each can be obtained with optimal settings, but real-time image effects cannot be provided
Solution Approach 1:
The system merges the outputs of two separate imaging sensors: the depth map from the first sensor and the high-resolution image from the second sensor. By combining these simultaneously captured data streams, the system enables real-time image effect processing while maintaining optimal quality for both meta information and images. The control unit processes both inputs together to generate real-time effects such as depth-based filtering and focus adjustments.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Various exemplary embodiments related to an electronic apparatus and a method for taking a photograph in the electronic apparatus are disclosed, and according to an exemplary embodiment, the electronic apparatus may include a display that displays a screen; a depth sensor that outputs a first image signal and depth information; an image sensor that outputs a second image signal; and a control unit that controls to display a preview screen on the display using the first image signal, obtain both depth information of a photographing moment and an image of the photographing moment using the second image signal in response to a request of photographing, and store the image and the depth information. Also, other various exemplary embodiments may be possible.