Depth Sensor Selection for Electronic Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The stereo scheme using multiple cameras faces performance degradation in low illumination or outdoor environments, while the Time of Flight (TOF) scheme struggles with subjects having a large amount of black color or being at a short distance, leading to increased power consumption and system complexity when both methods are used together.
Innovation Solution
An electronic device that automatically selects between a stereoscopic camera scheme and a TOF scheme for depth information generation based on characteristics like color temperature and texture pattern information, using a first camera and a depth sensor to determine the optimal method for acquiring depth information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the stereo scheme using two or more cameras is used to acquire depth information, then depth information can be obtained through image analysis, but sensing performance degrades in low illumination environments or outdoor environments
Solution Approach 1:
The electronic device integrates both stereo camera system and TOF depth sensor, enabling the system to perform depth measurement using either method depending on environmental conditions. The processor automatically selects the appropriate depth acquisition method based on scene analysis, making the system universally applicable across different lighting conditions and environments.
2Measurement precision
If the TOF scheme is used to acquire depth information, then depth information can be obtained through light time of flight measurement, but sensing performance degrades when the subject has a large amount of black color or when a nearby user is using a depth sensor
Solution Approach 1:
The processor analyzes characteristics of images captured by the camera system and uses this feedback to determine whether TOF-based depth sensing is appropriate. When black subjects or nearby users are detected through image analysis, the system automatically switches to stereo-based depth estimation, preventing the performance degradation that would occur with TOF sensing alone.
3Reliability
If both stereo scheme and TOF scheme are used together to ensure depth information quality, then depth information can be acquired under various conditions, but power consumption increases and system complexity increases
Solution Approach 1:
The system dynamically adjusts the depth sensing method based on real-time environmental assessment. The processor continuously evaluates scene characteristics and switches between stereo and TOF modes as needed, rather than operating both systems simultaneously at full capacity. This dynamic adaptation maintains depth information quality while reducing overall system complexity and power consumption.
4Reliability
If both stereo scheme and TOF scheme are used together to ensure depth information quality, then depth information can be acquired under various conditions, but power consumption increases
Solution Approach 1:
The system performs periodic environmental assessment using the camera system and switches between depth sensing methods based on detected conditions. Rather than continuously operating both stereo and TOF systems, the processor periodically evaluates whether TOF sensing is appropriate and switches methods as needed, reducing power consumption while maintaining reliable depth information across various conditions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces power consumption and provides high-quality depth information without excessive load on the device, improving performance in various environmental conditions.
Implementation Method 1
a depth sensor to measure a depth of the external object
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
In embodiments, an electronic device may include a first camera, a second camera, and a depth sensor, all of which are disposed on one surface of the electronic device. Also, the electronic device may include a processor configured to acquire one or more first images of an external object by using the first camera, to determine whether a predetermined condition associated with at least one of color information or texture pattern information of the external object identified from the acquired one or more first images is satisfied, when the predetermined condition is satisfied, to acquire one or more second images of the external object by using the first camera, acquire one or more third images of the external object corresponding to the one or more second images by using the second camera, and generate depth information corresponding to the external object based on a comparison between the one or more second images and the one or more third images, and when the predetermined condition is not satisfied, to measure a depth of the external object by using the depth sensor, and generate the depth information corresponding to the external object based on the measured depth. Other embodiments are possible.