TOF and Multi-Camera Fusion for Low-Light 3D Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional electronic devices, such as smartphones and tablets, typically capture two-dimensional images with a single camera, resulting in suboptimal photographing effects, which negatively impacts user experience, especially in low-light environments.
Innovation Solution
An electronic device equipped with a time-of-flight (TOF) module, a color camera, and a monochrome camera, where the processor constructs a three-dimensional image by combining depth, color, and monochrome images based on ambient light conditions, and adjusts camera operations to optimize image quality and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a single camera is used to capture images, then the device structure is simple, but the image quality and three-dimensional information are insufficient
Solution Approach 1:
The patent combines multiple cameras (color camera and monochrome camera) and a TOF module into an integrated imaging system. The color camera captures color information, the monochrome camera captures high-sensitivity luminance information, and the TOF module captures depth information. By merging these components and fusing their data, the system achieves superior image quality and three-dimensional reconstruction capability while managing device complexity through integrated design.
2Manufacturing precision
If multiple cameras are used to improve image quality, then the photographing effect is enhanced, but the power consumption increases
Solution Approach 1:
The patent implements dynamic camera selection based on ambient light conditions. The processor determines whether to activate the color camera, monochrome camera, or both, depending on the lighting environment. In low-light conditions, the monochrome camera is activated for its higher sensitivity, while in adequate light, only the color camera may be used. This dynamic approach optimizes power consumption by activating only the necessary cameras for each shooting scenario while maintaining image quality.
Solution Approach 2:
The system changes operational parameters by adjusting which cameras are active based on ambient light thresholds. The processor monitors light conditions and switches between different camera configurations (color only, monochrome only, or both), effectively changing the system's energy consumption profile to match environmental conditions while preserving image quality.
3Illumination intensity
If ambient light is sufficient, then color camera can capture good quality images, but in low light the image quality deteriorates
Solution Approach 1:
The monochrome camera acts as an intermediary solution for low-light conditions. Since monochrome sensors lack color filters, they have higher quantum efficiency and capture more light in dim environments. The system uses the monochrome camera as a mediator to bridge the gap when ambient light is insufficient for the color camera to produce quality images. The processor fuses the monochrome image data with available color data or processes it separately to maintain image quality across varying light conditions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances image quality in low-light environments, reduces power consumption, and improves user experience by capturing high-quality three-dimensional and fused images efficiently.
Implementation Method 1
The electronic device includes a time-of-flight (TOF) module configured to capture a depth image of a subject
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An electronic device (100) and a method for controlling the electronic device (100) are provided. The electronic device (100) includes a time-of-flight (TOF) module 20, a color camera 30, a monochrome camera (40), and a processor (10). The TOF module (20) is configured to capture a depth image of a subject. The color camera (30) is configured to capture a color image of the subject. The monochrome camera (40) is configured to capture a monochrome image of the subject. The processor (10) is configured to obtain a current brightness of ambient light in real time, and to construct a three-dimensional image of the subject according to the depth image, the color image, and the monochrome image when the current brightness is less than a first threshold.