Smartphone Imaging System Depth Map Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Smartphone cameras struggle to simulate the depth and bokeh effects of full-frame cameras due to smaller image sensors and limited depth information, resulting in uniform blurring and poor segmentation between foreground and background.
Innovation Solution
A method using a mobile electronic device with a first electronic sensor and a second electronic sensor, such as a TOF sensor, to obtain and combine image and depth information, determining disparities between images to generate enhanced depth and disparity information, which is then used to create a final digital image with accurate depth maps and bokeh effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a full-frame camera and lens are incorporated into a smartphone, then depth information and bokeh effects are improved, but device size and complexity increase
Solution Approach 1:
The patent combines multiple image sensors and depth sensors into an integrated camera module, merging their functions to achieve full-frame depth information capabilities within a compact smartphone form factor. The system fuses data from multiple sensors to simulate full-frame bokeh effects without requiring a physically larger camera system.
Solution Approach 2:
The patent uses computational photography to create synthetic depth maps that replicate the optical characteristics of full-frame cameras. By processing images from smaller sensors through algorithms that simulate depth perception, the system copies the visual effects of full-frame photography without the physical constraints.
2Measurement precision
If multiple images are processed to determine disparities, then depth information accuracy is improved, but processing time increases
Solution Approach 1:
The patent performs preliminary processing by capturing multiple images in rapid succession and pre-processing them for disparity analysis. Depth maps are generated in advance and stored for later use, reducing processing time during actual photography or video recording operations.
Solution Approach 2:
The system processes only critical regions of images for disparity determination, applying partial processing to areas with significant depth variations while using simplified methods for uniform areas. This selective approach maintains depth accuracy where needed while reducing overall processing time.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for the simulation of full-frame camera effects, providing accurate depth information and improved image quality with enhanced bokeh effects, overcoming the limitations of smartphone cameras by generating images with precise depth and focus adjustments.
Implementation Method 1
obtain, via a first electronic sensor, a plurality of images of a target within a time period
Implementation Method 2
depth information from a second electronic sensor
Data Source
AI summary
In exemplary illustrative embodiments, a method of generating a digital image and/or modified depth information may include obtaining, via a first electronic sensor, a plurality of images of a target within a time period; selecting one or more pixels in a first image of the plurality of images; identifying corresponding pixels, that correspond to the one or more selected pixels, in one or more other images of the plurality of images, the one or more selected pixels and the corresponding pixels defining sets of reference pixels; identifying two or more images of the plurality of images having respective sets of reference pixels with optimal disparity; generating modified depth information; and/or generating a final digital image via the plurality of images and the modified depth information.