Stereo Camera Depth Extraction for Out-Focus Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital Still Cameras (DSC) and phone cameras struggle to effectively implement the out-focus effect due to their short focal lengths and large f-numbers, resulting in a significantly reduced out-focus effect compared to Digital Single-Lens Reflex (DSLR) cameras.
Innovation Solution
A stereo camera system with two lenses and image sensors captures images of the same scene, extracts depth information using stereo matching methods, and applies this information to perform out-focus effects by adjusting and blurring regions based on depth maps, even with images of different resolutions or optical zoom magnifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a DSLR camera is used with long focal length and small f-number, then the out-focus effect is enhanced, but the device complexity and cost increase
Solution Approach 1:
The patent divides the single lens system into multiple lens units (first lens unit with positive power and second lens unit with negative power) that work together to achieve the desired optical effect. This segmentation allows the system to simulate DSLR-like out-focus effects while maintaining a compact structure suitable for DSC cameras.
Solution Approach 2:
The patent changes the optical parameters of the lens system by using a combination of positive and negative power lens units, which modifies the effective focal length and f-number characteristics to enhance the out-focus effect without requiring a full DSLR configuration.
2Manufacturing precision
If the focal length is made long and f-number is made small to enhance out-focus effect, then the out-focus effect becomes pronounced, but the device size and complexity increase
Solution Approach 1:
By segmenting the lens into multiple units with different optical powers, the system achieves extended effective focal length and improved out-focus effect while keeping each individual lens unit compact, thus maintaining a small overall camera size.
Solution Approach 2:
The patent employs a nested configuration where the second lens unit (negative power) is positioned to work in conjunction with the first lens unit (positive power), creating a compact integrated structure that achieves long focal length effects without proportionally increasing camera size.
3Manufacturing precision
If depth information extraction and out-focus processing are added to DSC cameras, then the out-focus effect is improved, but the processing complexity and computational requirements increase
Solution Approach 1:
The patent performs depth information extraction and out-focus processing as preliminary steps during the image capture and initial processing phase, rather than as post-processing operations. This approach integrates the complex processing into the existing camera workflow, reducing overall computational burden.
Solution Approach 2:
The camera system performs its own depth mapping and out-focus processing using integrated image processors, making the system self-sufficient for these computationally intensive tasks without requiring external processing equipment, thereby managing complexity within the camera itself.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances the out-focus effect in DSC and phone cameras by accurately extracting depth information and applying it to achieve a more pronounced blur, similar to DSLR cameras, thereby improving image quality.
Implementation Method 1
a first lens, a second lens, a first image sensor configured to acquire a first image through the first lens, a second image sensor configured to acquire a second image of a same scene through the second lens
Data Source
AI summary
An example camera and a method for extracting depth information by the camera having a first lens and a second lens are provided. The method includes photographing, by the first lens, a first image; photographing, by the second lens, a second image of a same scene; down-sampling the first image to a resolution of the second image if the first image is an image having a higher resolution than a resolution of the second image; correcting the down-sampled first image to match the down-sampled first image to the second image; and extracting the depth information from the corrected down-sampled first image and the second image.