Dual Camera Imaging System for Real-Time Depth-Aware Image Effects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic devices with camera functions face challenges in simultaneously obtaining high-resolution images and meta information, such as depth information, without a time delay, due to the limitations of a single imaging module, which hinders real-time application of image effects.

Innovation Solution

The use of dual cameras, where one camera provides phase difference information and the other disparity information, allows for the simultaneous acquisition of meta data, enabling real-time application of image effects to images by determining focus areas based on these data types.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single imaging module is used to obtain both high-resolution images and meta information, then device complexity is reduced, but time delay occurs between obtaining meta information and the actual image

Engineering Contradiction:
Improveimaging module structureVSAvoidtime delay between meta information and image
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The imaging system is segmented into two separate modules: a first imaging module dedicated to capturing high-resolution images and a second imaging module dedicated to capturing meta information. This segmentation eliminates the time delay problem by allowing both modules to operate simultaneously and independently, while the processor integrates data from both modules to generate the final output.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If a single imaging module obtains high-resolution images and meta information simultaneously, then device complexity is reduced, but measurement precision of depth information deteriorates

Engineering Contradiction:
Improveimaging module structureVSAvoiddepth information accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system segments the imaging functions into specialized modules where the second imaging module is dedicated solely to capturing meta information with high precision. This specialized dedication allows the second module to optimize its optical characteristics for precise depth measurement without the compromises required when sharing the module with high-resolution image capture.

Inventive Principle:
Principle #1Segmentation

3Loss of time

If dual cameras are used to simultaneously obtain images and meta information, then time delay is eliminated, but device complexity increases

Engineering Contradiction:
Improvetime delay between meta information and imageVSAvoidcamera system structure
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent merges the functionality of dual cameras into a coordinated system where a processor integrates data from both the first imaging module (for high-resolution images) and the second imaging module (for meta information). This merging approach eliminates time delay by processing data simultaneously while managing the complexity through integrated control and processing rather than separate independent systems.

Inventive Principle:
Principle #5Merging (Combining)

4Stability of the object's composition

If lens is moved to increase depth of field, then depth of field increases, but time required for image capture increases

Engineering Contradiction:
Improvedepth of fieldVSAvoidtime for lens movement
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The system segments the depth control function from the image capture function. The first imaging module captures high-resolution images with a fixed lens position optimized for speed, while the second imaging module captures meta information including depth data independently. This segmentation eliminates the need to move the lens during image capture, thereby eliminating the time delay while still achieving extended depth of field through computational methods.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11604574B2Electronic device and method for electronic device displaying image
Publication Date: 2023.03.14 SAMSUNG ELECTRONICS CO LTD
  • US11604574B2 patent drawing
  • US11604574B2 patent drawing
  • US11604574B2 patent drawing

AI summary

According to various embodiments, an electronic device may comprise: a first camera arranged on a first surface of a housing of the electronic device; a second camera arranged apart from the first camera on the first surface; a display; and a processor set to process at least a portion of a first inputted image by applying a first image effect and display same on the display, on the basis of a first object area for the first inputted image obtained by using phase difference information of the first inputted image from among the first inputted image obtained from the first camera or a second inputted image obtained from the second camera, and to process at least a portion of the first inputted image by applying a second image effect and displaying same on the display, on the basis of a second object area for the first inputted image obtained by using time difference information between the first inputted image and the second inputted image.