Dual-Camera 3D Photography With Wider View and Better Depth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for converting 2D images to 3D images face challenges such as complex operations, small field of view, and poor depth accuracy, particularly in mobile phone photography, limiting user experience.
Innovation Solution
A method using a mobile phone with dual cameras (primary and wide-angle) and neural networks to estimate depths, construct a fused 3D point cloud, and perform 3D viewing angle conversion, enhancing depth accuracy and field of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a single 2D image is used for 3D conversion, then the operation is simple, but the field of view is small and the effect is poor
Solution Approach 1:
The patent combines multiple images (first image from primary camera and second image from wide-angle camera) to create a fused 3D point cloud, merging the advantages of different camera types to achieve both operational simplicity and expanded field of view in the converted 3D image
2Ease of operation
If conventional 3D conversion methods are used, then the process is straightforward, but depth accuracy is poor
Solution Approach 1:
The patent applies different processing approaches to different parts of the image data - using the primary camera image for high-accuracy depth estimation in central regions and the wide-angle camera image for peripheral regions, thereby achieving improved depth accuracy while maintaining operational simplicity
Solution Approach 2:
The patent creates a composite 3D point cloud by fusing data from two different camera systems with different characteristics, combining the high-resolution depth information from the primary camera with the wide-field information from the wide-angle camera to achieve superior overall depth accuracy
3Area of stationary object
If multiple cameras are used for 3D conversion, then the field of view increases, but the device complexity increases
Solution Approach 1:
The patent makes the additional wide-angle camera serve multiple functions - it not only expands the field of view for 3D conversion but also provides supplementary depth information and enhances the overall robustness of the depth estimation process, thereby justifying the added device complexity
Data Source
Figure 1
Figure 2
Figure 3
AI summary
This application discloses a photographing method, applied to an electronic device, including: receiving a photographing instruction of a user, shooting a primary camera image by using a primary camera, and shooting a wide-angle image by using a wide-angle camera; and generating a three-dimensional image based on the primary camera image and the wide-angle image, where the three-dimensional image includes a plurality of frames of images that are converted from a three-dimensional viewing angle and correspond to different viewing angles. According to the photographing method of the three-dimensional image provided in this application, the three-dimensional image may be shot and generated based on a single operation of the user, and the operation thereof is simple. In addition, the wide-angle image can increase a conversion range of a viewing angle of the primary camera image, and the obtained three-dimensional image has a larger field of view and a better effect, thereby improving user experience in photographing. This application further discloses an image processing method and an electronic device.