Smartphone Image Compositing via Grid Alignment and Gradient Blending
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Smartphones with single lenses lack optical zoom capability, resulting in reduced image quality and detail, especially in low-light conditions, and existing dual-camera setups can only capture images from one camera at a time, limiting the ability to combine wide-angle and telephoto views effectively.
Innovation Solution
A method and system for compositing images from wide-angle and telephoto lenses by aligning and blending images using grid-based image alignment, point feature matching, and gradient-domain image blending to create a seamless, high-detail composite image with improved noise reduction and exposure/color balance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If images are composited from multiple lenses with different focal lengths, then image detail and view are improved, but processing time and computational resources increase
Solution Approach 1:
The patent segments the image compositing process into distinct stages: obtaining images from multiple lenses, aligning them through grid-based image alignment, blending them through gradient-domain blending, and processing them in a multi-step workflow. This segmentation allows complex image processing to be broken down into manageable computational tasks that can be optimized and executed efficiently
Solution Approach 2:
The patent performs preliminary actions by pre-aligning images through grid-based image alignment before compositing, and by pre-processing images through downsampling and blending at reduced resolutions. This preliminary processing prepares images in advance for final composition, reducing the computational burden during real-time or final processing stages
2Measurement precision
If grid-based image alignment is performed to align images from different lenses, then image alignment precision is improved, but computational complexity increases
Solution Approach 1:
The patent introduces grid-based image alignment as an intermediary process between image acquisition and final compositing. This intermediary alignment step uses grid structures to systematically map and align features from different lens images, providing a structured approach that improves precision while making the complex alignment task more manageable through systematic processing
3Reliability
If gradient-domain image blending is used to blend images, then blending quality and noise reduction are improved, but processing resources increase
Solution Approach 1:
The patent applies partial action by performing gradient-domain blending selectively on specific regions or at specific stages of the compositing process. By applying blending operations only where needed rather than uniformly across all images, the system achieves high blending quality in critical areas while reducing overall computational resource consumption
Data Source
AI summary
A method for compositing images by an electronic device is described. The method includes obtaining a first composite image that is based on a first image from a first lens with a first focal length and a second image from a second lens with a different second focal length. The method also includes downsampling the first composite image to produce a downsampled first composite image. The method further includes downsampling the first image to produce a downsampled first image. The method additionally includes producing a reduced detail blended image based on the downsampled first composite image and the downsampled first image. The method also includes producing an upsampled image based on the reduced detail blended image and the downsampled first composite image. The method further includes adding detail from the first composite image to the upsampled image to produce a second composite image.