Dual-Camera Zooming via Patch-Based Super-Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current digital zoom methods in mobile devices lead to blurring and inaccurate zoomed images due to the need for bulky and expensive optical lenses, and fail to provide high-resolution images, especially for objects at longer distances.

Innovation Solution

A method using a dual-camera system where one camera captures images without zoom and the other with a predefined optical zoom, processing these images to create a zoomed version by extracting and adding high-frequency content, allowing for better image quality and resolution without the need for expensive lenses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If digital zoom is used in mobile devices, then the device size is reduced and cost is lowered, but image quality deteriorates with blurring and inaccuracies

Engineering Contradiction:
Improvecamera system size and costVSAvoidimage resolution and quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent merges optical zoom and digital zoom functionalities into a hybrid system. The optical zoom module provides initial magnification with high quality, while the digital zoom module further processes the image through sophisticated algorithms including patch-based super-resolution and deep learning techniques. This combination allows mobile devices to achieve high-resolution zoomed images without requiring large optical lenses, thus maintaining compact device size while improving image quality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces pure mechanical/optical zoom systems with a computational approach. Instead of relying solely on physical lens movement and optical magnification, the system uses digital image processing, patch-based super-resolution algorithms, and deep learning models to achieve zoom. This substitution allows for high-resolution zooming in compact mobile devices without the size and cost constraints of traditional optical zoom systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If optical lens is used for zooming, then image quality is improved, but device size and cost increase

Engineering Contradiction:
Improveimage qualityVSAvoiddevice size and cost
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the zooming function into two distinct modules: an optical zoom module for initial magnification and a digital zoom module for further enhancement. The optical zoom module uses a fixed optical system with specific focal length, while the digital zoom module processes the captured image through computational algorithms. This segmentation allows the device to achieve high-quality zoom without requiring a single complex optical system, thus reducing overall device size and cost while maintaining image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses patch-based super-resolution techniques where small patches from the optically zoomed image are extracted, processed through deep learning models, and reconstructed to create high-resolution zoomed regions. This copying and processing approach allows the system to generate high-quality detailed regions without requiring the entire optical system to be scaled up, thus maintaining compact device size while achieving high image quality.

Inventive Principle:
Principle #26Copying

3Device complexity

If digital zoom is used, then device size is reduced, but measurement precision deteriorates due to blurring

Engineering Contradiction:
Improvedevice sizeVSAvoidzoom accuracy and detail capture
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary optical zoom to capture the target scene at a magnified scale before applying digital processing. The optical zoom module first creates a magnified image, and then the digital zoom module processes this pre-magnified image using patch-based super-resolution and deep learning techniques. This preliminary optical action provides a higher quality starting point for digital processing, ensuring that the final zoomed image maintains high measurement precision and detail accuracy even in compact devices.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional digital zoom interpolation methods with advanced computational techniques including patch-based super-resolution and deep learning models. These computational methods analyze and reconstruct image details at multiple scales, preserving fine details and avoiding the blurring associated with conventional digital zoom. This substitution maintains measurement precision while enabling compact device design.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20160323516A1Methods, Systems and Apparatuses for Dual-Camera Based Zooming
Publication Date: 2016.11.03 UURMI SYST
  • US20160323516A1 patent drawing
  • US20160323516A1 patent drawing
  • US20160323516A1 patent drawing

AI summary

A method and apparatus for zooming an image by a zoom factor wherein a first image without zoom and a second image with fixed optical zoom are processed to find a mapping between low resolution patches and high resolution patches that are then used for zooming the first image if the zoom factor is less than the fixed optical zoom else the mapping between low resolution patches and high resolution patches are used for zooming the second image with fixed optical zoom.