Dual Imaging Sensor Vignetting Correction via Pixel Sensitivity

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional imaging techniques using multiple cameras can only utilize one camera unit for zooming, limiting image quality and resolution, especially in electronic zoom applications where a single camera's performance is compromised for increased magnification.

Innovation Solution

An imaging apparatus utilizing two or more imaging units, where one unit captures images on the wide-angle side and another on the telephoto side, with high-sensitive pixel groups and Bayer arrangements, allows concurrent use of both units to enhance image quality by combining their outputs and adjusting blend ratios based on image height and shading characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If electronic zoom is used to increase imaging magnification, then imaging magnification is improved, but image quality deteriorates

Engineering Contradiction:

Improveimaging magnificationVSAvoidimage quality

Core Design Contradiction:

SpeedVSMeasurement precision

Solution Approach 1:

The imaging device is divided into multiple imaging units with different characteristics (wide-angle unit and telephoto unit). Each unit is optimized for specific imaging conditions, allowing the system to segment the imaging task and select or combine results based on the desired magnification and quality requirements.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent merges images from multiple imaging units through image synthesis. By combining the wide-angle image and telephoto image with appropriate weighting, the system achieves high magnification while maintaining image quality that would be unattainable with a single unit or simple electronic zoom.

Inventive Principle:

Principle #5Merging (Combining)

2Measurement precision

If multiple imaging units are used to increase image quality, then image quality is improved, but device complexity increases

Engineering Contradiction:

Improveimage qualityVSAvoidnumber of imaging units

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

Each imaging unit is designed to serve multiple functions. The wide-angle unit can capture both wide scenes and, when combined with the telephoto unit, contribute to high-magnification imaging. The telephoto unit similarly serves both as a standalone high-magnification unit and as a component in synthesized images, reducing the need for dedicated specialized components.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system changes operational parameters (which imaging unit is active, or how images are synthesized) based on imaging conditions. By adjusting the weighting coefficients in image synthesis or selecting different active units, the system optimizes image quality for different scenarios without requiring physical reconfiguration, thereby managing complexity.

Inventive Principle:

Principle #35Parameter changes

3Device complexity

If a single imaging unit is used for zooming, then device complexity is reduced, but image quality in peripheral regions deteriorates due to shading

Engineering Contradiction:

Improvenumber of camerasVSAvoidimage quality in peripheral regions

Core Design Contradiction:

Device complexityVSMeasurement precision

Solution Approach 1:

Different regions of the image are handled differently through the synthesis process. The system applies local quality adjustment by combining images with spatially varying weights, where central regions may rely more on one unit and peripheral regions on another, optimizing quality across the entire image area rather than applying a uniform approach.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The patent converts the harmful shading effect into a beneficial characteristic. By capturing images with multiple units that have different shading profiles and synthesizing them with appropriate compensation, the system transforms the limitation of individual units into an advantage where the combined output has reduced or eliminated shading artifacts.

Inventive Principle:

Principle #22Blessing in disguise (Convert harm into benefit)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach effectively increases image quality by combining the strengths of both imaging units, reducing shading effects and maintaining high resolution across different zoom levels, thereby improving the overall captured image quality.

Implementation Method 1

imaging element 113... imaging element 123

Methodology Applied

Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP3649772B1Imaging apparatus with second imaging element used for correcting vignetting in images captured by first imaging element

Publication Date: 2024.02.21 SONY SEMICON SOLUTIONS CORP

Figure 1A
Figure 1B
Figure 2~3

AI summary

There is provided an imaging apparatus including a first imaging element and a second imaging element configured to perform imaging in the same direction.The second imaging element is different in pixel arrangement between a central part and a non-central part, such that the pixels in the non-central part are more sensitive than the pixels in the central part. Image signals from the non-central part of the second imaging element are used to correct for shading (vignetting) in image signals from the first imaging element.