Multi-Lens Camera Calibration via Spot Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Miniaturization of smartphone cameras with single lenses is limited by physical distance corresponding to focal length, and existing multi-lens cameras face challenges in reducing focal distance while maintaining image quality and accuracy.

Innovation Solution

A calibration method and apparatus that senses spots where collimated light passing through multiple lenses is imaged on a sensor, determining a transformation matrix to restore images by adjusting angles and analyzing pixel information, rotation, pitch, aberration, gap, and blur information of the lenses, enabling precise image restoration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of moving object

If a single lens is used in a smartphone camera, then device miniaturization is achieved, but focal length physical distance cannot be reduced

Engineering Contradiction:
Improvecamera sizeVSAvoidfocal length
Core Design Contradiction:
Volume of moving objectVSLength of moving object

Solution Approach 1:

The patent divides a single lens into multiple lenses (micro-lens array) to achieve both miniaturization and reduced focal length. Each lens in the array processes a portion of the light field, enabling the camera to maintain a compact form factor while effectively reducing the focal distance through parallel light path processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single-lens 2D imaging approach to a multi-lens 3D light field capture approach. By adding the dimension of multiple lenses arranged in an array, the system achieves both miniaturization and focal length reduction while capturing spatial information that enables image restoration.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Length of moving object

If multiple lenses are used to reduce focal distance, then focal length is reduced, but image quality and accuracy deteriorate

Engineering Contradiction:
Improvefocal lengthVSAvoidimage quality
Core Design Contradiction:
Length of moving objectVSMeasurement precision

Solution Approach 1:

The patent implements a calibration process that uses collimated light to sense spots on the sensor, determines transformation matrices, and adjusts angles to restore image quality. This feedback mechanism compensates for the deteriorating image quality caused by multiple lenses, ensuring accurate image restoration while maintaining reduced focal length.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes parameters such as the angles of collimated light incidence and transformation matrix values to optimize image quality. By adjusting these parameters during calibration and image restoration, the system compensates for the optical distortions introduced by multiple lenses, maintaining high image quality despite the reduced focal length.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If calibration is performed with multiple lenses, then image restoration accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveimage restoration accuracyVSAvoidcalibration process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent enables the system to perform self-calibration using collimated light sources that are either external or integrated into the device. The multi-lens camera captures spots from the collimated light, processes them to determine transformation matrices, and automatically adjusts angles for image restoration, reducing the need for complex external calibration equipment while maintaining high accuracy.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The method effectively reduces focal length while maintaining image quality by determining a transformation matrix based on spot sensing, allowing for precise control of light angles and lens information, resulting in improved image restoration and miniaturization of multi-lens cameras.

Implementation Method 1

sensing spots at which collimated light passing through multiple lenses is imaged on a sensor

Methodology Applied
Scientific EffectRefraction: Refraction

Data Source

PatentUS10873693B2Calibration method and apparatus
Publication Date: 2020.12.22 SAMSUNG ELECTRONICS CO LTD
  • US10873693B2 patent drawing
  • US10873693B2 patent drawing
  • US10873693B2 patent drawing

AI summary

A calibration method and apparatus are provided. The calibration method includes sensing spots at which collimated light passing through multiple lenses is imaged on a sensor and determining a transformation matrix configured to restore an image acquired using the multiple lenses based on the spots.