Image Pickup Apparatus with Adjustable Lens-Sensor Distance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Light field cameras face a trade-off between image resolution and parallax detection ability due to the size of micro lenses, where increasing micro lens size decreases image resolution and decreasing size increases the number of viewpoints but decreases resolution.

Innovation Solution

An image pickup apparatus with a main lens, micro lens array, and controller that adjusts the distance between the main lens and image sensor to obtain multiple images with different depths of field, allowing for depth map generation and selective focusing on objects, thereby improving image resolution without decreasing the number of viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the size of micro lens is increased to increase the number of images having different viewpoints, then the parallax detection ability is improved, but the resolution of image decreases

Engineering Contradiction:
Improvenumber of viewpointsVSAvoidimage resolution
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by making the focal distance adjustable rather than fixed. The controller changes the focal distance based on the depth information obtained from parallax detection, allowing the system to dynamically optimize both the number of viewpoints and image resolution for different depth planes.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the focal distance parameter dynamically. By obtaining depth information from parallax detection and then adjusting the focal distance accordingly, the system optimizes image resolution for the selected depth plane while maintaining the ability to capture multiple viewpoints.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the size of micro lens is decreased to increase the resolution of image, then the image resolution is improved, but the number of simultaneously obtained images having different viewpoints decreases

Engineering Contradiction:
Improveimage resolutionVSAvoidnumber of viewpoints
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system dynamically adjusts the focal distance after capturing light field data with fixed micro lens sizes. This post-capture focusing capability allows the system to maintain high resolution while providing access to multiple viewpoints through computational refocusing.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent performs preliminary action by capturing comprehensive light field data including parallax information from multiple viewpoints first, then subsequently adjusts the focal distance to optimize resolution for the desired depth plane. This preliminary capture of multiple viewpoints enables later selective focusing.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If the distance between main lens and image sensor is changed to focus on different depths, then the depth of field is adjusted, but the time required to obtain clear images of objects at different distances increases

Engineering Contradiction:
Improvefocus accuracyVSAvoidtime to obtain clear image
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by capturing light field data with parallax information from multiple viewpoints in advance. This preliminary capture allows subsequent rapid refocusing at different depths without requiring physical lens movement, significantly reducing the time to obtain clear images at different distances.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates multiple virtual images corresponding to different focal distances by processing the captured light field data. Instead of physically moving the lens for each focal plane, the system generates copies of the image at different depths through computational methods, saving time.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The apparatus enhances image resolution by allowing for selective focusing and depth map generation, enabling clear images of selected objects while maintaining the number of viewpoints, thus overcoming the trade-off between resolution and parallax detection.

Implementation Method 1

a main lens configured to refract incident light

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

a micro lens array between the main lens and the image sensor and including a plurality of 2D-arranged micro lenses

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 3

an image sensor including a plurality of two-dimensional (2D)-arranged pixels configured to sense the incident light and to output an image signal according to the sensed incident light

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS10375292B2Image pickup apparatus and method for generating image having depth information
Publication Date: 2019.08.06 SAMSUNG ELECTRONICS CO LTD
  • US10375292B2 patent drawing
  • US10375292B2 patent drawing
  • US10375292B2 patent drawing

AI summary

Provided are an image pickup apparatus and method capable of improving a resolution of an image having depth information. The image pickup apparatus may include: a main lens configured to refract incident light; an image sensor comprising a plurality of two-dimensional (2D)-arranged pixels configured to output an image signal according to the incident light; a micro lens array between the main lens and the image sensor and comprising a plurality of 2D-arranged micro lenses; and a controller configured to receive the image signal from the image sensor and to generate an image according to the received image signal, wherein the controller is configured to obtain a plurality of images having different depths of field by changing a distance between the main lens and the image sensor and to obtain at least one depth map from the at least one of the obtained plurality of images.