Image Capture Device with Microlens Array for Selectable Parallax

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image capturing devices are unable to generate any desired number of images with parallax using a single photographic optical system.

Innovation Solution

An image capture device with a microlens array and image capture elements that extract region image signals from different partial regions of the pupil surface, generating multiple sets of viewpoint image data corresponding to different viewpoint positions, allowing for selection of the number of viewpoints, parallax, and depth of field, and displaying these as a three-dimensional image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a single photographic optical system is used, then device complexity is reduced, but the ability to generate multiple viewpoint images with different parallax is limited

Engineering Contradiction:
Improveability to generate multiple viewpoint imagesVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The pupil surface of the photographic optical system is divided into multiple partial regions, and image signals are extracted from different regions to generate multiple viewpoint images with different parallax. This segmentation approach allows a single optical system to produce multiple viewpoint images by processing different spatial regions of the pupil surface.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The invention utilizes the spatial dimension of the pupil surface by arranging microlenses in a two-dimensional configuration and extracting image signals from different spatial positions on the pupil surface. This dimensional approach enables generation of multiple viewpoint images without adding multiple optical systems.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple image capture optical systems are used to create parallax, then multiple viewpoint images can be generated, but device complexity and size increase

Engineering Contradiction:
Improvemultiple viewpoint image generationVSAvoiddevice size
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

Multiple viewpoint image capture functions are merged into a single photographic optical system by utilizing the pupil surface as a spatial resource. Different partial regions of the pupil surface are used to capture light fluxes that correspond to different viewpoint positions, eliminating the need for multiple separate optical systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

A single photographic optical system is designed to perform multiple functions: capturing images for different viewpoint positions by utilizing different regions of the pupil surface. The same optical system serves as a multi-functional device that can generate multiple viewpoint images with different parallax values.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If region image signals are extracted from different partial regions of the pupil surface, then multiple viewpoint images with different parallax can be generated, but image signal processing complexity increases

Engineering Contradiction:
Improveparallax controlVSAvoidsignal processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The microlens array is pre-arranged in a two-dimensional configuration that corresponds to the pupil surface regions. This preliminary arrangement of microlenses and photoelectric conversion elements enables direct extraction of region image signals without requiring complex real-time processing or additional optical components.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Multiple viewpoint images are generated by copying and processing region image signals from different partial regions of the pupil surface. The generation unit extracts and processes these signals to create multiple sets of viewpoint image data, effectively copying the imaging function across different spatial regions.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of multiple viewpoint images with selected parallax and depth, enhancing convenience by allowing three-dimensional image capture with a single camera, maintaining eye comfort by aligning convergence and focus points, and simplifying the process of obtaining desired depth and parallax.

Implementation Method 1

a plurality of microlenses 120 arranged in a two dimensional configuration in a vicinity of a focal plane of a photographic optical system... each pixel array 130 having a plurality of image capture pixels 131 arranged in a two dimensional configuration corresponding to the plurality of microlenses 120 respectively, wherein the image capture pixels 131 receive light fluxes from a photographic subject via the microlenses 120

Methodology Applied
Scientific EffectLight focusing: Lens

Implementation Method 2

each pixel array 130 having a plurality of image capture pixels 131 arranged in a two dimensional configuration corresponding to the plurality of microlenses 120 respectively, wherein the image capture pixels 131 receive light fluxes from a photographic subject via the microlenses 120 and output image signals

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS9341935B2Image capturing device
Publication Date: 2016.05.17 NIKON CORP
  • US9341935B2 patent drawing
  • US9341935B2 patent drawing
  • US9341935B2 patent drawing

AI summary

An image capture device includes: a plurality of microlenses; an image capture element in which a plurality of element groups including a plurality of photoelectric conversion elements that receive light fluxes and that output image signals are arranged; a generation unit that extracts a plurality of region image signals respectively corresponding to a plurality of different partial regions upon the pupil surface of the photographic optical system, and that generates a plurality of sets of image data corresponding to the partial regions as a plurality of sets of viewpoint image data whose viewpoint positions are different with each other; and a reception unit that receives a viewpoint number selection operation to select a number of viewpoints; wherein the generation unit generates the sets of viewpoint image data by extracting the region image signals whose number is equal to a number of selected viewpoints.