Image Synthesizing Part Resolving Resolution Contrast Trade-off

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-capturing devices face a challenge in maintaining high contrast and resolution when the width of a virtual pixel is narrower than the pitch of a microlens, leading to decreased image data quality.

Innovation Solution

An image-capturing device comprising a microlens array and photodetectors that synthesizes image data at an optional image plane, utilizing a Fourier transform and inverse Fourier transform with a point spread function to effectively divide and process signals, thereby enhancing image resolution and contrast.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the width of a virtual pixel is set narrower than the pitch of a microlens to increase resolution, then the resolution of synthetic image data is improved, but the contrast of synthetic image data decreases

Engineering Contradiction:
Improveresolution of synthetic image dataVSAvoidcontrast of synthetic image data
Core Design Contradiction:
Measurement precisionVSIllumination intensity

Solution Approach 1:

The patent divides the light receiving elements into multiple regions (first light receiving region and second light receiving region) corresponding to different microlenses. By segmenting the signal processing for different spatial frequencies, the system can process high-frequency components (fine details) and low-frequency components (overall intensity) separately, allowing narrow virtual pixel widths for resolution while maintaining contrast through appropriate signal combination.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter of virtual pixel width differently for different spatial frequency components. High-frequency components use narrow virtual pixel widths to achieve high resolution, while low-frequency components use wider effective widths to maintain contrast. This parameter differentiation resolves the contradiction between resolution and contrast.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If signals from overlapping photodetectors are used to increase pixel density, then the quantity of image data is improved, but the accuracy of signal attribution to specific pixels deteriorates

Engineering Contradiction:
Improvepixel density of image dataVSAvoidsignal attribution accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent segments the photodetector array into regions associated with specific microlenses. Each microlens has dedicated light receiving regions that capture light from specific angular directions. This segmentation allows the system to attribute signals to specific pixels with high accuracy while still utilizing overlapping regions to increase the effective pixel density through multi-angle light capture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The microlenses act as intermediaries between the incoming light and the photodetectors. Each microlens directs light from specific directions to specific photodetector regions, enabling accurate signal attribution. The intermediary microlens structure allows overlapping photodetector coverage while maintaining the ability to distinguish which light originated from which direction.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables the creation of image data with both high contrast and high resolution, surpassing the limitations of pixel density and microlens pitch, resulting in improved image quality.

Implementation Method 1

a plurality of microlenses arranged in a two-dimensional manner so that a light flux passing through a photographic optical system is incident thereon

Methodology Applied
Scientific EffectLight focusing: Lens

Implementation Method 2

a plurality of photodetectors arranged behind the plurality of microlenses to correspond to each of the plurality of microlenses

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10341580B2Image processing device configured to correct an image so as to decrease output data
Publication Date: 2019.07.02 NIKON CORP
  • US10341580B2 patent drawing
  • US10341580B2 patent drawing
  • US10341580B2 patent drawing

AI summary

An image-capturing device includes: a plurality of microlenses arranged in a two-dimensional manner; a plurality of photodetectors arranged to correspond to the plurality of microlenses; an image synthesizing part that synthesizes an image at an optional image plane of a photographic optical system, based on signals from the plurality of photodetectors; and an image processing part that removes signals of other pixels from signals of pixels constituting the image synthesized in the image synthesizing part.