Imaging Apparatus Pupil Segmentation for Shape Measurement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging techniques require complex optical systems and struggle with aberration and occlusion issues when obtaining precise shape information, such as distance and surface normal information, due to the use of multiple optical systems and difficulties in matching parallax images.

Innovation Solution

An imaging apparatus that uses a single optical system to obtain parallax images by guiding light flux through different areas of the pupil to different pixels, combining photometric stereo methods with parallax image processing to calculate precise shape information, including surface normal and distance information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple optical systems are used to obtain parallax images, then shape information can be obtained, but the apparatus becomes complex and the size increases

Engineering Contradiction:
Improveshape informationVSAvoidapparatus structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The single optical system's pupil is divided into multiple regions, with each region directing light to different pixels on the imaging element. This segmentation allows multiple parallax images to be obtained from a single optical system, resolving the contradiction between measurement precision and device complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A single optical system performs multiple functions by directing light through different pupil regions to different pixels, enabling it to capture multiple parallax images simultaneously. This multi-functionality eliminates the need for multiple separate optical systems while maintaining shape information measurement capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple optical systems are used to obtain parallax images, then shape information can be obtained, but aberration and occlusion make matching difficult

Engineering Contradiction:
Improveshape informationVSAvoidimage matching
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

By segmenting the pupil into regions and directing each to different pixels within a single optical system, the invention avoids the aberration and occlusion problems inherent in multiple optical systems. All pixels share the same optical path, ensuring consistent image quality and reliable matching.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The single optical system creates multiple virtual copies of the imaging process by directing light from different pupil regions to different pixels. These copies share the same optical characteristics, eliminating the need for complex calibration and matching between independent optical systems.

Inventive Principle:
Principle #26Copying

3Measurement precision

If multiple optical systems are used to obtain parallax images, then shape information can be obtained, but calibration of each optical system is required

Engineering Contradiction:
Improveshape informationVSAvoidcalibration process
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The single optical system serves multiple functions by capturing multiple parallax images through pupil region segmentation. Since all images originate from the same optical system, calibration is performed once for the entire system rather than requiring separate calibration for each optical system, greatly simplifying the manufacturing and setup process.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach simplifies the imaging apparatus structure, reduces the impact of optical aberrations, and enables precise calculation of shape information with improved resolution and accuracy, particularly along object edges and boundaries.

Implementation Method 1

an imaging element that obtains a plurality of parallax images by receiving a plurality of light flux that passes through different areas of a pupil of an optical system by different pixels

Methodology Applied
Scientific EffectLight flux propagation through optical system: Light

Implementation Method 2

a first obtaining unit that obtains first shape information of an object based on a plurality of photometric stereo images that are shot by using the imaging element in light source conditions that include at least three different light source conditions

Methodology Applied
Scientific EffectPhotometric stereo effect: Reflection

Data Source

PatentUS11159778B2Imaging apparatus, method of processing image, and storage medium
Publication Date: 2021.10.26 CANON KK
  • US11159778B2 patent drawing
  • US11159778B2 patent drawing
  • US11159778B2 patent drawing

AI summary

An apparatus includes an imaging element for obtaining a plurality of parallax images by receiving a plurality of light flux that passes through different areas of a pupil of an optical system by different pixels, and a processor for performing image processing on an image that is obtained by using the imaging element. The processor includes a first obtaining unit that obtains first shape information based on a plurality of photometric stereo images that are shot by using the imaging element in light source conditions that include at least three different light source conditions, a second obtaining unit that obtains second shape information by using the plurality of parallax images, and a third obtaining unit that obtains third shape information by using the first shape information and the second shape information.