Image Processing Apparatus for Layered Surface Height Measurement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques struggle to accurately acquire the height of an object's surface when it has a high light transmittance layer on a color development layer, as methods like photometric stereo are ineffective in capturing the height of such surfaces.

Innovation Solution

An image processing apparatus that captures images of an object under various geometric conditions, generating specular and diffuse reflection data to determine the height of both the color development layer and the high light transmittance layer using polarizing filters and multi-viewpoint image capturing, allowing for precise surface height acquisition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If photometric stereo method is used to estimate normal distribution, then shape acquisition is possible for general objects, but height of high light transmittance layer surface cannot be acquired

Engineering Contradiction:
Improveshape acquisition capabilityVSAvoidheight measurement accuracy for high light transmittance layer
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the reflection light into two distinct components: specular reflection light and diffuse reflection light. By separating these components through polarization filtering, the system can independently analyze each type of reflection to determine heights of different layers. The diffuse reflection light is used to measure the color development layer height, while specular reflection light is used to measure the high light transmittance layer height, thus resolving the measurement problem for transparent layers.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces polarizing filters as an intermediary mechanism to separate specular and diffuse reflection light. The polarizing filter acts as a mediator that selectively transmits or blocks specific polarization components of reflected light, enabling the system to isolate and measure each reflection type independently. This intermediary device solves the fundamental problem of measuring transparent layer heights that were previously inaccessible to conventional photometric stereo methods.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If conventional image processing methods are used, then processing is simple, but measurement precision for layered objects with high light transmittance is insufficient

Engineering Contradiction:
Improveprocessing method simplicityVSAvoidsurface height measurement accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent adds the polarization dimension to the traditional imaging approach. By capturing images with different polarization states (specular and diffuse reflection components), the system transforms a two-dimensional height measurement problem into a three-dimensional analysis that includes polarization information. This additional dimension enables precise measurement of transparent layer heights without significantly complicating the overall processing framework.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate determination of the surface height of objects with high light transmittance layers on color development layers by distinguishing between specular and diffuse reflection characteristics, overcoming the limitations of previous methods.

Implementation Method 1

a generation unit configured to generate, based on the plurality of pieces of image data, specular reflection data representing a reflection characteristic of light which is part of light emitted from the light source and specularly reflected as specular reflection light from the object and to generate diffuse reflection data representing a reflection characteristic of light which is part of the light emitted from the light source and diffuse-reflected as diffuse reflection light from the object

Methodology Applied
Scientific EffectPolarization: Polarisation

Data Source

PatentUS10863082B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2020.12.08 CANON KK
  • US10863082B2 patent drawing
  • US10863082B2 patent drawing
  • US10863082B2 patent drawing

AI summary

An image processing apparatus is capable of determining a height of a surface of an object having a structure including a high light transmittance layer located on a color development layer. The image processing apparatus includes an acquisition unit configured to acquire a plurality of pieces of image data and parameters associated with imaging, a generation unit configured to generate specular reflection data and a diffuse reflection data based on the plurality of pieces of image data, a first determination unit configured to determine a height of the color development layer based on the diffuse reflection data, and a second determination unit configured to determine a height of the high light transmittance layer based on the parameters, the specular reflection data, and the height of the color development layer.