Polarization Image Processing for Arbitrary Illumination Direction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D computer graphic techniques require complex data acquisition and calculation to change illumination conditions, increasing user burden and data complexity, while polarization imaging methods cannot arbitrarily change illumination directions.

Innovation Solution

An image processing apparatus and method that calculates angle-dependent luminance components from multiple polarized lights with different polarization angles to produce images with arbitrarily selected illumination directions, using a calculator and image sensor to generate output images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If 3D computer graphic techniques are used to change illumination conditions, then illumination direction can be adjusted, but data complexity and calculation amount increase

Engineering Contradiction:
Improveillumination direction adjustmentVSAvoiddata complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the angle-dependent luminance component from the captured image data by dividing the light into polarized and non-polarized components. This extraction allows illumination direction adjustment without requiring complex 3D object data, as the angle-dependent component directly encodes the illumination information needed for rendering.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a simplified copy of illumination information by capturing angle-dependent luminance components through polarization filtering. Instead of using full 3D object models and complex lighting calculations, the system captures and processes only the necessary angular luminance data, significantly reducing data complexity while maintaining illumination adjustment capability.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If 3D computer graphic techniques are used to change illumination conditions, then illumination direction can be adjusted, but user burden increases

Engineering Contradiction:
Improveillumination direction adjustmentVSAvoiduser burden
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system performs automatic processing of the captured angle-dependent luminance components to generate images with different illumination directions. The calculator automatically calculates the required components and the image generator produces the final images without requiring users to manually specify complex illumination parameters, significantly reducing user burden.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary capture and processing of angle-dependent luminance components during the image acquisition phase. By pre-calculating and storing these components, the system enables rapid generation of images with different illumination directions without requiring complex real-time calculations or user input during the rendering phase.

Inventive Principle:
Principle #10Preliminary action

3Ease of manufacture

If polarization imaging method is used to remove polarized light, then specific light can be extracted, but illumination direction cannot be arbitrarily changed

Engineering Contradiction:
Improvelight extraction capabilityVSAvoidillumination direction control
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent makes the illumination direction dynamic by calculating images with different illumination directions from the captured angle-dependent luminance components. Instead of being limited to a fixed illumination direction determined during capture, the system can generate images with arbitrarily adjusted illumination directions through post-processing calculations, enabling flexible and adaptive illumination control.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive and arbitrary adjustment of illumination directions in images, reducing user burden and data complexity by calculating and synthesizing images using angle-dependent components, effectively addressing the limitations of existing techniques.

Implementation Method 1

luminance values of one or more input images produced by photoelectric conversion of multiple polarized lights whose polarization angles are mutually different

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10984566B2Image processing apparatus that calculates using luminance values of one or more input images produced by photoelectric conversion of multiple polarized lights, image-capturing apparatus and image processing method
Publication Date: 2021.04.20 CANON KK
  • US10984566B2 patent drawing
  • US10984566B2 patent drawing
  • US10984566B2 patent drawing

AI summary

The image processing apparatus includes a calculator configured to calculate, using luminance values of one or more input images produced by photoelectric conversion of multiple polarized lights whose polarization angles are mutually different, an angle-dependent component at a specific polarization angle among angle-dependent components that are luminance components changing depending on the polarization angle. The apparatus further includes a producer configured to produce an output image using the angle-dependent component at the specific polarization angle.