Image Processing Apparatus Correcting Polarization Coloring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods for combining polarization information from multiple images struggle with correcting coloring issues when the color information of a reference image is not accurately acquired, leading to unnatural coloring in the output image.

Innovation Solution

An image processing apparatus that acquires first polarization information from input images captured in different polarization states, corrects this information by replacing specific components with second polarization information using luminance values, and generates an output image using the corrected polarization information, thereby reducing coloring variations across color channels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If polarization information is calculated from multiple input images with different polarization states, then polarization information can be acquired, but coloring variations occur in the output image when color information of reference images is not correctly acquired

Engineering Contradiction:
Improvepolarization information accuracyVSAvoidcolor consistency
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the polarization information calculation into separate processing for luminance values and color information. Luminance values are used to calculate polarization information (amplitude and phase) independently, while color information is applied separately to generate the final colored output image. This segmentation prevents color inconsistencies from affecting polarization accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces luminance values as an intermediary medium between the input polarized images and the final output. By calculating polarization information through luminance values rather than directly from color channels, the system avoids color-related inconsistencies and achieves more reliable polarization data that can then be combined with color information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If color information from reference images is used to correct polarization information, then coloring can be adjusted, but the method fails when color information of the reference image is not correctly acquired

Engineering Contradiction:
Improvecolor correction capabilityVSAvoidcolor correction reliability
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent enables the system to self-correct coloring issues by using luminance values that are inherently consistent across all input images. Since luminance values are derived from the same polarization calculation process for all color channels, they provide a self-consistent reference that automatically corrects coloring without requiring external reference image color information.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If polarization information is calculated using color channel data, then colored output images can be generated, but coloring variations occur across different color channels

Engineering Contradiction:
Improvecolored image generationVSAvoidcolor channel consistency
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent separates the polarization calculation process from color processing. Luminance values are calculated from all color channels together to obtain unified polarization information, which is then applied to generate the colored output image. This segmentation ensures that polarization parameters are consistent across all color channels while still producing a full-color image.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11838699B2Image processing apparatus, image pickup apparatus, and image processing method
Publication Date: 2023.12.05 CANON KK
  • US11838699B2 patent drawing
  • US11838699B2 patent drawing
  • US11838699B2 patent drawing

AI summary

An apparatus includes an acquisition unit configured to acquire first polarization information that includes a polarized light component and an angle component using luminance values of input images obtained by imaging light of a plurality of colors in a plurality of different polarization states, a correction unit configured to acquire corrected polarization information obtained by replacing at least part of the first polarization information in a specific area with second polarization information obtained using a luminance value of a specific color among the plurality of colors in the specific area in the input images, and a generation unit configured to generate an output image using the corrected polarization information. The polarized light component is a luminance component that changes according to polarization angles. The angle component is a polarization angle that maximizes the luminance value.