Image Processing Apparatus Separating Luminance for Intrusion Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image processing methods that remove specular reflection components to eliminate intrusion information often alter the texture of objects, as they include both intruder and object information.

Innovation Solution

An image processing apparatus and method that separates luminance information into intrusion and object components using polarization information, dichroic reflection models, or parallax information, allowing for the determination of intrusion components and processing to maintain object texture integrity by generating an output image based on these components.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-generated harmful factors

If the specular reflection component is removed to eliminate intrusion information, then intrusion information is removed, but the texture of the object changes

Engineering Contradiction:
Improveintrusion informationVSAvoidtexture of the object
Core Design Contradiction:
Object-generated harmful factorsVSShape

Solution Approach 1:

The luminance information is segmented into two distinct components: intrusion component and object component. This segmentation allows selective processing where only the intrusion component is removed while the object component (containing texture information) is preserved and combined to maintain the original texture appearance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different processing is applied to different components: the intrusion component is removed while the object component is preserved. This local differentiation ensures that texture information is maintained in regions where it exists while eliminating intrusion information where it appears.

Inventive Principle:
Principle #3Local quality

2Object-generated harmful factors

If polarization information is used to separate specular reflection component, then intrusion information can be removed, but the processing complexity increases

Engineering Contradiction:
Improveintrusion informationVSAvoidprocessing complexity
Core Design Contradiction:
Object-generated harmful factorsVSDevice complexity

Solution Approach 1:

Polarization information serves as an intermediary that facilitates the separation of intrusion and object components. By introducing this intermediate measurement dimension, the system can distinguish between specular reflection (intrusion) and diffuse reflection (object) without requiring complex hardware modifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Effectively removes intrusion information while preserving object texture, preventing changes in the object's appearance and maintaining accurate representation.

Implementation Method 1

separating, utilizing polarization information acquired by a polarization sensor, an image component into a specular reflection component (intrusion information) and a diffuse reflection component (object information)

Methodology Applied
Scientific EffectPolarization: Polarisation

Data Source

PatentUS11842570B2Image processing apparatus, image pickup apparatus, image processing method, and storage medium
Publication Date: 2023.12.12 CANON KK
  • US11842570B2 patent drawing
  • US11842570B2 patent drawing
  • US11842570B2 patent drawing

AI summary

An image processing apparatus includes a separation unit configured to separate luminance information of each pixel in a processing area of an input image into an intrusion component and an object component, a determination unit configured to determine whether each of intrusion components is a first component or a second component, a processing unit configured to generate first information based on the first component, and an image generating unit configured to generate an output image based on the first information, the second component, and the object component.