Image Processing Apparatus for Variable Illumination via Specular Component Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods cannot create images with a variable illumination position without physically moving the light source, as they fail to effectively separate and manipulate specular-reflection components from images captured at multiple viewpoints.

Innovation Solution

An image processing apparatus that includes a transformation unit to match corresponding points across multiple images, a separating unit to remove specular-reflection components, and an image reconstructing unit to combine these components, allowing for the creation of images with a virtually changed light source position.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If images are processed to create arbitrary viewing point images with fixed illumination position, then image synthesis from multiple viewpoints is achieved, but the illumination position cannot be varied without physically moving the light source

Engineering Contradiction:
Improveillumination position variabilityVSAvoidphysical light source manipulation
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the specular-reflection component from the rendered image, separating it from the diffuse reflection component. This extracted specular component can then be independently manipulated to change the apparent light source position without physically moving the light source, thereby resolving the contradiction between illumination variability and device complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the rendering process into separate components: diffuse reflection rendering and specular-reflection component extraction. By processing these components separately and then recombining them with modified specular components, the system achieves variable illumination positions without physical light source manipulation

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If specular-reflection components are separated and manipulated to change light source position, then illumination control is achieved, but the image processing complexity increases

Engineering Contradiction:
Improvelight source position controlVSAvoidimage processing steps
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the specular-reflection component from the rendered image using a separating unit that processes the rendered image data. This extraction allows the specular component to be independently manipulated for light source position control while maintaining a structured processing approach that manages complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements a dynamic image processing system where the specular-reflection component can be selectively manipulated and recombined at different positions. This dynamic approach allows flexible light source positioning by processing and recombining image components rather than requiring static physical light source arrangements

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9965834B2Image processing apparatus and image acquisition apparatus
Publication Date: 2018.05.08 OLYMPUS CORPORATION(JP)
  • US9965834B2 patent drawing
  • US9965834B2 patent drawing
  • US9965834B2 patent drawing

AI summary

Provided is an image processing apparatus including a transformation unit that is configured to deform images so that corresponding points in a plurality of images obtained from several viewpoints with respect to the same subject are matched; a separating unit that is configured to separate specular-reflection components from the plurality of images transformed by the transformation unit and create an image from which the specular-reflection component is removed; and an image reconstructing unit that is configured to combine at least one of the specular-reflection components of the plurality of images, separated by the separating unit, and the image from which the specular-reflection component is removed.