Diffuse Image Extraction Using Multi-Viewpoint Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for obtaining diffuse images from input images using the dichromatic reflection model struggle to accurately separate diffuse components when different objects with the same hue are present, leading to confusion and inaccurate processing.

Innovation Solution

An image processing apparatus and method that captures multiple input images while changing the light source position or viewpoint, allowing for the extraction of diffuse images based on the same pixel areas across multiple images, thereby avoiding hue-based confusion and accurately estimating the diffuse component.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If pixels are extracted for each hue in a single input image to estimate the diffuse component, then the processing speed is improved, but the accuracy of diffuse image obtention deteriorates when different objects with the same hue exist

Engineering Contradiction:
Improveprocessing speedVSAvoidaccuracy of diffuse image obtention
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The patent segments the image processing by dividing it into multiple input images captured from different viewpoints or lighting conditions, rather than processing a single image. This allows the system to extract diffuse components by comparing corresponding pixel areas across multiple images, thereby distinguishing between different objects with the same hue and improving accuracy while maintaining processing efficiency.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If multiple input images are captured while changing light source position or viewpoint, then the accuracy of diffuse image separation is improved, but the complexity of the device increases

Engineering Contradiction:
Improveaccuracy of diffuse image separationVSAvoidcomplexity of the device
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs a camera system that can function in multiple modes: capturing images under different lighting conditions, capturing images from different viewpoints, or capturing images at different times. This multi-functionality allows the system to achieve accurate diffuse image separation without requiring multiple specialized devices, thereby reducing overall system complexity while maintaining high accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If objects with different diffuse reflectance are processed using hue-based extraction, then the ease of operation is maintained, but the reliability of the results deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidreliability of the results
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces multiple input images captured under different conditions as an intermediary medium. By comparing corresponding pixel areas across these images, the system can reliably distinguish between different objects with the same hue, thereby maintaining ease of operation through automated processing while significantly improving the reliability of the diffuse image separation results.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10721395B2Image processing apparatus, image pickup apparatus, image processing method, and non-transitory computer-readable storage medium
Publication Date: 2020.07.21 CANON KK
  • US10721395B2 patent drawing
  • US10721395B2 patent drawing
  • US10721395B2 patent drawing

AI summary

An image processing apparatus (104) includes a first obtainer (104a) that obtains a plurality of input images (111) obtained by photographing an object a plurality of times while at least one of a light source position and a viewpoint is changed, and a second obtainer (104b) that obtains a plurality of diffuse images (115) based on the same pixel areas of object images in the plurality of input images (111).