Noise Reduction for Accurate Diffuse Reflection Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for estimating diffuse reflection components in images are degraded by noise, leading to inaccurate pixel extraction and estimation due to hue variation, especially when pixels from objects with different diffuse reflectances are mixed.

Innovation Solution

An image processing apparatus and method that performs a noise reduction process on the input image to obtain a second hue with reduced noise, allowing for accurate extraction of pixels and estimation of diffuse reflection components, using a combination of noise reduction techniques such as bilateral filters and guided filters, and fitting methods to exclude specular reflection outliers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If pixels are extracted based on hue from input images containing noise, then pixel extraction can be performed, but extraction accuracy is degraded due to hue variation caused by noise

Engineering Contradiction:
Improvepixel extractionVSAvoidextraction accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by performing noise reduction on the input image before extracting pixels based on hue. The noise reduction process is executed in advance to produce a cleaned image, ensuring that subsequent pixel extraction operates on noise-reduced data, thereby preventing noise-induced hue variation from degrading extraction accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary approach by using a noise-reduced intermediate image as a mediator between the original noisy input image and the final pixel extraction process. This intermediate representation filters out noise while preserving essential color information, enabling accurate hue-based pixel extraction without direct exposure to noise-induced variations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If hue range for pixel extraction is increased to compensate for noise variation, then more pixels can be extracted, but pixels from objects with different diffuse reflectances are mixed, degrading estimation accuracy

Engineering Contradiction:
Improvenumber of extracted pixelsVSAvoiddiffuse reflection estimation accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by performing noise reduction before pixel extraction. By cleaning the input image in advance, the noise-induced hue variations are eliminated, allowing for a narrower and more precise hue range to be used during extraction. This ensures that only pixels from objects with similar diffuse reflectance are extracted, maintaining estimation accuracy while still capturing sufficient pixels.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If noise reduction process is applied to input image, then noise influence is reduced and extraction accuracy is improved, but processing time and computational complexity increase

Engineering Contradiction:
Improveextraction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies parameter changes by adjusting the noise reduction process to operate specifically on hue information rather than the entire image. By changing the processing parameter to target only the hue channel, the system reduces computational complexity and processing time while still achieving effective noise reduction that improves extraction accuracy.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies segmentation by separating the noise reduction operation from the complete image processing pipeline and applying it specifically to the hue component. This segmentation allows the noise reduction to be performed only where necessary (on hue data) rather than on all image data, reducing overall processing time while maintaining extraction accuracy.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10565687B2Image processing apparatus, imaging apparatus, image processing method, image processing program, and recording medium
Publication Date: 2020.02.18 CANON KK
  • US10565687B2 patent drawing
  • US10565687B2 patent drawing
  • US10565687B2 patent drawing

AI summary

One or more image processing apparatuses, imaging apparatuses, image processing methods, image processing programs, and recording mediums are provided herein. At least one image processing apparatus includes a hue obtaining unit configured to perform a noise reduction process on an input image or a first hue of the input image so as to obtain a second hue having reduced noise, an extraction unit configured to extract a plurality of pixels from the input image based on the second hue having the reduced noise, and an estimation unit configured to estimate diffuse reflection components based on the plurality of extracted pixels.