Normals Distribution Estimation Using Material-Aware Reflection Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for estimating the distribution of normals to an object suffer from reduced accuracy due to the selection of reflection models based on luminance values, which do not consider the material characteristics of the object.

Innovation Solution

An image processing apparatus that obtains captured images of an object under various conditions and information about the object's material, then uses an estimation unit to calculate the distribution of normals based on these images and material information, selecting a suitable reflection model for improved accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a reflection model is selected based on luminance values, then the selection process is simple and fast, but the accuracy of normals distribution estimation deteriorates because material characteristics are not considered

Engineering Contradiction:
Improveselection speedVSAvoidnormals distribution estimation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary classification of the object's material characteristics before selecting the reflection model. By pre-establishing the relationship between material types and suitable reflection models, the system can quickly identify the appropriate model without compromising accuracy, thus resolving the contradiction between selection speed and estimation accuracy

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the selection criterion from simple luminance values to material characteristics (such as roughness, reflectivity, and material type). This parameter change enables more accurate matching between the reflection model and the object, improving normals distribution estimation accuracy while maintaining efficient selection through automated material recognition

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If a reflection model supporting various kinds of objects is used, then the adaptability increases, but the number of parameters increases causing reduced accuracy unless sufficient observation values are obtained

Engineering Contradiction:
Improveobject type coverageVSAvoidnormals distribution estimation accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system segments the object classification into distinct material categories (such as metallic, non-metallic, rough, smooth surfaces). By dividing the continuous spectrum of material properties into discrete segments, the system can select from multiple specialized reflection models, each optimized for specific material types, thereby maintaining high accuracy while achieving broad adaptability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies different reflection models to different material types based on their local characteristics. Instead of using a single universal model with many parameters, the system selects appropriate models with fewer parameters for each material category, improving accuracy by matching the model's complexity to the object's specific properties

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the accuracy of normals distribution estimation by selecting a reflection model tailored to the object's material, thereby improving the precision of asperity information representation.

Implementation Method 1

a first obtainment unit configured to obtain a plurality of captured images of an object captured under a plurality of image capture conditions; an estimation unit configured to estimate a distribution of normals of the object based on the plurality of captured images and information on a material of the object

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS12299924B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2025.05.13 CANON KK
  • US12299924B2 patent drawing
  • US12299924B2 patent drawing
  • US12299924B2 patent drawing

AI summary

An image processing apparatus includes: a first obtainment unit configured to obtain a plurality of captured images of an object captured under a plurality of image capture conditions; a second obtainment unit configured to obtain information on a material of the object; and an estimation unit configured to estimate a distribution of normals of the object based on the plurality of captured images and the information on the material.