Polarized Image Processing for Accurate Material Information Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Captured images of photographic subjects can vary significantly due to lighting conditions, making it difficult to accurately distinguish between intrinsic color and shape, leading to inaccurate information processing.
Innovation Solution
An image processing apparatus and method using a polarizing camera to capture a target object at varying angles and light source states, analyzing polarization degrees to estimate material information such as surface roughness and metalness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a captured image is used to identify material information, then the process is simple, but the accuracy is insufficient due to lighting variations
Solution Approach 1:
The patent changes the parameter of light polarization angle to capture images under different polarization conditions. By capturing images at multiple polarization angles (e.g., 0°, 45°, 90°, 135°) and analyzing the polarization degree, the system can distinguish intrinsic material properties from lighting effects, thereby improving measurement precision while maintaining reasonable process complexity
Solution Approach 2:
The patent introduces polarization degree as an intermediary parameter to bridge the gap between captured images and material information. The polarization degree obtainment unit calculates this intermediate metric, which serves as a mediator to separate specular reflection (affecting appearance) from diffuse reflection (revealing intrinsic material properties), enabling accurate material identification
2Measurement precision
If multiple captured images under different conditions are obtained, then material information accuracy is improved, but device complexity increases
Solution Approach 1:
The patent employs periodic action by systematically capturing images at regularly spaced polarization angles (e.g., every 45 degrees). This periodic sampling approach ensures comprehensive coverage of polarization states while maintaining a manageable number of captures, balancing accuracy improvement with controlled system complexity
Solution Approach 2:
The patent implements dynamics by making the polarization angle variable rather than fixed. The system dynamically adjusts the polarization angle to capture images under different polarization conditions, allowing adaptive exploration of material properties under varying light conditions without requiring a completely complex system redesign
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Accurately obtains material information with improved precision by distinguishing between specular and diffuse reflections, enhancing the accuracy of subsequent image processing.
Implementation Method 1
obtain multiple captured images resulting from using a polarizing camera to capture a target object while causing, for at least any one of the target object and a light source, an angle with respect to an image capturing surface or a state of the light source to differ
Implementation Method 2
obtain a degree of polarization of an image of the target object in each of the captured images
Implementation Method 3
distinguishing between whether an image of a certain target object represents an intrinsic color or shape or whether the image of the certain target object has an obtained figure by chance due to adjustment of light
Implementation Method 4
distinguishing between whether an image of a certain target object represents an intrinsic color or shape or whether the image of the certain target object has an obtained figure by chance due to adjustment of light
Data Source
AI summary
A captured image obtainment unit in an image processing apparatus obtains multiple sets of polarized images that have been captured while causing image capturing states to differ. For each polarized image, a polarization degree obtainment unit obtains a degree of polarization for an image of a target object. An image selection unit in a material information estimation unit, on the basis of the degree of polarization or additional information, selects an input image and a type thereof. An algorithm switching unit, on the basis of the degree of polarization or additional information, switches an algorithm used in material information estimation. An estimation unit uses the input image to estimate material information using the algorithm that was switched to. An output data generation unit generates an image using the material information and outputs the image to a display apparatus.