Stereo Polarization Image Capture for Passive Normal Vector Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for obtaining normal information from images are limited, as they often require special light sources, are not passive, or have limited applicability due to factors like multiple reflections and material or shape constraints, and struggle to handle both specular and diffuse reflection components simultaneously.
Innovation Solution
An image processing apparatus that captures polarized light from different viewpoints and uses polarization information to estimate normal direction vectors by segmenting images into areas with common optical properties, allowing for the generation of high-precision normal information over a wide area without active lighting.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If active sensing methods like photometric stereo are used to obtain normal information, then normal information can be obtained, but the method requires special light sources and cannot be called passive sensing
Solution Approach 1:
The patent replaces active mechanical/light-based sensing systems with passive polarization-based optical sensing. Instead of using active light sources and photometric stereo methods, the invention utilizes the natural polarization properties of reflected light from the subject, allowing passive acquisition of normal information through polarization image analysis without requiring special illumination conditions
Solution Approach 2:
The patent changes the measurement parameter from intensity-based photometric stereo to polarization-based normal estimation. By analyzing the polarization state of reflected light rather than intensity variations under different lighting, the system achieves passive sensing capability while maintaining precision in normal information acquisition
2Ease of operation
If polarization methods are used to directly measure normal information, then passive sensing is achieved, but the methods have limited applicability due to multiple reflections and material constraints
Solution Approach 1:
The patent segments the image into multiple regions based on polarization characteristics, identifying specular reflection areas, diffuse reflection areas, and shadow areas separately. This segmentation allows the system to apply appropriate processing to each region, thereby handling diverse materials and lighting conditions effectively and expanding applicability across different subjects and environments
Solution Approach 2:
The patent applies different processing strategies to different regions of the image based on their local optical properties. Specular regions are processed using polarization-based normal estimation, while diffuse and shadow regions use alternative methods, allowing the system to maintain accuracy across various materials and lighting conditions without being constrained by uniform processing limitations
3Measurement precision
If conventional polarization methods are used, then normal information can be obtained, but high-precision normal information over wide areas cannot be achieved
Solution Approach 1:
The patent introduces the dimension of multiple viewpoint polarization images to enhance normal information precision. By capturing polarization images from different viewpoints and analyzing the geometric relationships between corresponding points, the system achieves high-precision normal estimation across wide areas, overcoming the limitations of single-viewpoint methods
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables passive and precise estimation of normal information for entire subjects, overcoming limitations of previous methods by effectively handling both specular and diffuse reflection components and providing accurate normal direction vectors across various environments and materials.
Implementation Method 1
a polarization image capturing section for receiving light from the subject and obtaining a polarization image
Data Source
AI summary
High-precision normal information on the surface of a subject is generated by capturing an image of the subject. A normal information generating device captures the image of the subject and thereby passively generates normal information on the surface of the subject. The normal information generating device includes: a stereo polarization image capturing section for receiving a plurality of polarized light beams of different polarization directions at different viewpoint positions and obtaining a plurality of polarization images of different viewpoint positions; and a normal information generating section for estimating a normal direction vector of the subject based on the plurality of polarization images of different viewpoint positions.