Polarization Control for Shadow-Free Photogrammetry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current photogrammetry techniques struggle to capture accurate three-dimensional models of real-world environments under varying lighting conditions, especially in non-studio settings, due to issues with shadows, specular reflections, and subsurface scattering, which are exacerbated by fixed light sources and the difficulty in transporting and coordinating artificial lighting.
Innovation Solution
The method involves capturing cross-polarized and co-polarized images to isolate diffuse and specular components, using a system that controls polarization states to reduce shadows and enhance lighting simulation, allowing for the generation of shadow-free images that can be processed to create realistic virtual environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If cross-polarized imaging is used to reduce shadows and isolate diffuse components, then measurement precision of surface properties improves, but device complexity increases due to polarization control requirements
Solution Approach 1:
The patent segments the lighting information into distinct polarization components (diffuse, specular, shadow) by capturing images at multiple polarization angles. This allows separate processing and reconstruction of each component, improving measurement precision while managing system complexity through modular data handling.
Solution Approach 2:
The patent adds the polarization dimension to traditional photogrammetry by capturing images across multiple polarization states. This additional dimensional information enables separation of lighting components and shadow removal, enhancing surface property measurement without requiring complex physical modifications to the imaging geometry.
2Loss of information
If multiple polarization states are captured to separate lighting components, then information completeness about surface properties improves, but loss of time increases due to multiple exposures required
Solution Approach 1:
The patent employs periodic modulation of polarization filters to cycle through multiple polarization states during image capture. This periodic action allows systematic collection of polarization-dependent information while maintaining a structured capture sequence that optimizes time efficiency.
Solution Approach 2:
The patent maintains continuous capture of useful information by overlapping polarization angle sequences and using all captured polarization data for reconstruction. This ensures that time is not wasted by discarding any polarization state information, as each state contributes valuable lighting component data.
3Illumination intensity
If on-axis lighting is used to illuminate subject matter, then illumination intensity improves, but object-generated harmful factors increase due to shadow introduction
Solution Approach 1:
The patent converts the harmful shadow effect into beneficial information by capturing shadows at multiple polarization angles. Through polarization-based segmentation, the system identifies and removes shadow components from the diffuse surface texture, transforming what was previously harmful information into a useful separation mechanism.
Solution Approach 2:
The patent changes the polarization parameter of the captured light to differentiate between shadow and non-shadow regions. By analyzing polarization state variations across the image, the system can identify shadow areas and separate them from the true surface texture, effectively eliminating shadow artifacts from the final model.
4Device complexity
If fixed light sources are used in photogrammetry, then device complexity decreases, but object-generated harmful factors increase due to specular reflections and subsurface scattering
Solution Approach 1:
The patent introduces polarization state as an intermediary parameter to mediate between fixed light sources and the image sensor. By capturing and analyzing polarization information, the system can separate specular reflections and subsurface scattering effects from the true surface texture, effectively filtering out harmful factors while maintaining simple fixed lighting.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables the creation of photorealistic virtual environments by separating diffuse and specular components, reducing shadows, and simulating realistic lighting conditions, even under changing perspectives and natural light sources, improving the accuracy and practicality of virtual environment rendering.
Implementation Method 1
receiving a two-dimensional data set responsive to a cross-polarized exposure captured at the sensor orientation
Implementation Method 2
a two-dimensional data set responsive to a cross-polarized exposure captured at the sensor orientation
Data Source
AI summary
Paired images of substantially the same scene are captured with the same freestanding sensor. The paired images include reflected light illuminated with controlled polarization states that are different between the separate images. A first pixel value from one of the first image and the second image is subtracted from a corresponding pixel value from a remaining one of the first image and the second image. When repeated over the raster of corresponding pixels, a modified image includes an isolated representation of substantially pure specular color data. The captured images and the modified image are stored and used to generate a model. Substantially shadow-free diffuse color and specular color data are applied to texture maps of the model to generate a virtual environment where a virtual light source can be introduced and controlled to achieve desired results absent adverse effects introduced from fixed ambient light sources used in conventional source photography.