Cross-Polarized Image Capture for Shadow-Free Virtual Environments
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional photogrammetry techniques struggle to capture and process images of real-world environments with varying lighting conditions, leading to issues like shadows and specular reflections, which are difficult to address in non-studio settings due to the limitations of fixed light sources and the impracticality of transporting and positioning artificial light sources.
Innovation Solution
The method involves capturing cross-polarized and co-polarized images under controlled lighting conditions to isolate diffuse and specular surface textures, using a freestanding image-capture system that synchronizes illumination with the camera's shutter to minimize shadows and optimize light exposure, and processing these images to generate shadow-free diffuse and specular projection maps for creating realistic virtual environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If fixed light sources are used in photogrammetry, then the imaging system can be simplified and operated in non-studio environments, but shadows and specular reflections are introduced that obfuscate true surface features
Solution Approach 1:
The patent employs multiple light sources with controllable output intensities that can be dynamically adjusted during image capture. The system transitions from static studio lighting to dynamic, adaptable lighting that can be controlled independently for each light source, enabling the system to adapt to different capture conditions and minimize shadows while maintaining operability in non-studio environments
Solution Approach 2:
The patent combines multiple light sources with different characteristics (natural light, artificial light, flash sources) into a composite illumination system. By layering and controlling these different light sources with varying intensities and timing, the system achieves comprehensive surface illumination that reduces shadows and specular reflections while maintaining versatility in non-studio settings
2Object-affected harmful factors
If artificial light sources are transported and positioned around the subject, then shadow-free illumination can be achieved, but the system becomes resource intensive and impractical for non-studio environments
Solution Approach 1:
The patent creates a multi-functional illumination system where a single controllable light source can perform multiple functions by adjusting its output intensity and timing. The same light source can provide diffuse illumination, specular illumination, or be synchronized with the shutter to eliminate shadows, replacing the need for multiple specialized light sources and reducing overall system complexity
Solution Approach 2:
The patent controls shadow-free illumination by changing the parameters of light sources rather than adding more light sources. By adjusting output intensity, timing synchronization with shutter speed, and polarization states, the system achieves shadow-free illumination with a minimized set of controllable light sources, making the system practical for non-studio environments
3Illumination intensity
If continuous light sources are used with slower shutter speeds, then more light reaches the sensor, but temporal resolution is lost for freestanding cameras
Solution Approach 1:
The patent employs periodic, pulsed illumination from flash sources that are synchronized with the camera shutter. Instead of continuous illumination, the light source emits brief pulses at precise intervals that coincide with shutter opening, providing sufficient light exposure during the exposure window while maintaining temporal resolution by eliminating light during non-exposure periods
Solution Approach 2:
The patent uses brief, intense flash illumination that rushes through the exposure window in a concentrated pulse rather than continuous illumination. This allows sufficient light energy to reach the sensor during the brief exposure period without requiring the shutter to remain open longer, thereby maintaining temporal resolution while achieving adequate light exposure
4Object-affected harmful factors
If cross-polarized lighting is used to reduce shadows, then diffuse surface texture can be captured, but specular reflections are also reduced along with useful surface information
Solution Approach 1:
The patent segments the illumination into separate polarized channels, using cross-polarized light for diffuse surface capture and co-polarized or unpolarized light for specular surface capture. By separating the illumination paths and polarization states, the system can selectively capture different surface properties without one interfering with the other, then combine the information in post-processing
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for the creation of realistic virtual environments with reduced shadows and improved surface texture representation, enabling more accurate rendering of changing lighting conditions and subsurface scatter, even in outdoor or dynamic settings.
Implementation Method 1
Polarizing filters are arranged adjacent to the light sources to polarize the light from the light sources in a desired orientation
Implementation Method 2
receiving a two-dimensional data set responsive to a cross-polarized exposure captured at the sensor orientation
Data Source
AI summary
Paired images of substantially the same scene are captured with the same freestanding sensor. The paired images include reflected light illuminated with controlled polarization states that are different between the separate images. A first pixel value from one of the first image and the second image is subtracted from a corresponding pixel value from a remaining one of the first image and the second image. When repeated over the raster of corresponding pixels, a modified image includes an isolated representation of substantially pure specular color data. The captured images and the modified image are stored and used to generate a model. Substantially shadow-free diffuse color and specular color data are applied to texture maps of the model to generate a virtual environment where a virtual light source can be introduced and controlled to achieve desired results absent adverse effects introduced from fixed ambient light sources used in conventional source photography.