3D Subsurface Scattering Texture Maps from Polarized Multi-View Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional texture maps fail to capture subsurface scattering properties of 3D objects, particularly those with translucent or semi-transparent surfaces, leading to inaccurate rendering and relighting.
Innovation Solution
An electronic apparatus and method that utilizes polarized lighting patterns and multi-view image capture to estimate subsurface scattering parameters, generating texture maps like SSS translucency and color maps through a multipole scattering model fitting on captured images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional texture maps are generated based on surface reflectance properties, then the rendering process is simple and fast, but subsurface scattering properties are not captured accurately
Solution Approach 1:
The patent segments the texture map generation process into multiple specialized maps: albedo map for surface color, normal map for surface geometry, and subsurface scattering map for translucent properties. This segmentation allows each map to capture specific material properties independently, improving measurement precision for subsurface scattering while managing system complexity through modular processing
Solution Approach 2:
The patent introduces an intermediary processing step that analyzes captured images to separate surface reflectance from subsurface scattering components. This intermediary analysis layer enables accurate capture of subsurface properties without requiring complete system redesign, bridging the gap between conventional simple capture and advanced material characterization
2Measurement precision
If multiple lighting patterns and multi-view capture are used to capture subsurface scattering, then rendering accuracy is improved, but the time and resources required for capture increase
Solution Approach 1:
The patent applies preliminary actions by pre-configuring multiple light sources in specific geometric arrangements and pre-positioning cameras at predetermined viewpoints before capture begins. This preliminary setup enables efficient multi-view capture with optimized lighting patterns, reducing on-site adjustment time while maintaining high measurement precision for subsurface scattering parameters
Solution Approach 2:
The patent employs periodic action by sequentially activating different lighting patterns in a systematic sequence during image capture. This periodic illumination approach allows comprehensive subsurface scattering characterization through multiple lighting conditions while managing capture time through structured, repeating cycles rather than random or continuous illumination
3Reliability
If subsurface scattering parameters are estimated through complex model fitting, then photorealistic rendering is achieved, but computational complexity and processing time increase
Solution Approach 1:
The patent transforms the complex subsurface scattering characterization problem into parameter estimation by fitting a mathematical model to captured images. This approach changes the problem from direct complex optical measurement to parameter optimization, achieving photorealistic rendering accuracy while managing computational complexity through efficient model fitting algorithms that estimate key subsurface parameters rather than solving full radiative transfer equations
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Accurately renders 3D models by incorporating subsurface scattering properties, resulting in photorealistic and relightable representations of objects with translucent surfaces.
Implementation Method 1
controlling a set of light sources to generate a set of lighting patterns... Each light source of the set of light sources may include a polarizer
Implementation Method 2
certain properties of the object's surface can cause incident light to be absorbed into the surface
Implementation Method 3
scattered at a subsurface level, and then reemerge from the surface
Data Source
AI summary
An electronic apparatus and method for generation of subsurface scattering texture maps for three-dimensional (3D) objects is provided. The electronic apparatus controls a set of light sources to generate a set of lighting patterns. The electronic apparatus controls a set of image capture devices to capture a set of images of an object that is illuminated by the generated set of lighting patterns. The electronic apparatus determines pixel-level offset information based on application of an image registration operation on the set of images. The electronic apparatus generates a set of corrected images based on the pixel-level offset information and the set of images. The electronic apparatus estimates subsurface scattering (SSS) parameters in a form of texture maps corresponding to a 3D mesh of the object. The estimation is performed based on a fitting of a scattering model on the set of corrected images.