Moveable 3D Scanner Texture Modeling for Lighting-Independent Color
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D scanners generate texture maps with inconsistent lighting and shading information, failing to capture material properties accurately, which hinders photorealistic rendering of objects.
Innovation Solution
A moveable scanner, such as a structured light or photogrammetry scanner, separates inconsistent illumination and shading from true surface color by using equations that describe light behavior at various angles, determining material properties like reflectivity and specular color for each pixel, and correcting RGB values to remove stray highlights.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If conventional 3D scanners capture images from multiple viewpoints to create texture maps, then the coverage of the object surface is improved, but the lighting and shading information becomes inconsistent across different views
Solution Approach 1:
The patent applies parameter changes by systematically varying the scanner position and orientation parameters to capture images from multiple viewpoints. By controlling the movement parameters and applying geometric transformations, the system maintains consistent lighting representation across different views while achieving complete surface coverage.
Solution Approach 2:
The patent transitions from 2D image captures to 3D spatial reasoning by incorporating depth information and spatial transformations. The system uses 3D model geometry to map and integrate texture information from multiple viewpoints, adding a dimensional aspect that resolves lighting inconsistencies through geometric correction.
2Measurement precision
If photographs are taken under specific lighting conditions to capture object color, then the color accuracy for those conditions is improved, but the model fails to represent the object under different lighting conditions
Solution Approach 1:
The patent implements feedback by using the captured images and known scanner positions to iteratively refine the texture model. The system compares observed lighting conditions with expected conditions based on geometry, and adjusts the texture parameters to achieve consistency across multiple views and lighting scenarios.
Solution Approach 2:
The patent creates a universal texture model that functions across multiple lighting conditions by separating intrinsic object properties from extrinsic lighting effects. The resulting model can be applied universally to different viewing and lighting scenarios, making the texture representation adaptable and versatile.
3Loss of time
If a single photograph is used to texture a 3D model, then the processing time is reduced, but the model does not appear physically accurate under varying lighting
Solution Approach 1:
The patent performs preliminary actions by capturing a comprehensive set of images from multiple predetermined viewpoints before model generation. This pre-captured data is then processed to create a robust texture model that maintains physical accuracy without requiring extensive post-processing or multiple photographs during rendering.
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
A method is performed at a moveable scanner with one or more optical sensors. The method includes scanning, using the moveable scanner, an object having a surface. The scanning generates color data from a plurality of orientations of the moveable scanner with respect to the object. The method further includes generating, using at least the color data, a pixel map of the surface of the object, the pixel map including, for each respective pixel of a plurality of pixels: a color value of a corresponding point on the surface of the object; and a value for a non-color property of the corresponding point on the surface of the object.