Temporary Texturing for 3D Modeling of Textureless Surfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D modeling techniques struggle with textureless regions, leading to incomplete or distorted reconstructions due to difficulty in tracking key points across different viewing angles.
Innovation Solution
Applying temporary textures to textureless regions using a volumetric density function and pseudo-random colors, followed by selective blending to enhance key point detection and surface geometry modeling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional 3D modeling techniques are used on textureless regions, then the processing is simple and fast, but the reconstruction accuracy deteriorates due to inability to track key points
Solution Approach 1:
The patent applies preliminary texturization to textureless regions before performing 3D reconstruction. By pre-applying pseudo-random textures to regions that lack texture information, the system enables key point detection and tracking to work effectively in areas that would otherwise be untrackable, thereby improving reconstruction accuracy without requiring complex alternative approaches during the main processing pipeline
Solution Approach 2:
The patent introduces temporary pseudo-random textures as an intermediary element between the textureless regions and the key point tracking process. These intermediary textures serve as artificial features that facilitate tracking in textureless areas, allowing the system to overcome the limitation of traditional methods while maintaining the original textureless appearance in the final output
2Measurement precision
If temporary textures are applied to all regions, then key point tracking is improved, but the original texture information is lost in textured regions
Solution Approach 1:
The patent applies local quality by restricting temporary texture application only to textureless regions rather than uniformly across the entire image. The system identifies regions lacking texture information and applies pseudo-random textures selectively to those specific areas, while leaving regions with existing texture information unchanged. This localized approach ensures that key point tracking is improved where needed without compromising original texture information in already-textured regions
3Loss of information
If selective blending is used to preserve original textures, then texture information is maintained, but the processing time increases
Solution Approach 1:
The patent applies partial action by performing selective blending only in regions where it is necessary - specifically, in areas where temporary textures have been applied. Rather than processing the entire image through the blending pipeline, the system identifies and processes only the textureless regions that required texturization, thereby preserving original textures in already-textured regions and reducing overall processing time while still achieving the goal of maintaining texture information where it exists
Data Source
Figure 1
Figure 2A~2B
Figure 3A
AI summary
Systems and methods are directed to generating a three-dimensional (3D) model of a first image set. The first image set (e.g., input image set) corresponds to different viewing angles of an object that is subject to 3D modeling. A volumetric density function is generated from the first image set. A second image set (e.g., a textured image set) is generated from the volumetric density function and from a predefined color function. The first image set is blended with the second image set to generate a third image set (e.g., an image set with temporary textures). To generate the 3D model, a 3D surface model is generated from the third image set. In addition, a texture map of the 3D surface model is generated from the first image set. A computing system is configured to render the 3D surface model and texture map for display.