Virtual Pattern Projection for 3D Texture Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D scanning technologies face challenges in obtaining high-quality textures due to the need for accurate depth information and the complexity of removing pattern light information, especially when the optical axes of pattern projection and photography apparatuses do not coincide, leading to increased data size and inefficiencies.
Innovation Solution
A high-quality texture obtaining apparatus and method that includes a stereoscopic information obtainer, a virtual pattern projector, and a pattern remover, which projects virtual pattern light onto a stereoscopic model, extracts a second texture map, and removes patterns from the first texture map using this information to generate a third texture map without pattern distortion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If pattern projection apparatus and photographing apparatus have different optical axes, then the system is easier to set up and operate, but the pattern removal becomes more complex and requires additional equipment
Solution Approach 1:
The patent creates a virtual copy of the pattern projection process by generating a virtual pattern map that simulates how the pattern would appear from the photographing apparatus's perspective. This virtual map is then used to remove the actual pattern from the captured image, eliminating the need for complex calibration between different optical axes.
Solution Approach 2:
The patent introduces a virtual pattern map as an intermediary element that bridges the gap between the pattern projection apparatus and the photographing apparatus. This virtual map serves as a mediator that allows pattern removal without requiring direct optical axis alignment or additional sensing equipment.
2Object-generated harmful factors
If infrared-based pattern projection is used, then the pattern is undetectable by standard photographing apparatus, but additional infrared sensing equipment is required
Solution Approach 1:
Instead of using infrared patterns that require special sensing equipment, the patent uses visible light patterns and creates a virtual copy of the pattern appearance through computational processing. This approach allows standard photographing apparatus to capture both the object and pattern information without needing additional infrared sensors.
Solution Approach 2:
The patent replaces the physical infrared sensing mechanism with a computational approach. Rather than detecting infrared patterns with specialized hardware, the system uses visible light patterns and removes them through image processing algorithms, substituting mechanical sensing with computational methods.
3Measurement precision
If multiple photographing apparatus with same optical axes are used, then pattern removal accuracy is improved, but data size and processing requirements increase
Solution Approach 1:
The patent segments the pattern removal process into two distinct stages: first capturing the image with pattern, then separately generating and applying the virtual pattern map for removal. This segmentation allows accurate pattern removal using a single photographing apparatus without requiring multiple cameras or increasing data volume.
Data Source
AI summary
Provided are a high-quality texture obtaining apparatus and a high-quality texture obtaining method. The high-quality texture obtaining apparatus includes a stereoscopic information obtainer configured to obtain a stereoscopic model of an object onto which patterns have been projected and a first texture map including information about a texture and color of the object, from an image obtained by photographing the object; a virtual pattern projector configured to project virtual pattern light onto the stereoscopic model to project a virtual pattern onto the stereoscopic model; a texture map obtainer configured to extract a second texture map including information about a texture and a color of the stereoscopic model onto which the virtual pattern light has been projected; and a pattern remover configured to remove the patterns from the first texture map by referring to the second texture map and obtain a third texture map from which the patterns have been removed.