3D Model Generation for Reflective and Transmissive Surfaces
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing three-dimensional model generation techniques using photogrammetry often inaccurately represent reflective or transmissive surfaces, leading to incorrect generation of three-dimensional models by mistaking optical surfaces for spaces behind them or breaking the model at optical surface portions.
Innovation Solution
A device and method that includes an imager, optical surface detection, color attribute detection, and a model generation unit to identify and process optical surfaces by arranging masks corresponding to the detected color attributes and surface types, ensuring accurate representation of reflective and transmissive surfaces in generated three-dimensional models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If photogrammetry is used to generate three-dimensional models from multiple images, then three-dimensional model generation is enabled, but optical surfaces (reflective or transmissive) are incorrectly processed causing model distortion or breakage
Solution Approach 1:
The patent segments the image processing by detecting and masking optical surface regions separately from regular regions. The mask processing unit divides the image into optical surface regions (requiring special handling) and non-optical regions (processed by standard photogrammetry), allowing differential processing that preserves optical surfaces while maintaining overall model generation capability
Solution Approach 2:
The patent introduces masks as intermediary elements that mediate between the captured images and the three-dimensional model generation process. These masks represent optical surface regions and are arranged in the images to prevent incorrect processing, acting as a bridge that preserves optical surface information while enabling standard photogrammetry processing
2Manufacturing precision
If masks are arranged in optical surface regions to preserve them, then optical surface representation improves, but processing complexity increases
Solution Approach 1:
The mask processing unit automatically detects optical surface regions and generates appropriate masks without requiring manual intervention. The system self-services by autonomously identifying regions needing mask protection and applying the correct mask types, reducing the need for complex manual processing while maintaining high precision
Solution Approach 2:
The patent changes the processing parameters for detected optical surface regions by applying specific mask types (reflective masks for mirror surfaces, transmissive masks for glass surfaces). This parameter change approach allows standard photogrammetry algorithms to be used with modified input images, avoiding the need for entirely different complex processing methods
Data Source
AI summary
A three-dimensional model generation device includes: an imager configured to acquire multiple images captured at multiple capturing positions; an optical surface detection unit configured to detect an optical surface region in which at least one of a reflected image visually recognized by reflection of light and a transmitted visual object visually recognized through a transparent member is observed in the multiple captured images; a model generation unit configured to arrange a mask in the optical surface region and generates a three-dimensional model based on the multiple images in which the mask is arranged; and a color attribute detection unit configured to detect a color attribute of the optical surface region, whereinthe model generation unit is further configured to generate and arrange the mask based on the color attribute of the optical surface region and a type of the optical surface region.