Guided 3D Scanning for Complete Coverage With Fewer Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D scanning systems face challenges in generating accurate models due to incomplete data capture, leading to holes, gaps, and artifacts, as well as high processing times and resource consumption, particularly when capturing complex objects or scenes, and often require manual expertise to ensure adequate coverage.
Innovation Solution
A guided scanning system that uses a camera and processor to capture initial images, compute guidance maps to identify optimal poses for additional images, and provide feedback to users or automatically adjust camera positions to improve coverage and reduce redundant data capture, thereby enhancing the accuracy and efficiency of 3D model generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the scanning process captures hundreds of frames to cover sufficient color and geometric aspects of an object, then the completeness and accuracy of the 3D model is improved, but the amount of data produced and processing time increases significantly
Solution Approach 1:
The system performs preliminary actions by computing a guidance map before actual scanning to identify optimal camera poses. This pre-planning ensures that the camera captures images from the most informative positions, reducing the total number of frames needed while maintaining model accuracy. The guidance map is computed based on the object's geometry and the camera's field of view, allowing the system to avoid redundant captures.
Solution Approach 2:
The system uses feedback by continuously updating the guidance map as the camera moves and new images are captured. This real-time feedback mechanism allows the system to adapt to the actual scanning progress and adjust the planned poses dynamically, ensuring optimal data collection efficiency and reducing unnecessary processing time.
2Adaptability or versatility
If the user manually operates the camera to capture images, then flexibility in positioning is improved, but the likelihood of under-sampling or over-sampling increases
Solution Approach 1:
The system provides feedback to the user by displaying the guidance map and recommended camera poses. This feedback guides the user's manual operation, ensuring that the camera is positioned optimally for each capture. The user retains flexibility in manual positioning while the system's guidance ensures accurate sampling, combining human adaptability with computational precision.
Solution Approach 2:
The guidance map acts as an intermediary between the system's computational planning and the user's manual operation. It translates complex geometric and viewing considerations into simple, actionable recommendations for the user, bridging the gap between automated precision and manual flexibility.
3Manufacturing precision
If the camera captures images from multiple views to avoid holes and gaps in the model, then the completeness of the 3D model is improved, but the amount of redundant data increases
Solution Approach 1:
The system performs preliminary computation of the guidance map to identify the minimum necessary set of camera poses that will achieve complete coverage. This pre-planning ensures that the camera captures images only from positions that contribute new information to the 3D model, avoiding redundant data collection while ensuring completeness.
Solution Approach 2:
The system extracts and focuses on the essential viewing positions needed for complete model construction. By analyzing the object's geometry and the camera's field of view, the guidance map identifies and extracts only the critical poses that will capture all necessary surface information, eliminating redundant captures.
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
A three-dimensional scanning system includes: a camera configured to capture images; a processor; and memory coupled to the camera and the processor, the memory being configured to store: the images captured by the camera; and instructions that, when executed by the processor, cause the processor to: control the camera to capture one or more initial images of a subject from a first pose of the camera; compute a guidance map in accordance with the one or more initial images to identify one or more next poses; control the camera to capture one or more additional images from at least one of the one or more next poses; update the guidance map in accordance with the one or more additional images; and output the images captured by the camera to generate a three-dimensional model.