3D Object Scanning Plane Segmentation Mesh Completion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D object scanning technologies face challenges in generating complete models of objects on planar surfaces, as the support plane often occludes the bottom portion, leading to incomplete or hollow artifacts in the 3D model.
Innovation Solution
The system employs tracking-based object segmentation and mesh completion processing, integrating plane detection into a tracking system to reconstruct objects without the plane, and uses boundary remeshing to generate a refined mesh for the occluded portion, ensuring a closed and complete 3D model.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If traditional 3D object scanning is used to capture objects on planar surfaces, then the scanning process is simple, but the resulting 3D model is incomplete with hollow artifacts at the bottom portion
Solution Approach 1:
The patent segments the object from its supporting plane by detecting the plane's location and masking it out during 3D reconstruction. This separation allows independent processing of the object geometry, eliminating the hollow artifact problem caused by plane interference while maintaining a relatively simple scanning setup.
Solution Approach 2:
The patent introduces plane detection and segmentation as intermediary processing steps between data capture and 3D model generation. By detecting the supporting plane and using it to segment the object, the system mediates the interference between the plane and object, enabling complete reconstruction without complicating the physical scanning apparatus.
2Reliability
If the support plane is included in the scanning field, then the object is stable during scanning, but the plane occludes the bottom portion of the object causing incomplete models
Solution Approach 1:
The patent extracts the supporting plane information from the scanning data through plane detection algorithms. By identifying and separating the plane's geometric contribution, the system removes the occluding element digitally while the physical plane remains in place to provide stability during the scanning process.
Solution Approach 2:
The patent transitions from 2D image space to 3D reconstruction space, using plane detection in the 2D domain to inform segmentation in the 3D reconstruction process. This dimensional transformation allows the system to account for and compensate for plane occlusion that appears in 2D views but affects 3D completeness.
3Manufacturing precision
If tracking-based segmentation is used to remove the plane, then the 3D model completeness improves, but computational complexity increases
Solution Approach 1:
The patent performs plane detection and segmentation preparation in advance during the scanning process itself, rather than as a separate post-processing step. By establishing the plane model and segmentation masks during data capture, the system reduces the computational burden of later reconstruction while maintaining high segmentation accuracy.
Solution Approach 2:
The tracking-based segmentation system uses the object's own visual features and the plane's consistent geometric properties to automatically maintain accurate segmentation throughout the scanning process. This self-correcting mechanism reduces the need for external computational intervention and minimizes processing requirements while preserving segmentation precision.
Data Source
AI summary
Techniques are provided for generating three-dimensional models of objects from one or more images or frames. For example, at least one frame of an object in a scene can be obtained. A portion of the object is positioned on a plane in the at least one frame. The plane can be detected in the at least one frame and, based on the detected plane, the object can be segmented from the plane in the at least one frame. A three-dimensional (3D) model of the object can be generated based on segmenting the object from the plane. A refined mesh can be generated for a portion of the 3D model corresponding to the portion of the object positioned on the plane.