Full-Body 3D Modeling Through Depth-Scan Point Cloud Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional 3D modeling techniques for human subjects, such as those using smartphones, face challenges with inaccurate camera pose estimation and minimal features, making it difficult to perform 3D reconstruction due to the need for alignment of point cloud fragments based on camera pose and feature detection.
Innovation Solution
A system using a user device with imaging sensors captures depth images as the user rotates, converting them into 3D point clouds, aligning and cleaning up the data to generate an accurate 3D model, which can be integrated with a parametric full-body model and enhanced by user input parameters for precise body measurements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If traditional body scanning techniques use RGB camera to scan user for 3D modeling, then the system can capture color image data, but the camera pose estimation becomes inaccurate and feature detection is minimal
Solution Approach 1:
The patent introduces depth sensors as an intermediary device to capture depth information, which serves as additional features for pose estimation and 3D reconstruction. The depth data acts as a mediator between the RGB camera and the 3D modeling process, providing rich geometric features that弥补 the lack of visual features in traditional RGB-based scanning.
2Ease of manufacture
If traditional techniques require alignment of point cloud fragments based on camera pose, then 3D reconstruction can be performed, but the process becomes difficult with minimal features
Solution Approach 1:
The patent segments the scanning process into multiple independent depth image captures, each providing localized 3D information. These segmented depth maps are then integrated through registration processes that leverage the inherent geometric features in depth data, making the overall reconstruction process more manageable and less dependent on global feature detection.
3Measurement precision
If multiple partial scans are used to represent greater body portions, then the 3D model accuracy improves, but the scanning process complexity increases
Solution Approach 1:
The patent creates a universal parametric body model that can represent different body portions and poses. This multi-functional model framework allows partial scans to be integrated into a complete body representation, where the same parametric model structure handles various scanning scenarios (full body, partial body, different poses) uniformly, reducing the complexity of managing multiple scan types.
Data Source
AI summary
Depth images acquired during a scan of one or more portions of a user's body may be used to determine a full-body three-dimensional (3D) representation of the user. Depth imaging data may be used to determine the full-body shape and contours of the user when rotating in front of a user device. Machine learning methods for pose detection may be used to determine the portion of the user's body being scanned, as well as the position and pose of the user's body. A point cloud alignment process that leverages knowledge of user behavior during the scan is used to determine parameters for a full-body representation of a user, which may be based on a plurality of partial scans of the user's body. A full-body representation of a user may be output and/or displayed along with accurate measurements determined for various portions of the user's body.