3D Human Body Reconstruction With Single-Image Texture Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for human-body reconstruction from a single image fail to achieve high accuracy and complete texture information, relying on complex setups and algorithms that are impractical for everyday scenarios.
Innovation Solution
A method that segments an input image to generate an initial 3D model and recover complete texture information using a texture generation model, such as InferGAN, based on a single frame of a human body image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a complicated apparatus and reconstruction algorithm are applied, then reconstruction accuracy may be improved, but device complexity and ease of operation deteriorate
Solution Approach 1:
The patent uses a pre-built 3D human body model as a template or copy, which is then adapted to match the input image. Instead of reconstructing the 3D model from scratch using complex algorithms, the system copies an existing model and modifies it to fit the target subject, thereby achieving accurate reconstruction with simpler processing
Solution Approach 2:
The patent transforms the 3D model by adjusting its parameters (such as shape, pose, and texture) to match the input image characteristics. This parameter-based adaptation allows the system to achieve high reconstruction accuracy by modifying a standard model rather than building a complex reconstruction pipeline
2Ease of operation
If a single frame image is used for reconstruction, then ease of operation is improved, but measurement precision and completeness of texture information deteriorate
Solution Approach 1:
The system copies a complete 3D human body model template and adapts it to the single input image. This copying approach allows the system to inherit complete texture and geometric information from the template, compensating for the limitations of single-frame input and achieving both simplicity and accuracy
3Ease of operation
If a single frame image is used for reconstruction, then ease of operation is improved, but manufacturing precision of texture information deteriorates
Solution Approach 1:
The patent copies complete texture information from a pre-built 3D model template and maps it to the reconstructed model. This allows the system to achieve complete texture information (including areas not visible in the single input image) while maintaining the simplicity of single-frame operation
Solution Approach 2:
The system performs preliminary preparation by pre-building comprehensive 3D models with complete texture information before the actual reconstruction process. This preliminary action ensures that all necessary texture data is available beforehand, allowing complete texture reconstruction from a single image without requiring multiple views
Data Source
Figure 1~3
Figure 4~6
Figure 7~9
AI summary
A human body model reconstruction method and reconstruction system, and a storage medium. The human body model reconstruction method comprises: acquiring a target image, and performing segmentation processing on the basis of an object, to be reconstructed, in the target image, so as to obtain a segmented image, wherein the target image is a frame of front image corresponding to said object; respectively obtaining an initial estimate shape and texture information of said object on the basis of the segmented image; determining an initial three-dimensional model of said object according to the initial estimate shape, wherein the initial three-dimensional model is a three-dimensional model without a texture; obtaining complete texture information of said object according to the texture information and a texture generation model; and generating a three-dimensional reconstruction model of said object on the basis of the initial three-dimensional model and the complete texture information, wherein the three-dimensional reconstruction model is a three-dimensional model with a texture.