3D Hand Model Reconstruction From Self-Captured Wrist Rotation Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for generating 3D hand models require assistance and are not suitable for real-time, self-operated digital reconstruction of a user's hand in consumer scenarios, leading to inaccurate and time-consuming results.
Innovation Solution
A method involving a user rotating their wrist joint from a first angle to a second angle while maintaining a hand posture, capturing images to create a 3D hand model based on hand movement video, optimizing key point parameters using curvature information, and attaching a hand texture map to enhance realism.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If 360-degree photos are taken to generate 3D hand model, then the model can be created in advance for online publication, but the method requires assistance from other people and is not suitable for real-time self-operated creation by C-end users
Solution Approach 1:
The patent transforms the static 360-degree photo shooting process into a dynamic video-based process. Instead of requiring the hand to remain stationary for multiple photos, the system captures a video of the hand rotating naturally, converting a complex multi-step photographic process into a single continuous capture that users can perform independently.
Solution Approach 2:
The system enables users to capture their own hand data independently without requiring assistance from others. The video capture process is designed to be user-friendly, allowing C-end users to complete the entire hand model creation process by themselves through simple wrist rotation movements.
2Productivity
If 360-degree photos are used for hand reconstruction, then the process can be completed in advance, but the method is time-consuming and not suitable for real-time applications
Solution Approach 1:
The system performs preliminary processing by extracting key frame images from the captured video and generating the 3D hand model structure during the capture phase itself. This preliminary action reduces the post-processing time significantly, enabling real-time or near-real-time model generation rather than requiring lengthy offline processing of 360-degree photos.
Solution Approach 2:
The patent skips the time-consuming steps of traditional 360-degree photo processing by directly utilizing video frame sequences. Instead of processing multiple high-resolution photos individually, the system rapidly processes a continuous video stream, rushing through the data acquisition and initial processing stages to achieve faster model generation.
3Measurement precision
If conventional 360-degree photo method is used, then the hand model can be created for online publication, but the reconstruction accuracy is insufficient for high-precision applications
Solution Approach 1:
The patent transitions from 2D photo-based reconstruction to 3D video-based reconstruction. By utilizing the temporal dimension of video sequences and capturing hand movements from multiple angles continuously, the system achieves higher measurement precision for hand model reconstruction compared to static 360-degree photo methods.
Data Source
AI summary
A method including acquiring a hand movement video obtained by capturing images during a process in which a target user rotates a wrist joint from a first angle to a second angle while maintaining a hand posture with five fingers naturally extended, so that the hand movement video comprises a plurality of image content frames captured during a rotation process of the hand from a front/side view to a side/front view; acquiring curvature information of the fingers and/or nails from the plurality of image content frames acquired during the rotation process; and creating a 3D hand model of the target user based on the hand movement video, and optimizing key point parameters of the fingers and/or nails in the 3D hand model based on the curvature information of the fingers and/or nails. The present disclosure enables digital reconstruction of the hand and improve the reconstruction accuracy of the hand.