Forearm Skin Rotation Tracking for Natural Virtual Live Animation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual live streaming methods fail to synchronize the detailed actions of a physical object to a virtual model, resulting in unnatural actions of the virtual model in live videos.
Innovation Solution
Acquire real-time feature data of a physical object's forearm, control the rotation angles of the virtual model's forearm skin based on these data, and generate live video frames accordingly, correlating the angles with distances from the elbow joint to ensure natural synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If simple redirection technology is used to synchronize physical object actions to virtual model, then the overall posture synchronization is achieved, but the action details cannot be synchronized resulting in unnatural virtual model actions
Solution Approach 1:
The forearm is divided into multiple parts (wrist, middle part, elbow) with independent rotation angle tracking. Each part's rotation angle around the axial direction is captured separately and positively correlated with its distance from the elbow joint, enabling detailed action synchronization rather than overall posture only
Solution Approach 2:
The patent adds rotational dimension tracking around the axial direction of the forearm. By capturing rotation angles in addition to positional information, the system achieves more comprehensive action detail synchronization, making virtual model actions more natural
Data Source
AI summary
The method includes acquiring first feature data of a physical object in real time, where the physical object includes a torso, a main arm, an elbow joint, and a forearm, the first feature data is configured for representing rotation angles of multiple parts of the forearm around an axial direction, and the rotation angles of the multiple parts of the forearm around the axial direction are positively correlated with distances from the multiple parts of the forearm to the elbow joint of the physical object; controlling rotation angles of multiple parts of the forearm skin of a virtual model around an axis direction based on the first feature data acquired in real time, where the rotation angles of the multiple parts of the forearm skin around the axial direction are positively correlated with distances from the multiple parts of the forearm skin to the elbow joint of the virtual model; and generating the image frame of the live video according to the virtual model and the rotation angles of the multiple parts of the forearm skin of the virtual model around the axis direction.