3D Facial Model Reconstruction for Synchronized Special Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for adding special effects to user videos, such as eyelash effects, often result in positional offsets during head rotation, failing to universally match faces due to the use of two-dimensional feature points and standard displacements.
Innovation Solution
A method and device for reconstructing a facial model by determining an anchor point for a three-dimensional special effect element, attaching it to a corresponding attachment point on a three-dimensional facial model, and moving the anchor point to the center of the model's world coordinate system, allowing the special effect element to bind with the facial model and move synchronously with facial actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If two-dimensional feature points and standard displacement are used to attach special effect elements, then the attachment process is simple, but positional offsets occur during head rotation and universal matching fails
Solution Approach 1:
The patent transitions from two-dimensional feature point attachment to three-dimensional model-based attachment. By constructing a 3D facial model with depth information and using 3D coordinate systems, the special effect elements can be positioned accurately in three-dimensional space, preventing positional offsets during head rotation while maintaining universal matching capability across different users.
Solution Approach 2:
The patent changes the coordinate system parameters from 2D to 3D, introducing depth information and world coordinate system transformations. This parameter change enables the special effect elements to maintain correct spatial relationships during head rotation, resolving the position accuracy issue while keeping the attachment process manageable through automated 3D model construction.
2Reliability
If three-dimensional models and coordinate system transformations are used to attach special effect elements, then position accuracy during head rotation is improved, but the device complexity increases
Solution Approach 1:
The patent performs preliminary construction of the three-dimensional facial model before the actual attachment process. By pre-establishing the 3D model, feature points, and world coordinate system transformations, the system prepares all necessary spatial relationships in advance. This preliminary action simplifies the runtime attachment process while ensuring position accuracy during head rotation, as the complex 3D transformations are already computed and stored.
Data Source
AI summary
A facial model reconstruction method and apparatus, and a medium and a device are provided. The facial model reconstruction method comprises: determining an anchor point of a three-dimensional special effect element to be attached on a face; determining an attachment point on a three-dimensional facial model to which the three-dimensional special effect element is to be attached, wherein the three-dimensional facial model corresponds to the face; attaching the anchor point to the attachment point in a way that the anchor point overlaps the attachment point; and moving the anchor point to a center of a world coordinate system of the three-dimensional facial model, and binding the 3D special effect element with the 3D facial model.