2D Virtual Character Face Warping for Real-Time Expression Imitation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 2D virtual roles in applications lack the ability to imitate real-time facial expressions, limiting the sense of presence and engagement for users, particularly in gaming and social interactions.
Innovation Solution
A method and apparatus that utilize a warping control parameter to generate and display a virtual role's face image based on a user's real-time facial expressions, using a warping image set and a face parameter to create a dynamic and interactive virtual role experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If 2D virtual roles use predetermined avatar images, then the implementation is simple and fast, but the ability to imitate real-time facial expressions is lost
Solution Approach 1:
The virtual role's face is divided into multiple controllable regions (eyes, eyebrows, mouth, cheeks) that can be independently warped. This segmentation allows the system to apply specific expression transformations to different facial regions based on detected user facial movements, enabling realistic expression imitation without requiring a completely complex 3D model.
Solution Approach 2:
The patent transforms static predetermined avatar images into dynamic expressions by applying real-time warping transformations. The virtual role's facial features are dynamically adjusted based on detected user facial movements, allowing the 2D image to exhibit lifelike expression changes without transitioning to a 3D model.
2Reliability
If 3D virtual roles are used to improve expression realism, then the sense of presence is enhanced, but the computational load and processing time increase significantly
Solution Approach 1:
Instead of using complex 3D models, the patent creates a 2D copy or representation of the virtual role's face that can be rapidly transformed. By warping a 2D facial image based on detected expressions, the system achieves realistic expression representation without the computational burden of rendering and animating 3D models in real-time.
3Adaptability or versatility
If real-time facial expression detection is implemented, then user engagement is improved, but the device complexity and processing requirements increase
Solution Approach 1:
The patent extracts only the essential facial expression information from the user's face (key facial landmarks and movement patterns) rather than processing the entire facial image or using complex AI models. This extraction approach enables real-time expression detection with reduced computational requirements by focusing only on the critical features needed for warping the virtual role's face.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
The present disclosure discloses a method and apparatus for displaying a face of a virtual role, a terminal, and a storage medium, and relates to the field of human-machine interaction. The method includes: obtaining a face parameter corresponding to a user face, the face parameter being used for indicating a facial feature of a corresponding face region of the user face; determining a warping control parameter according to the face parameter, the warping control parameter being used for indicating a warping degree of a corresponding face region of a virtual role; generating a virtual role face image according to the warping control parameter and a warping image set, the warping image set including a basic face image and at least one basic warping face image of the virtual role, and displaying the virtual role face image.