Virtual Avatar Mannerism Detection and Animation Update
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual avatars lack the ability to be fully personalized, as customization requires manual selection from predefined lists, limiting their realism and life-likeness, and they do not automatically adapt to user mannerisms.
Innovation Solution
A computer-implemented method that processes user input data, such as images and audio, to determine user mannerisms and updates the virtual avatar's poses and animations automatically, using machine learning algorithms like artificial neural networks to create unique and realistic representations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If manual selection from predefined lists is used for avatar customization, then the ease of operation is improved, but the adaptability and realism of the avatar deteriorates
Solution Approach 1:
The system automatically captures user mannerisms through cameras and microphones, processes the data to identify unique characteristics, and applies them to the virtual avatar without requiring manual user selection. The avatar self-adapts to the user's actual behavior patterns, eliminating the need for manual customization while achieving high personalization.
Solution Approach 2:
The manual mechanical process of selecting from predefined lists is replaced with an automated system using cameras, microphones, and machine learning algorithms. The system captures audio and video data, processes it to identify user mannerisms, and automatically updates the avatar's poses and animations to match the user's actual behavior.
2Ease of manufacture
If stock animations and poses are used for the virtual avatar, then the ease of manufacture is improved, but the realism and life-likeness of the avatar deteriorates
Solution Approach 1:
The system transitions from static stock animations to dynamic, adaptive avatar behavior. The avatar's poses and animations automatically adjust in real-time based on captured user mannerisms, allowing the avatar to dynamically adapt to the user's actual behavior patterns rather than being limited to predetermined motions.
Solution Approach 2:
The system changes the parameters of the avatar's animations and poses based on processed user data. By analyzing audio and video input to identify user mannerisms, the system modifies the avatar's movement parameters, facial expressions, and poses to match the user's actual behavior, thereby enhancing realism while maintaining production efficiency through automated parameter adjustment.
3Productivity
If automated update of avatar poses and animations is implemented, then the productivity and personalization efficiency are improved, but the device complexity increases
Solution Approach 1:
The system uses multi-functional input devices (cameras and microphones) that serve multiple purposes: capturing user mannerisms for avatar customization, and potentially other applications. The processing system handles multiple tasks including audio analysis, video analysis, mannerism identification, and avatar updates through a unified architecture, reducing overall system complexity despite the automated personalization capability.
Data Source
AI summary
There is described a computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising; providing a virtual avatar associated with a user, wherein the virtual avatar is associated with a plurality of poses and a plurality of animations; receiving input data associated with the user from at least one input source; processing the input data, the input data comprising images of the user and/or audio data captured from the user; determining a user mannerism from the processed input data; and updating at least one of the plurality of poses and/or animations of the virtual avatar, or creating a new pose and/or animation, to apply the user mannerism to the virtual avatar. There is also described a computing device configured to carry out the computer-implemented method.