Emotion-Driven Character Motion Selection for Natural Animation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing motion generation systems for CG characters struggle to create synchronized and emotionally nuanced animations, as they rely on pre-assigned motions that fail to account for the speaker's emotion, leading to unnatural character interactions.
Innovation Solution
An information processing apparatus and method that analyzes the utterance sentence to determine the character's emotion and selects appropriate motions synchronized with the voice output timing, reducing the burden on creators by using pre-defined motion sets based on word classes and emotions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If pre-assigned motions are used for words, then the motion generation process is simplified, but the motions fail to synchronize with the speaker's emotion and utterance timing
Solution Approach 1:
The system dynamically selects motions based on detected emotions and utterance timing rather than using static pre-assigned motions. The motion selection changes adaptively according to the emotional state and temporal context of each utterance, resolving the contradiction between simplicity and precision.
Solution Approach 2:
The system changes motion selection parameters based on emotion detection results and timing information. By varying the motion parameters according to emotional intensity and utterance timing, the system achieves both ease of use and high synchronization precision.
2Manufacturing precision
If emotions are detected and motions are dynamically selected, then motion synchronization with emotion is improved, but the processing complexity increases
Solution Approach 1:
The processing system is segmented into distinct functional modules: emotion detection module, utterance analysis module, motion selection module, and timing adjustment module. This segmentation reduces overall complexity by making each module independent and specialized.
Solution Approach 2:
An intermediary processing layer is introduced that translates emotional detection results and utterance analysis into motion selection parameters. This intermediary simplifies the connection between emotion detection and motion execution, reducing system complexity.
3Ease of manufacture
If pre-defined motion sets are used, then the burden on creators is reduced, but the emotional nuance in character animations is lost
Solution Approach 1:
The pre-defined motion sets are designed to be universal and multi-functional, capable of expressing multiple emotions through parameter variation. Each motion set can adapt to different emotional contexts, maintaining both ease of use and emotional versatility.
Solution Approach 2:
The system achieves emotional nuance by changing parameters within pre-defined motion sets rather than requiring completely different motions for each emotion. This allows creators to use simple pre-defined sets while the system adds emotional depth through parameter adjustment.
Data Source
AI summary
Provided are an information processing apparatus, an information processing method, and a program that make it possible to assign more natural motions reflecting the emotions of a character.[Solving Means]The information processing apparatus includes a control unit configured to perform the processing of: determining an emotion on the basis of a result of utterance sentence analysis performed on an utterance sentence of a character included in a scenario; selecting, depending on a content of the utterance sentence and the emotion determined, a motion of the character that is synchronized with the utterance sentence; adjusting a character movement speed based on the selected motion and an intimacy between the character and a user; and adding, to the scenario, a description for adjusting presentation of the selected motion to match a voice output timing of the utterance sentence.