Avatar Facial Expression Generation with Transition Configurations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for simulating facial expressions in virtual reality and augmented reality struggle to accurately transition between different emotions, often resulting in abnormal expressions due to the difficulty in identifying facial features and the abrupt switching of emotions.
Innovation Solution
An avatar facial expression generating system that determines and transitions between emotional configurations based on user data, using a processor to generate facial expressions over specific durations, incorporating a transition emotional configuration to smoothly change between first and second emotional configurations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a camera is disposed to capture the face of a user with a head-mounted display (HMD), then facial features can be identified for generating simulated facial expressions, but a part of the face is covered by the HMD making it hard to identify facial features and facial expressions
Solution Approach 1:
The patent introduces an intermediary solution by using alternative sensors (such as depth sensors, infrared sensors, or other non-visible spectrum sensors) to detect facial features and expressions. These sensors can penetrate or work around the HMD obstruction, serving as a mediator to capture facial data without being blocked by the display device.
2Productivity
If the facial expression of an avatar is forced to be switched from one emotion to another emotion in response to a change of emotions, then the avatar can respond to emotional changes, but an abnormal facial expression may be presented on the avatar
Solution Approach 1:
The patent applies preliminary action by pre-defining multiple intermediate emotional states and transition paths between different emotions. When an emotional change is detected, the system proactively transitions through these pre-planned intermediate states rather than making abrupt jumps, ensuring smooth and natural facial expression changes while maintaining responsive behavior.
3Measurement precision
If multiple facial expressions of human are considered with significant difference between two facial expressions with different emotions, then accurate emotional representation is achieved, but the transition between emotions becomes complex and difficult to manage
Solution Approach 1:
The patent segments the complex emotional transition space by dividing it into multiple discrete emotional states arranged in a hierarchical or topological structure. Each emotion is broken down into controllable states with defined transition rules, allowing the system to manage complex emotional representations through a structured, modular approach rather than treating emotions as a monolithic complex system.
Data Source
AI summary
An avatar facial expression generating system and a method of avatar facial expression generation are provided. In the method, user data relating to sensing result of a user is obtained. A first and a second emotional configurations are determined. The first and second emotional configuration maintain during a first and a second duration, respectively. A transition emotional configuration is determined based on the first emotional configuration and the second emotional configuration, in which the transition emotional configuration maintains during a third duration. Facial expressions of an avatar are generated based on the first emotional configuration, the transition emotional configuration, and the second emotional configuration, respectively. The third duration exists between the first duration and the second duration. Accordingly, a normal facial expression on an avatar would be presented while encountering the emotion transformation.