Virtual Avatar Control via Baseline-Dynamic Model Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for controlling virtual avatars in digital environments lack accuracy, resilience, and responsiveness, particularly in representing users' behaviors and emotions in real-time, especially when interacting with computer-generated entertainment environments.

Innovation Solution

A computer-implemented method that uses a base model to define a virtual avatar associated with a user profile, receiving input data from multiple multimedia sources, processing it to determine baseline and dynamic avatars, generating an output avatar by combining these, and updating the base model to render a more accurate and responsive virtual representation on a display screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If input data is received from a single input source, then the system is simpler to implement, but the system lacks resilience to network errors or faults with particular input sources

Engineering Contradiction:
Improveresilience to network errorsVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the input data acquisition by using multiple independent input sources (e.g., camera, microphone, sensors) rather than relying on a single source. Each input source operates independently, so if one fails or encounters network errors, others continue to provide data for avatar control.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system prepares multiple redundant input sources in advance to cushion against potential failures. By having backup input channels ready before errors occur, the system maintains resilience without adding complex error handling logic during operation.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Measurement precision

If the virtual avatar uses predefined behaviors only, then the system is more stable and predictable, but the avatar lacks accuracy in representing live user behaviors and emotions

Engineering Contradiction:
Improveaccuracy of user representationVSAvoidsystem stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system merges predefined avatar behaviors with live user behavior data from multiple input sources. The predefined behaviors provide a stable base model, while real-time data from cameras, microphones, and sensors adds accuracy by capturing actual user expressions, gestures, and emotions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system transitions from static predefined behaviors to dynamic behavior generation by continuously integrating real-time input data. This allows the avatar to adapt its expressions and actions dynamically while maintaining the structural stability of the base model through weighted combinations.

Inventive Principle:
Principle #15Dynamics

3Productivity

If the system processes data in real-time from multiple sources, then the avatar responsiveness improves, but the computational complexity and processing time increase

Engineering Contradiction:
Improveavatar responsivenessVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the processing of multiple input sources by handling each source independently and then combining results. This modular approach allows parallel processing of camera feed, audio input, and sensor data, improving responsiveness while managing computational complexity through division of labor.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If the base model is updated frequently with live data, then the avatar accuracy improves, but the system becomes more vulnerable to data quality issues and errors

Engineering Contradiction:
Improveavatar accuracyVSAvoidsystem resilience
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system cushions against data quality issues by maintaining a base model that is not overly dependent on any single live data source. The weighted combination approach ensures that even if one input source provides poor quality data, the overall avatar representation remains accurate through contributions from other sources and the predefined base model.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentEP4385592A1Computer-implemented method for controlling a virtual avatar
Publication Date: 2024.06.19 SONY COMP ENTERTAINMENT EURO LTD
  • EP4385592A1 patent drawingFigure 1~2
  • EP4385592A1 patent drawingFigure 3
  • EP4385592A1 patent drawingFigure 4

AI summary

A computer-implemented method for controlling a virtual avatar on an electronic device, the method comprising: providing a base model that defines a virtual avatar associated with a user profile corresponding to a user; receiving input data from at least one of a plurality of multimedia input sources; processing the input data; determining a baseline avatar and a dynamic avatar using the processed input data; generating an output avatar based on the determined baseline avatar and the determined dynamic avatar; updating the base model by adding the generated output avatar to the base model; and rendering the updated base model to display the virtual avatar on a display screen.