Automated Audio-Visual Avatar Evaluation for Naturalness Scoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for evaluating virtual avatars rely heavily on human intervention, leading to inefficiencies, errors, and high costs due to the need for skilled labor, and lack automated methods for ensuring high levels of naturalness and quality in virtual avatars.

Innovation Solution

An automated evaluation system and method that combines audio and video metrics to assess the naturalness and quality of avatars, using an evaluation module with audio and video evaluators to generate combined scores based on comparisons with target person features.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual evaluation methods are used to assess avatar naturalness and quality, then evaluation accuracy can be maintained through human judgment, but the process becomes time-consuming and requires extensive skilled labor

Engineering Contradiction:
Improveevaluation accuracyVSAvoidevaluation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual human evaluation with an automated evaluation module that uses audio and video metrics to assess avatar naturalness and quality. The system extracts audio features from target person and generated avatar, compares them using audio metrics, and similarly processes video features, ultimately generating evaluation scores without human intervention.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an evaluation module as an intermediary between the avatar generator and the final assessment. This module acts as a mediator that automatically compares audio and video features using predefined metrics, generating evaluation results that bridge the gap between raw data and quality assessment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If manual evaluation systems are deployed to ensure avatar quality, then detailed assessment can be performed, but the cost increases due to required skilled labor

Engineering Contradiction:
Improveavatar quality assuranceVSAvoidcost-effectiveness
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The evaluation system is self-service in nature, automatically performing quality assessment without requiring external human evaluators. The system extracts features, compares them using predefined metrics, and generates evaluation scores autonomously, eliminating the need for skilled labor while maintaining reliable quality assurance.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces expensive manual evaluation processes with an automated computational system that uses audio and video feature extraction and comparison. This substitution eliminates the need for skilled human evaluators while maintaining consistent and reliable quality assessment across multiple avatars.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If automated evaluation systems are implemented to reduce time and cost, then efficiency improves, but the system complexity increases due to multiple evaluation components

Engineering Contradiction:
Improveevaluation efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The evaluation system is segmented into distinct functional components: an audio evaluator that processes audio features and generates scores, a video evaluator that processes video features and generates scores, and a score combination module that integrates these evaluations. This segmentation allows each component to be independently optimized while maintaining overall system efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The evaluation module serves multiple functions within a single integrated system: it extracts audio features, extracts video features, compares features using audio metrics, compares features using video metrics, combines evaluation scores, and generates final assessment results. This multi-functionality reduces the need for separate systems while maintaining evaluation efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12456180B2System and method for an audio-visual avatar evaluation
Publication Date: 2025.10.28 SIT AUTONOMOUS AG
  • US12456180B2 patent drawing
  • US12456180B2 patent drawing
  • US12456180B2 patent drawing

AI summary

The present disclosure relates to a system to evaluate an avatar generated by an avatar generator. The system comprises an evaluation module including an audio evaluation module for evaluating audio features and a video evaluation module for evaluating video features. Evaluation of the avatar includes extracting audio and video features from the avatar and applying a set of evaluation metrics for generating audio and video evaluation scores. The scores are combined to generate a final score. For avatar generator evaluation, audio clip and video clip are provided to the audio evaluation module and video evaluation module, respectively. A set of evaluation metrics is applied for evaluation. Each metric can generate a score. All scores are combined to generate a final evaluation score.