3D Avatar Generation via Optimal Transport Mesh Deformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The manual design of three-dimensional (3D) avatars in online virtual communities is impractical due to the growing number of users, as it requires extensive manual creation of virtual assets by artists and special effects designers, and existing AI-generated content models face limitations in domain adaptation and require large training datasets.

Innovation Solution

The method employs optimal transport functions for mesh deformation to generate intermediate 3D objects through interpolation or extrapolation based on identified 3D objects of interest, allowing for efficient customization of avatars by processing devices, which can present these objects to users for selection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual design is used to create 3D avatars and virtual assets, then customization quality and artistic control are improved, but productivity and scalability deteriorate due to the growing number of users

Engineering Contradiction:
Improvecustomization qualityVSAvoidavatar generation efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system enables users to automatically generate their own 3D avatars and virtual assets through self-service interfaces. Users can input basic parameters and the system automatically performs mesh deformation and texture generation, eliminating the need for manual design by artists while maintaining customization quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The invention transforms the avatar creation process from manual artistic design to automated parameter-based generation. By changing physical and geometric parameters of mesh structures and applying optimal transport functions, the system generates diverse 3D assets automatically while preserving artistic quality through controlled parameter adjustments.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If existing AI-generated content models are used, then productivity in generating 3D assets is improved, but adaptability to different domains deteriorates due to requirements for large training datasets

Engineering Contradiction:
Improveasset generation speedVSAvoiddomain adaptation capability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The invention extracts and utilizes geometric and structural features directly from input images and reference 3D models, rather than relying on large pre-trained datasets. By extracting key geometric constraints and mesh deformation patterns, the system achieves domain adaptability without requiring extensive training data from specific domains.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system introduces an intermediary optimal transport function that bridges different domains and styles. This mathematical framework acts as a mediator that can adaptively transform source 3D assets into target domains while preserving geometric consistency, enabling versatility across different applications without domain-specific retraining.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If optimal transport functions are used for mesh deformation, then adaptability in generating diverse 3D objects is improved, but device complexity increases

Engineering Contradiction:
Improve3D object generation flexibilityVSAvoidcomputational system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The invention replaces complex mechanical or manual mesh manipulation systems with optimal transport mathematical functions. By substituting the traditional mechanical approach of manual mesh editing with a mathematical optimization framework, the system achieves high adaptability in generating diverse 3D objects while managing computational complexity through efficient algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Manufacturing precision

If manual design processes are used for each user, then customization quality is maintained, but loss of time increases significantly with growing user base

Engineering Contradiction:
Improveavatar customization qualityVSAvoiddesign time per user
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-processing input images to extract geometric features and pre-defining mesh structures before actual avatar generation. This preliminary preparation enables rapid customization for each user while maintaining quality, as the computationally intensive work is done once and reused across multiple user customizations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240355052A1Automatic 3D avatar generation by mesh deformation based on optimal transport function
Publication Date: 2024.10.24 SAMSUNG ELECTRONICS CO LTD
  • US20240355052A1 patent drawing
  • US20240355052A1 patent drawing
  • US20240355052A1 patent drawing

AI summary

A method includes obtaining, using at least one processing device of an electronic device, an identification of multiple three-dimensional (3D) objects of interest. The method also includes generating, using the at least one processing device, multiple intermediate 3D objects based on the 3D objects of interest using optimal transport, where the intermediate 3D objects are generated using interpolation or extrapolation based on shapes of the 3D objects of interest. The method further includes presenting, using the at least one processing device, one or more of the intermediate 3D objects to a user.