Parameterized Avatar Generation Using Machine Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional avatar generation systems are tedious for users to select cartoon features and often fail to accurately preserve identities and expressions, especially in non-photorealistic styles, leading to low-quality avatar images.

Innovation Solution

A parameterized avatar generation system using a trained machine-learning model that identifies corresponding cartoon features from a library, enabling animation and editing, and producing avatars in various styles while maintaining identity and expression accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional avatar generation systems use user-selectable cartoon features, then users can customize their avatars, but the selection process becomes tedious and time-consuming

Engineering Contradiction:
Improveavatar customizationVSAvoidselection process time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system automatically generates avatar parameters by analyzing the user's photograph without requiring manual selection. The machine learning model extracts facial features and automatically configures the avatar, allowing the system to serve itself rather than requiring continuous user input for each parameter.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary analysis of the user's photograph to pre-determine avatar parameters before the user needs to use the avatar. By processing the image in advance and extracting relevant features, the system prepares the avatar configuration ahead of time, eliminating the need for tedious selection during actual use.

Inventive Principle:
Principle #10Preliminary action

2Extent of automation

If conventional systems use machine-learning models to convert photorealistic images to cartoon avatars, then automation is improved, but identity and expression preservation deteriorates in non-photorealistic styles

Engineering Contradiction:
Improveavatar generation automationVSAvoididentity preservation accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The system extracts specific facial parameters (landmarks, contours, expressions) from the photorealistic image and applies them to control the cartoon avatar generation process. By changing from direct image conversion to parameter-based control, the system maintains precise identity information while allowing flexible stylistic transformation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system introduces an intermediate representation layer that captures essential identity and expression parameters from the input photograph. This intermediate parameter set acts as a mediator between the photorealistic input and the cartoon-style output, preserving critical identity information while enabling stylistic transformation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If conventional systems produce cartoon avatars in photorealistic styles, then image quality is improved, but adaptability to various cartoon styles is reduced

Engineering Contradiction:
Improveavatar image qualityVSAvoidcartoon style variety
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The system separates the avatar generation process into distinct components: identity parameter extraction, expression parameter extraction, and style-specific rendering. This segmentation allows the same extracted parameters to be applied across multiple cartoon styles while maintaining high image quality through specialized rendering for each style.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates a universal parameter representation that can serve multiple cartoon styles. By extracting style-agnostic facial parameters and expressions, the system enables a single avatar model to be adapted to various cartoon styles (anime, cartoon, illustration, etc.) while maintaining consistent identity and high quality across all styles.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10607065B2Generation of parameterized avatars
Publication Date: 2020.03.31 ADOBE INC
  • US10607065B2 patent drawing
  • US10607065B2 patent drawing
  • US10607065B2 patent drawing

AI summary

Generation of parameterized avatars is described. An avatar generation system uses a trained machine-learning model to generate a parameterized avatar, from which digital visual content (e.g., images, videos, augmented and/or virtual reality (AR/VR) content) can be generated. The machine-learning model is trained to identify cartoon features of a particular style—from a library of these cartoon features—that correspond to features of a person depicted in a digital photograph. The parameterized avatar is data (e.g., a feature vector) that indicates the cartoon features identified from the library by the trained machine-learning model for the depicted person. This parameterization enables the avatar to be animated. The parameterization also enables the avatar generation system to generate avatars in non-photorealistic (relatively cartoony) styles such that, despite the style, the avatars preserve identities and expressions of persons depicted in input digital photographs.