Virtual Avatar Customization via Facial Feature Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual avatar customization systems require manual input from users to update the appearance of their avatars, which can be time-consuming and inefficient, especially when dealing with large amounts of image data that includes irrelevant information.

Innovation Solution

A computer-implemented method for real-time customization of virtual avatars using data models that process input audio and image data to automatically update the avatar's appearance by detecting predefined features, such as facial or body characteristics, through techniques like facial detection and feature recognition, without manual user intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If manual customization options are provided for virtual avatar appearance, then user personalization capability is improved, but time consumption and operational complexity increase

Engineering Contradiction:
Improveavatar personalization capabilityVSAvoidcustomization time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system automatically extracts features from user images and applies them to customize the virtual avatar without requiring manual user input. The data model processes the image data and determines avatar features autonomously, allowing the system to serve itself in the customization process.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The manual mechanical process of selecting avatar features is replaced by an automated data model that uses image processing and feature recognition algorithms to automatically determine and apply avatar characteristics based on user-provided images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If complete image data including surroundings is processed, then comprehensive user context is captured, but data processing time and computational resources increase

Engineering Contradiction:
Improveuser context informationVSAvoiddata processing efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system extracts only the relevant user image data from the complete image input, separating the user's appearance features from the surrounding environment. This extraction focuses processing resources on the essential information needed for avatar customization while discarding irrelevant contextual data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The image processing is segmented into distinct stages: initial image reception, user identification and extraction, feature detection, and avatar application. This segmentation allows the system to process only the necessary portions of the image data at each stage, improving overall processing efficiency.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240193836A1Method and system for customization of a virtual avatar
Publication Date: 2024.06.13 SONY INTERACTIVE ENTERTAINMENT LLC
  • US20240193836A1 patent drawing
  • US20240193836A1 patent drawing
  • US20240193836A1 patent drawing

AI summary

A computer-implemented system and method for real-time customization of a virtual avatar, comprising providing a virtual avatar associated with a user, receiving an image of the user and at least a portion of their surroundings, applying a facial detection algorithm to detect the user's face in the image, extracting a region of interest from the image, the region of interest including the user's face, providing the region of interest to a data model, processing the region of interest, by the data model, and using feature recognition to determine whether the region of interest comprises a feature from a set of predefined features. In response to determining that the region of interest comprises a feature from a set of predefined features, the appearance of the virtual avatar is updated.