Real-Time Face Mapping in Video Game Characters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video game streaming technologies lack personalized interaction and realistic player representation, as they often use static images for character faces, failing to dynamically reflect players' expressions and emotions in real-time.

Innovation Solution

The use of live camera video to generate a character's face, allowing for real-time expression changes and personalized player representation by integrating facial detection and cropping processes to ensure dynamic and accurate reflection of players' emotions within the game.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If static images are used for character faces, then device complexity is reduced, but realism and player representation are worsened

Engineering Contradiction:
Improvesystem complexityVSAvoidrealism accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies the copying principle by capturing the player's face via webcam and using that visual copy to generate the character's face in real-time. The system extracts facial features from the player's image and replicates them in the game character, creating an accurate visual representation without requiring complex 3D scanning or manual modeling processes.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces traditional mechanical or manual character creation methods with automated computer vision and machine learning systems. Instead of requiring manual 3D modeling or complex hardware scans, the system uses software-based facial recognition and neural networks to automatically generate character faces from simple webcam images, reducing hardware complexity while improving realism.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If live camera video is used to generate character faces, then realism and player representation are improved, but device complexity and processing requirements are worsened

Engineering Contradiction:
Improverealism accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the complex task of real-time face generation into separate processing stages: (1) capturing facial data via webcam, (2) extracting facial features using computer vision algorithms, (3) processing and manipulating the extracted features, and (4) rendering the final character face. This modular approach reduces overall system complexity by making each stage independently optimizable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses an intermediary processing layer between the webcam capture and the final character rendering. This intermediary layer includes facial feature extraction modules and neural network processors that translate raw camera data into game-ready character faces, simplifying the overall system architecture by introducing a dedicated processing middleman.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If facial detection and cropping processes are integrated, then player representation accuracy is improved, but processing time and system complexity are worsened

Engineering Contradiction:
Improvefacial detection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-processing facial detection and cropping operations before the main character rendering cycle. The system continuously monitors and extracts facial features in advance, storing processed facial data for rapid application when needed. This pre-computation approach reduces real-time processing requirements and improves responsiveness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic adjustment of processing intensity based on real-time needs. The facial detection and cropping processes operate at variable resolutions and frequencies, intensifying processing when high accuracy is needed and reducing processing during normal operation. This dynamic scaling optimizes the balance between accuracy and processing time.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11344816B2Video game waiting queue and audience interaction
Publication Date: 2022.05.31 AMAZON TECH INC
  • US11344816B2 patent drawing
  • US11344816B2 patent drawing
  • US11344816B2 patent drawing

AI summary

Live camera video of video game players may be captured. Portions of the live video that include the player's faces may be inserted into the faces of characters that are controlled by the players and displayed in real-time. The players may stream video output from the video game to respective groups of spectators. The game video output may include a competition area and a competition audience that includes audience portions based on the groups of spectators that receive the game video output from the players. An audience member may be associated with a spectator, and the spectator's username, profile picture, chat messages and other spectator input may be displayed adjacent to the audience member. A queue of waiting players may be displayed simultaneously with current gameplay in the competition area, and a queued character may move to the competition area when an open competition slot becomes available.