Automatic Rigid Stabilization of Facial Expressions Using Subject-Specific Skull

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current manual processes for rigid stabilization of facial expressions in facial scanning are tedious, error-prone, and time-consuming, leading to inaccurate results, especially when capturing digital doubles for media works, as they fail to effectively separate true expression deformations from unwanted rigid head movement.

Innovation Solution

An automatic rigid stabilization method that uses a subject-specific skull representation, generated by deforming a generic skull representation using facial landmarks and anatomically-motivated constraints, to align and stabilize facial expressions, allowing for quick and accurate extraction of pure facial expressions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual processes are used for rigid stabilization of facial expressions, then some level of stabilization can be achieved, but the process becomes tedious, error-prone, and time-consuming

Engineering Contradiction:
Improveaccuracy of facial expression stabilizationVSAvoidtime required for stabilization process
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical adjustment processes with an automated computer-implemented method. The system automatically performs rigid stabilization by obtaining facial expression data, generating a subject-specific skull representation, and fitting the skull model to stabilize expressions, eliminating the need for tedious manual operations while improving accuracy and reducing time requirements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service stabilization by automatically processing facial expression data without requiring manual intervention. The computer-implemented method autonomously generates skull representations, performs fitting operations, and produces stabilized facial expressions, allowing the process to serve itself without human operators

Inventive Principle:
Principle #25Self-service

2Productivity

If manual processes are used for rigid stabilization, then some stabilization is achieved, but the results become inaccurate due to human error

Engineering Contradiction:
Improvequality of facial expression stabilizationVSAvoidconsistency and accuracy of results
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent replaces manual stabilization processes with an automated computer-implemented system that consistently applies the same algorithmic operations. This substitution eliminates human variability and error, producing reliable and consistent results across different facial expressions and subjects while maintaining high productivity

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If automated methods are implemented for rigid stabilization, then speed and consistency improve, but complexity of the system increases

Engineering Contradiction:
Improvespeed of stabilization processVSAvoidcomplexity of stabilization system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the stabilization process into distinct computational steps: obtaining facial expression data, generating a subject-specific skull representation, and fitting the skull model to expressions. This segmentation allows each step to be independently optimized and executed, improving overall speed while managing system complexity through modular design

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system manages complexity by dynamically adjusting parameters during the fitting process, such as optimizing the alignment between the skull representation and facial expressions. By automatically managing parameter changes through computational algorithms, the system achieves high speed and consistency without requiring complex manual configuration

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9477878B2Rigid stabilization of facial expressions
Publication Date: 2016.10.25 DISNEY ENTERPRISES INC
  • US9477878B2 patent drawing
  • US9477878B2 patent drawing
  • US9477878B2 patent drawing

AI summary

Systems and techniques for performing automatic rigid stabilization of facial expressions are provided. The systems and techniques may include obtaining one or more shapes, the one or more shapes including one or more facial expressions of a subject. The systems and techniques may further include generating a subject-specific skull representation, and performing rigid stabilization of the one or more facial expressions by fitting the subject-specific skull with the one or more facial expressions of the subject.