Animation Libraries for Facial Expression Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer-based animation techniques require numerous facial markers and optimal lighting conditions to capture detailed facial expressions, which are time-consuming and impractical for capturing motion in various environments, and often result in low-resolution motion meshes that do not accurately represent the actor's face.

Innovation Solution

A system that uses a library of previously captured animation information to identify and transfer facial expressions by comparing surface features to a motion model, allowing for a high-resolution animation mesh to be created with less data, using principal component analysis to decompose and compress motion information for efficient storage and reuse.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If numerous facial markers are applied to capture detailed facial expressions, then measurement precision is improved, but device complexity and time consumption increase

Engineering Contradiction:
Improvefacial expression detailVSAvoidmarker application complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses a library of pre-computed motion models as copies of facial motion patterns. Instead of capturing every facial movement with numerous markers, the system compares captured surface features against these pre-stored motion models to identify and transfer facial expressions, reducing the need for extensive marker application while maintaining expression accuracy

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary action by pre-computing and storing motion models from captured images before actual use. These preprocessed motion models are stored in a library and can be quickly retrieved and applied to new captures, eliminating the need to reprocess extensive marker data for each new facial expression capture

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If numerous facial markers are applied to capture detailed facial expressions, then measurement precision is improved, but loss of time increases

Engineering Contradiction:
Improvefacial expression detailVSAvoidmarker application time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent uses a library of pre-computed motion models as copies of facial motion patterns. Instead of capturing every facial movement with numerous markers, the system compares captured surface features against these pre-stored motion models to identify and transfer facial expressions, reducing the need for extensive marker application while maintaining expression accuracy

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary action by pre-computing and storing motion models from captured images before actual use. These preprocessed motion models are stored in a library and can be quickly retrieved and applied to new captures, eliminating the need to reprocess extensive marker data for each new facial expression capture

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If a reduced set of surface features is used for identification, then device complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvefeature set complexityVSAvoidfacial expression identification accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent uses a library of pre-computed motion models as copies of facial motion patterns. Instead of capturing every facial movement with numerous markers, the system compares captured surface features against these pre-stored motion models to identify and transfer facial expressions, reducing the need for extensive marker application while maintaining expression accuracy

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system changes the parameter approach by transforming raw surface feature data into decomposed principal components. This parameter transformation allows the system to work with reduced feature sets while maintaining identification accuracy, as the principal components capture the essential motion patterns in a compressed representation

Inventive Principle:
Principle #35Parameter changes

4Manufacturing precision

If motion data is stored in high resolution for animation, then manufacturing precision is improved, but loss of information increases

Engineering Contradiction:
Improveanimation mesh resolutionVSAvoidmotion data storage requirements
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The system changes the parameter approach by transforming raw surface feature data into decomposed principal components. This parameter transformation allows the system to work with reduced feature sets while maintaining identification accuracy, as the principal components capture the essential motion patterns in a compressed representation

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system extracts only the essential motion information from the full motion data by using principal component analysis. The motion models store only the critical deformation patterns and motion trajectories needed for animation, discarding redundant information while preserving the essential facial expression characteristics for high-resolution animation

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS8681158B1Using animation libraries for object identification
Publication Date: 2014.03.25 LUCASFILM ENTERTAINMENT COMPANY LTD
  • US8681158B1 patent drawing
  • US8681158B1 patent drawing
  • US8681158B1 patent drawing

AI summary

A computer-implemented method includes comparing one or more surface features to a motion model. The surface feature or surface features represent a portion of an object in an image. The method also includes identifying a representation of the object from the motion model, based upon the comparison.