Skin Microstructure Filtering for Realistic Facial Deformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing facial animation techniques fail to realistically simulate the dynamic microstructure of human skin, leading to unrealistic and shiny appearances due to the lack of consideration for skin stretching and compression, which results in plastic or unnatural skin behavior.

Innovation Solution

A two-pass filtering method is applied to simulate skin microstructure texture, involving precomputation of one-dimensional filtered tiles at various angles and strengths, followed by runtime determination of deformation directions to apply the appropriate filters, enhancing the realism of skin deformation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If microstructure and mesostructure details are considered in facial animation, then the detail level of skin texture is improved, but the skin appears plastic or shiny giving unrealistic results

Engineering Contradiction:
Improveskin texture detail levelVSAvoidrealism of skin appearance
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent changes the filtering parameters (filter strength, filter direction) based on the local deformation characteristics of the skin. By adjusting these parameters dynamically according to deformation magnitude and direction, the system maintains realistic skin appearance while preserving microstructure details. The filter strength is modulated by deformation magnitude, and filter direction is aligned with deformation direction, preventing the plastic/shiny appearance that occurs with static filtering approaches.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If skin deformation is simulated without dynamic filtering, then the animation performance is maintained, but the skin stretching and compression effects are unrealistic

Engineering Contradiction:
Improveanimation performanceVSAvoidskin deformation realism
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent precomputes and stores filtered texture versions at runtime, organizing them in a lookup structure that can be quickly accessed during animation. This preliminary preparation allows the system to apply appropriate filtering based on deformation characteristics without performing complex real-time filtering calculations, thus maintaining animation performance while achieving realistic skin deformation effects.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic filtering where the filter parameters (strength, direction, type) are adjusted in real-time based on the local deformation characteristics of the skin. This dynamic adaptation allows the skin texture to respond realistically to stretching and compression while maintaining computational efficiency through the use of precomputed filtered versions and efficient parameter selection.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If full 2D filtering is applied to microstructure texture during runtime, then the skin texture realism is improved, but the computational cost and memory usage increase significantly

Engineering Contradiction:
Improveskin texture realismVSAvoidcomputational cost
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The patent segments the 2D filtering operation into multiple 1D filtering steps applied sequentially along different directions. By decomposing the 2D filter into 1D filters, the computational complexity is reduced from O(n²) to O(n), where n is the filter kernel size. This segmentation allows realistic skin texture rendering while significantly reducing the computational cost and memory usage during runtime.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts the filtering approach based on the local deformation characteristics. In regions with high deformation, full filtering is applied to maintain realism, while in regions with low deformation, reduced or no filtering is applied to save computational resources. This dynamic adaptation optimizes the balance between texture realism and computational cost.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12367635B2Skin microstructure texture filtering for runtime facial animations
Publication Date: 2025.07.22 ELECTRONIC ARTS INC
  • US12367635B2 patent drawing
  • US12367635B2 patent drawing
  • US12367635B2 patent drawing

AI summary

A method of skin microstructure texture filtering for facial animation includes obtaining a plurality of one-dimensional (1D) filtered tiles corresponding to a plurality of filter axis angles and a plurality of filter parameters applied to a neutral tile, and at runtime, for each pixel representing a region of human skin, determining a principal direction of deformation, a principal filter parameter corresponding to the principal direction of deformation, and a secondary filter parameter corresponding to a secondary direction of deformation orthogonal to the principal direction of deformation, and selecting a first 1D filtered tile among the plurality of 1D filtered tiles, the first 1D filter tile corresponding to the secondary direction of deformation and the secondary filter parameter, and generating a respective two-dimensional (2D) filtered tile by convolving the first 1D filtered tile with a second 1D filter kernel corresponding to the principal direction of deformation and the principal filter parameter.