Anatomically Constrained Implicit Shape Models for Nonlinear Deformations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional linear 3D morphable models (3DMMs) are unable to represent continuous, nonlinear deformations of faces and other recognizable shapes, leading to unrealistic motion and physically impossible shapes.

Innovation Solution

The technique involves generating a set of attributes associated with anatomical constraints for an object using neural networks, and then computing the positions of points on the object based on these attributes to create a three-dimensional (3D) model that adheres to these constraints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If linear 3D morphable model is used to represent shapes, then computational simplicity is maintained, but the ability to represent continuous nonlinear deformations is lost

Engineering Contradiction:
Improveability to represent continuous nonlinear deformationsVSAvoidmodel complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transforms the linear combination parameters into nonlinear parameters by introducing anatomical constraint parameters (skull, jaw bone, skin patches) that govern deformation in a nonlinear manner. This allows the model to represent continuous nonlinear deformations while maintaining a structured parameter space for efficient computation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent combines multiple anatomical structures (skull, jaw bone, skin patches) into a composite hierarchical model where each component has specific deformation properties. This composite structure enables realistic nonlinear facial deformations by integrating the mechanical behaviors of different tissue types.

Inventive Principle:
Principle #40Composite materials

2Reliability

If linear 3D morphable model is used, then processing speed is fast, but anatomical plausibility of generated shapes deteriorates

Engineering Contradiction:
Improveanatomical plausibilityVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent pre-computes anatomical constraints (skull, jaw bone, skin patches) from training data and stores them as prior knowledge. During runtime, these pre-computed constraints are directly applied to guide deformation, eliminating the need for iterative optimization and achieving real-time processing speeds while ensuring anatomical plausibility.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the iterative mechanical optimization system with a direct neural network-based computation system. The neural networks predict anatomically plausible deformations by learning from training data, substituting the slow iterative optimization process with fast parallel computation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If iterative optimization is used to fit 3DMM parameters, then anatomical constraints are satisfied, but computational time and resource overhead increase significantly

Engineering Contradiction:
Improveanatomical constraint satisfactionVSAvoidcomputational time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent substitutes the iterative mechanical optimization process with a neural network-based direct computation approach. The neural networks are trained to directly predict anatomically constrained deformations, eliminating the need for iterative optimization while maintaining constraint satisfaction.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent performs preliminary training of neural networks on anatomically constrained data during the offline phase. This pre-learning enables the model to directly generate anatomically plausible results during runtime without requiring iterative optimization, significantly reducing computational time.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250037366A1Anatomically constrained implicit shape models
Publication Date: 2025.01.30 DISNEY ENTERPRISES INC
  • US20250037366A1 patent drawing
  • US20250037366A1 patent drawing
  • US20250037366A1 patent drawing

AI summary

One embodiment of the present invention sets forth a technique for generating a shape model. The technique includes generating, via execution of a set of neural networks based on a plurality of shapes associated with an object, a set of attributes associated with a set of anatomical constraints for the object. The technique also includes computing, based on the set of attributes, a set of positions of a set of points on the object. The technique further includes generating a three-dimensional (3D) model of the object based on the set of positions of the set of points.