Neural State Machine for Digital Character Animation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional digital animation systems are limited to generating single-type cyclic motions and are unable to create complex actions involving multiple actions and varied environments, requiring tedious manual inputs from users to achieve realistic animations.

Innovation Solution

An animation generation system employing a neural state machine with a gating module and motion prediction module, using blending coefficients to generate animations of digital characters performing complex actions in diverse environments by predicting and transitioning between different states based on input features and phases of motion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional digital animation systems are used to generate animations, then the system can produce simple cyclic motions (walk, run), but the system is limited to single-type actions and cannot handle complex actions involving multiple actions and objects

Engineering Contradiction:
Improvecapability to perform complex actionsVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments complex actions into multiple phases (e.g., approach phase, interaction phase, departure phase). Each phase is handled by specialized motion generators that produce cyclic motions appropriate for that phase. This segmentation allows the system to manage complexity by breaking down complex actions into manageable components while maintaining the ability to perform diverse complex actions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically transitions between different motion types and phases based on the current state and target action. The motion generation system adapts its behavior in real-time, switching between idle, approach, interact, and depart phases as needed. This dynamic adaptation enables the system to handle complex sequences of actions without requiring a completely different system architecture.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If conventional digital animation systems are used, then the system can generate animations in a single environment type, but the system cannot address a variety of environments

Engineering Contradiction:
Improveenvironmental adaptabilityVSAvoidmanual specification time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system automatically adapts to different environments by analyzing the target environment characteristics and self-adjusting its motion generation parameters. Rather than requiring manual configuration for each environment type, the system services itself by autonomously determining appropriate motion patterns for the given environment, thereby eliminating the time loss associated with manual specification while achieving environmental versatility.

Inventive Principle:
Principle #25Self-service

3Reliability

If manual specification is used to create complex actions, then the animation can be realistic, but the process is tedious and computationally inefficient requiring repeated manual inputs

Engineering Contradiction:
Improveanimation realismVSAvoidanimation generation efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system replaces the manual mechanical process of specifying each animation parameter with an automated computational system. The motion generators and phase-based architecture automatically compute realistic motion patterns based on the desired action and environment, substituting manual input with algorithmic generation. This maintains animation realism through physics-based motion while dramatically improving productivity by eliminating repeated manual inputs.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Ease of operation

If conventional systems are used, then the animation generation process is simple, but the system requires user intervention and correction to achieve realistic results

Engineering Contradiction:
Improveautomation levelVSAvoidaction precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system incorporates feedback mechanisms where the generated animation is evaluated against realism criteria and automatically corrected if necessary. The phase-based motion generation allows for continuous monitoring and adjustment of motion parameters to ensure precision. This feedback loop enables high automation while maintaining action precision, as the system can detect and correct deviations without user intervention.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11321895B2Neural state machine digital character animation
Publication Date: 2022.05.03 ADOBE INC
  • US11321895B2 patent drawing
  • US11321895B2 patent drawing
  • US11321895B2 patent drawing

AI summary

Digital character animation automated generation techniques are described that are implemented by an animation generation system via a computing device. These techniques enable the animation generation system to generate an animation of a digital character automatically and without user intervention responsive to a user input of a target action such that the digital character is capable of performing a complex set of actions in a precise and realistic manner within an environment contained within digital content, e.g., an animation as part of a digital video.