Animated Figure Projection Mapping With Real-Time Optical Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing animated figures in amusement parks lack the ability to realistically interact with their environment and guests, often appearing unnatural due to internal projection mapping that creates an ethereal glow and limited actuator space.

Innovation Solution

A reactive media system with external projectors and trackers for real-time optical motion capture, allowing dynamic image projection on external surfaces and enabling complex actuators, independent of internal projection limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If internal projection mapping is used in animated figures, then the figures can display predetermined images, but the figures appear unnatural with an ethereal glow and have limited space for actuators

Engineering Contradiction:
Improveinternal projection implementationVSAvoidrealistic appearance
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent extracts the projection system from the internal configuration and relocates it to external projectors positioned around the animated figure. This removes the ethereal glow effect caused by internal projection and eliminates the conflict between projection space and actuator space within the figure's limited volume.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a media control system as an intermediary that receives sensor data from trackers on the animated figure and generates dynamically adapted images for projection. This intermediary processes real-time motion data to create realistic textures and lighting effects that match the figure's actual position and orientation, enhancing the realistic appearance.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If internal projection is used through semi-transparent surfaces, then images can be displayed on the figure, but the figures lack the ability to contextually blend with their environment in a realistic manner

Engineering Contradiction:
Improveimage display capabilityVSAvoidenvironmental blending
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements a feedback loop where trackers on the animated figure continuously provide position and orientation data to the media control system. The system uses this feedback to dynamically adjust and adapt the projected images in real-time, ensuring the textures and lighting contextually blend with the figure's current pose and environmental conditions.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent transitions from static predetermined images to dynamic real-time projection mapping. The external projectors and media control system continuously update the projected content based on the animated figure's real-time motion and environmental context, enabling the figures to naturally blend with their surroundings as they move.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If trackers are coupled to the figure for motion capture, then real-time position and orientation data can be obtained, but the device complexity increases

Engineering Contradiction:
Improvemotion capture accuracyVSAvoidtracking system configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses optical trackers that create light-based copies or representations of the animated figure's position and orientation in digital space. These optical markers are detected by external cameras to generate accurate motion capture data without requiring complex internal sensors or electronics within the figure itself.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system enhances the lifelike appearance and interactive capabilities of animated figures by providing realistic textures and movements, enhancing guest immersion and engagement.

Implementation Method 1

a tracking camera configured to receive the respective sensor signals from the set of trackers. The tracking camera is also configured to determine a current position of the set of trackers relative to one another, relative to the tracking camera, or both based on receipt of the respective sensor signals.

Methodology Applied
Scientific EffectOptical detection: Photoelectric Effect

Implementation Method 2

The projector is also configured to project the images onto the second surface of the figure portion having the current position and the current orientation.

Methodology Applied
Scientific EffectLight projection: Light

Data Source

PatentUS12552044B2Systems and methods for optical performance captured animated figure with real-time reactive projected media
Publication Date: 2026.02.17 UNIVERSAL CITY STUDIOS LLC
  • US12552044B2 patent drawing
  • US12552044B2 patent drawing
  • US12552044B2 patent drawing

AI summary

A reactive media system of includes a motion control system. The motion control system includes an animated figure having a figure portion. The motion control system also includes a set of trackers coupled to a first surface of the figure portion. Each tracker of the set of trackers is configured to emit a respective sensor signal. The reactive media system also includes a media control system. The media control system includes a tracking camera configured to receive the respective sensor signals from the set of trackers. The tracking camera is also configured to determine a current position of the set of trackers relative to one another, relative to the tracking camera, or both based on receipt of the respective sensor signals. The tracking camera is also configured to generate state signals indicative of a current position and a current orientation of the figure portion based on the current position of the set of trackers. The media control system also includes a media controller communicatively coupled to the tracking camera. The media controller is configured to generate first image data indicative of images to be projected onto at least a second surface of the figure portion having the current position and the current orientation. The second surface comprises an external surface and the second surface is different than the first surface. The media control system also includes a projector communicatively coupled to the media controller. The projector is configured to receive the data indicative of the images from the media controller. The projector is also configured to project the images onto the second surface of the figure portion having the current position and the current orientation.