Markerless Skeletal Tracking in Interactive Entertainment Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional motion capture systems require intensive calibration and setup due to the need for markers on the body, limiting their application and ability to provide seamless, immersive entertainment experiences.

Innovation Solution

A method that uses an enhancer to illuminate an area with invisible light, allowing image detectors to capture images of a person, which are then analyzed to determine skeletal features and generate a virtual pose, enabling interactive effects without the need for physical markers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If markers are placed on the person's body for motion capture, then pose detection accuracy is improved, but calibration complexity and setup time increase

Engineering Contradiction:
Improvepose detection accuracyVSAvoidcalibration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent removes markers from the system entirely, extracting the problematic element that caused calibration complexity while maintaining pose detection capability through markerless computer vision algorithms that track natural body features and movements

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the mechanical marker-based system with an optical/electronic computer vision system that uses cameras and algorithms to detect pose, eliminating the need for physical markers and simplifying the overall system architecture

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If markers are placed on the person's body for motion capture, then pose detection accuracy is improved, but setup time increases

Engineering Contradiction:
Improvepose detection accuracyVSAvoidsetup time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent removes markers from the system entirely, extracting the problematic element that caused calibration complexity while maintaining pose detection capability through markerless computer vision algorithms that track natural body features and movements

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system uses the person's own body features (natural contours, movements, and characteristics) as the detection target, eliminating the need for external markers and reducing setup time to minimal system initialization without requiring body preparation

Inventive Principle:
Principle #25Self-service

3Measurement precision

If traditional motion capture systems are used, then pose detection capability is achieved, but user immersion and experience quality deteriorate

Engineering Contradiction:
Improvepose detection capabilityVSAvoiduser immersion
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent removes markers from the system entirely, extracting the problematic element that caused calibration complexity while maintaining pose detection capability through markerless computer vision algorithms that track natural body features and movements

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system creates a virtual copy or avatar that mirrors the user's physical movements and characteristics, allowing the user to interact with the virtual environment as themselves, thereby enhancing immersion without requiring physical modification of the user

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution simplifies the calibration process and enhances the user experience by allowing for seamless interaction with virtual environments, improving the accuracy and speed of pose detection, and enabling more immersive entertainment experiences.

Implementation Method 1

illuminating, by an enhancer, an area with light having a wavelength invisible to humans

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Data Source

PatentUS12343616B2Interactive entertainment system
Publication Date: 2025.07.01 DISNEY ENTERPRISES INC
  • US12343616B2 patent drawing
  • US12343616B2 patent drawing
  • US12343616B2 patent drawing

AI summary

The present disclosure describes a method for providing an interactive experience. The method includes illuminating, by an enhancer, an area with light having wavelength invisible to humans. A plurality of image detectors capture at least two images of a person in the area including a portion of the light reflected from the person. A processing element determines a first skeletal feature of the person based on the at least two images. The processing element determines a position characteristic of the first skeletal feature; constructs, from the first skeletal feature, a vector in three dimensions corresponding to the position characteristic; and outputs an interactive effect based on the position characteristic.