Camera-Based Performer Tracking for Large-Stage Interactive Effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for real-time interaction in large-scale theatrical performances, such as using ground screens with pressure sensors or infra-red markers, are costly and limited in spatial extent, making them undesirable for large-scale applications.
Innovation Solution
Utilizing cameras and artificial intelligence for multi-person position tracking, employing computer vision and AI algorithms to detect performer positions and enable real-time interactive graphics on a large performance stage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If ground screens with pressure sensors or infra-red markers are used for real-time interaction, then interaction accuracy is improved, but cost and device complexity increase significantly
Solution Approach 1:
The patent replaces mechanical pressure sensors and infra-red markers with a computer vision-based optical system. Cameras capture images of performers, and AI algorithms process these images to track positions, eliminating the need for complex mechanical sensing infrastructure while maintaining tracking accuracy.
Solution Approach 2:
The system creates a virtual copy of the physical performance space by capturing real-world images and generating synthetic images that mirror the actual performer positions. This virtual representation enables interaction without requiring physical sensors embedded in the environment.
2Difficulty of detecting and measuring
If ground screens with pressure sensors are used, then position detection capability is improved, but ease of manufacture and installation deteriorate
Solution Approach 1:
The patent replaces the complex mechanical installation of ground screens and pressure sensors with a software-based computer vision system using standard cameras. This substitution dramatically simplifies deployment, requiring no physical modification of the performance space infrastructure.
Solution Approach 2:
The camera system serves multiple functions: capturing performer positions, tracking movement trajectories, and providing input for AI-based interaction decisions. This multi-functional approach eliminates the need for specialized detection hardware, improving ease of deployment.
3Measurement precision
If infra-red markers are used for tracking, then tracking precision is improved, but adaptability to different performance spaces deteriorates
Solution Approach 1:
The patent employs a universal camera-based system that can detect and track performers across diverse performance spaces without requiring space-specific calibration or specialized markers. The AI algorithms adapt to different environments by processing visual data from various camera angles and lighting conditions, enabling broad spatial versatility.
Data Source
AI summary
Methods, apparatus, systems, and articles of manufacture are disclosed for real-time interactive performances. An example apparatus includes at least one memory, machine readable instructions, and processor circuitry to at least one of instantiate or execute the machine readable instructions to capture an image of a performance area, detect one or more performers in the performance area using the image, estimate locations of the one or more detected performers, smooth the estimated locations of the one or more detected performers based on prior estimated locations, and provide the smoothed estimated locations to display controller circuitry for generation of an interactive effect based on the smoothed estimated locations