Neuromorphic and Color Camera Tracking for Stage Performers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for tracking performers on show stages face challenges due to sensitivity to lighting conditions, especially in environments with numerous performers moving on multiple rings and varying lighting, where traditional vision and recognition methods fail to accurately track movements.
Innovation Solution
A system utilizing a motorized yoke with a color camera and a neuromorphic camera, along with light or video projectors, to track performers by receiving event-related images from the neuromorphic camera and visible images from the color camera, with infrared diodes for illumination and infrared identifiers for enhanced identification, allowing for automatic tracking and movement follow-up.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional vision and recognition methods are used to track performers, then the system is simple to implement, but the tracking accuracy deteriorates under varying lighting conditions and with multiple performers on multiple rings
Solution Approach 1:
The system segments the tracking task by using multiple independent cameras (color camera and neuromorphic camera) positioned at different locations, each capturing specific aspects of performer movement. The image processing module then integrates these segmented views to achieve comprehensive tracking accuracy across multiple rings and lighting conditions
Solution Approach 2:
The patent introduces an image processing module as an intermediary that receives images from both color and neuromorphic cameras, processes the visual data, and generates coordinated tracking commands. This intermediary layer reconciles the different camera inputs and translates them into accurate performer position data, resolving the contradiction between using multiple sensors and system complexity
2Adaptability or versatility
If multiple cameras and projectors are deployed to track performers on multiple rings, then the tracking coverage and accuracy improve, but the device complexity and cost increase
Solution Approach 1:
The system employs universal components that serve multiple functions: the color camera and neuromorphic camera not only track performers but also provide lighting adaptation; the projectors serve both as illumination sources and as tracking indicators; the single image processing module handles data from multiple cameras and generates commands for multiple projectors across different rings, reducing overall system complexity
Solution Approach 2:
The patent merges the color camera and neuromorphic camera into a coordinated imaging system with shared processing, combines the lighting and tracking functions into integrated projector units, and unifies the control architecture through a single image processing module that manages all cameras and projectors, thereby achieving comprehensive coverage without proportional increases in complexity
3Measurement precision
If event-related images from neuromorphic camera and visible images from color camera are processed simultaneously, then the identification and tracking precision improve, but the image processing complexity increases
Solution Approach 1:
The system employs periodic action by having the neuromorphic camera capture event-related images at specific moments when changes occur, rather than continuous streaming. The image processing module processes these periodic event images alongside visible images, reducing the overall processing load while maintaining identification precision through event-triggered updates
Solution Approach 2:
The patent uses the color camera to capture visible images that serve as copies or references for performer appearance and context. These visible image copies provide contextual information that simplifies the processing of neuromorphic event images, as the system can cross-reference the high-precision event data with the richer contextual visible data without processing all details of both simultaneously
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and efficient tracking of performers across multiple stages with improved lighting conditions, facilitating real-time movement detection and identification, even in complex circus settings with multiple performers.
Implementation Method 1
a dichroic mirror separating and directing the image collected through the common objective lens, on the one hand towards the color camera and on the other hand towards the neuromorphic camera
Implementation Method 2
the motorized yoke further includes an infrared diode module to illuminate the volume of the stage
Data Source
AI summary
A system for tracking performers on a show stage, includes: a plurality of projectors, at least one motorized yoke with direct axial drive for the support and the omnidirectional movement of an assembly including: an image acquisition assembly formed of color and neuromorphic cameras having a common objective lens, a dichroic mirror, an image processing module to receive, from the neuromorphic camera, event-related images of the performers in order to determine their coordinates and to receive, from the color camera, visible images of these performers allowing them to be identified, and a display screen to display a visible image of each of the performers obtained by the color camera and to allow the assignment by an operator at a control terminal or a media server of the determined projectors to identified performers on the stage, to ensure automatic tracking by the projectors of the respective movements of these identified performers.