Infrared Retroreflector Integration in LED Panels for Camera Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera tracking methodologies for virtual film production using LED volumes rely on visible tracking elements, which are either visible in the final scene or require post-production removal, decreasing workflow efficiency and increasing costs.
Innovation Solution
Integration of invisible infrared retroreflectors and Lidar depth sensors into LED panels for positional tracking, allowing for real-time three-dimensional camera tracking without visible markers, enabling in-camera visual effects and reducing post-production requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visible tracking elements (markers, tracking stars) are used for camera position tracking in LED volumes, then accurate three-dimensional tracking can be achieved, but the tracking elements become visible in the final scene or require post-production removal
Solution Approach 1:
The patent applies the principle of color changes by using retroreflective materials that are invisible to the camera sensor but reflect infrared light. The tracking markers are made from materials that appear transparent or invisible in the visible spectrum while having high reflectivity in the infrared spectrum, allowing the camera to detect them without them appearing in the final image.
Solution Approach 2:
The patent changes the operational parameters of the tracking system by using infrared illumination and infrared-sensitive sensors instead of visible light. This parameter change allows the tracking markers to be detected in the infrared spectrum while remaining invisible in the visible spectrum captured by the camera, thus resolving the contradiction between tracking accuracy and visibility.
2Measurement precision
If traditional visible tracking markers are used, then camera tracking is achievable, but post-production removal is required which decreases workflow efficiency and increases costs
Solution Approach 1:
By using markers that are invisible in the visible spectrum but visible in the infrared spectrum, the system eliminates the need for post-production removal of tracking markers. The camera captures infrared-reflected images for tracking purposes only, while the final visual output contains no visible markers, thus improving workflow efficiency.
3Measurement precision
If outside-in tracking with multiple tracking devices is used, then 360 degree perspective tracking is achieved, but the tracking devices appear as visible rings or artifacts in the final footage
Solution Approach 1:
The patent applies color changes by making the tracking markers invisible in the visible spectrum while maintaining their detectability in the infrared spectrum. This allows multiple tracking devices to be positioned around the scene for 360-degree coverage without them appearing as visible rings or artifacts in the final footage.
4Measurement precision
If inside-out tracking with star constellation markers is used, then triangulation for position determination is achieved, but the markers occlude the virtual image on the LED screen
Solution Approach 1:
The patent resolves the occlusion problem by using markers that are invisible in the visible spectrum. The star constellation markers are made from retroreflective materials that do not appear in the final visual output, thus eliminating occlusion of the virtual image on the LED screen while maintaining triangulation accuracy through infrared detection.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient and cost-effective real-time virtual environment filming by providing accurate positional tracking data without visible artifacts, eliminating the need for post-production marker removal and enhancing workflow efficiency.
Implementation Method 1
The retroreflector is secured to a rear surface of the display screen and is operable to reflect light back to a source of the light
Implementation Method 2
a plurality of Lidar depth sensors integrated into the LED panel in alternate locations to the retroreflectors
Data Source
AI summary
A LED panel wherein a plurality thereof are employed to construct a LED volume for filing simulated virtual environments wherein the LED panel of the present invention provides tracking of objects in the vicinity thereof such as but not limited to a camera wherein the tracking elements do not require post production removal. The LED panel includes a housing having a perimeter frame that has a transparent LED display mounted thereto. On the rear surface of the LED display or proximate thereto are a plurality of retroreflectors. The retroreflectors function to provide inside-out tracking of a camera disposed within the LED volume. The present invention further includes a plurality of lidar sensors and optical sensors mounted to the perimeter frame. The lidar sensors and optical sensors provide data for outside-in tracking of a camera within the LED volume. The retroreflectors can be provided in multiple alternate embodiments.