LED Panel Infrared Retroreflectors for Invisible Camera Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera tracking technologies in LED volumes for virtual film production are visible in the final scene, necessitating post-production removal, which decreases workflow efficiency and increases costs.
Innovation Solution
Incorporation of infrared retroreflectors and Lidar depth sensors into LED panels to provide invisible positional tracking, enabling real-time three-dimensional tracking of cameras and objects within the LED volume.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visible tracking devices or markers are used for camera tracking in LED volumes, then camera position can be determined, but the tracking elements become visible in the final scene requiring post-production removal
Solution Approach 1:
The retroreflectors are designed to reflect infrared light while remaining invisible to the human eye and standard camera sensors. This wavelength-specific reflection allows the tracking markers to be detected by infrared-sensitive cameras for precise position tracking, while appearing completely transparent in the final visible light footage, thus eliminating the need for post-production removal
Solution Approach 2:
The system uses retroreflective markers that create optical copies of the infrared tracking signal without visible light emission. The markers reflect infrared light back to the source camera, creating a detectable signal for position calculation while remaining invisible in the visible spectrum, thus providing tracking data without visible artifacts
2Manufacturing precision
If post-production removal of tracking elements is performed, then image quality is maintained, but workflow efficiency decreases and costs increase
Solution Approach 1:
The tracking markers are designed to be invisible from the outset by using retroreflective materials that only reflect infrared light. This preliminary design choice eliminates the need for subsequent post-production removal operations, streamlining the workflow and reducing both time and costs while maintaining complete image quality
3Ease of manufacture
If traditional green screen technology is used, then background can be replaced, but realistic lighting and reflections cannot be achieved in real-time
Solution Approach 1:
The system uses real-time infrared camera tracking to continuously monitor camera position and orientation, feeding this data back to the rendering system. This allows the LED volume to dynamically adjust the virtual background and lighting in real-time based on the actual camera perspective, creating realistic reflections and lighting effects that update continuously as the camera moves, unlike static green screen compositions
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Eliminates the need for post-production removal of tracking elements, enhancing workflow efficiency and maintaining image quality by providing accurate positional data without visible artifacts.
Implementation Method 1
the retroreflector provides a wide range of angle of incidence and reflects infrared light back to the infrared light source
Data Source
AI summary
A LED panel wherein a plurality thereof are employed to construct a LED volume for filing simulated virtual environments wherein the LED panel of the present invention provides tracking of objects in the vicinity thereof such as but not limited to a camera wherein the tracking elements do not require post production removal. The LED panel includes a housing having a perimeter frame that has a transparent LED display mounted thereto. On the rear surface of the LED display or proximate thereto are a plurality of retroreflectors. The retroreflectors function to provide inside-out tracking of a camera disposed within the LED volume. The present invention further includes a plurality of lidar sensors and optical sensors mounted to the perimeter frame. The lidar sensors and optical sensors provide data for outside-in tracking of a camera within the LED volume. The retroreflectors can be provided in multiple alternate embodiments.