Dual-Spectrum Camera Motion Capture with Invisible Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional motion capture systems often require additional equipment and markers that interfere with the actor's performance, necessitating improved systems and methods for more comfortable and efficient motion capture.
Innovation Solution
The implementation of a dual-camera system that captures performance in visible and invisible light spectrums, allowing markers to be invisible to the visible light camera while clearly visible to the infrared camera, eliminating the need for head-mounted cameras and reducing actor discomfort.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If markers are applied to the actor's face for motion capture, then measurement precision is improved, but ease of operation deteriorates due to actor discomfort and performance interference
Solution Approach 1:
The patent applies different properties to different parts of the marker system: the markers are made invisible in the visible spectrum (affecting only the local property of visibility) while remaining highly detectable in the infrared spectrum. This allows the markers to fulfill their measurement function without interfering with the actor's performance in the visible domain.
Solution Approach 2:
The patent changes the operational parameter of the camera system from visible light to infrared light. By operating in a different spectral range, the system can detect markers without the actor being aware of or disturbed by them, thus maintaining measurement precision while improving actor comfort and performance.
2Measurement precision
If visible markers are used on the actor, then measurement precision is improved, but object-generated harmful factors increase due to marker visibility and distraction
Solution Approach 1:
The markers are designed with selective visibility: they are invisible in the visible spectrum (eliminating distraction) but highly detectable in the infrared spectrum (maintaining measurement precision). This local differentiation of optical properties resolves the contradiction between measurement accuracy and actor distraction.
Solution Approach 2:
The patent effectively uses 'color' in the broader sense of spectral reflectivity. The markers have the property of being invisible (no reflection in visible spectrum) while reflecting infrared light strongly. This spectral color change allows the markers to be undetectable to the actor's eyes but clearly visible to the infrared camera.
3Measurement precision
If head-mounted cameras are used for facial motion capture, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent extracts the infrared detection function from the head-mounted camera system and places it in a stationary or remotely mounted infrared camera. The markers remain on the actor's face for precision, but the complexity of head-mounted equipment is eliminated by using a separate infrared detection system that captures the same facial motion data without requiring head-mounted devices.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables efficient and comfortable motion capture by allowing actors to perform without visible markers, reducing the need for post-processing edits and minimizing distractions, thus improving performance and satisfaction.
Implementation Method 1
a second camera system can simultaneously capture the performance in a second light wavelength spectrum different from the first spectrum (e.g., invisible light spectrum such as the IR light spectrum)
Implementation Method 2
a first camera system can capture the performance within a first light wavelength spectrum (e.g., visible light spectrum)
Data Source
AI summary
Embodiments of the disclosure provide systems and methods for motion capture to generate content (e.g., motion pictures, television programming, videos, etc.). An actor or other performing being can have multiple markers on his or her face that are essentially invisible to the human eye, but that can be clearly captured by camera systems of the present disclosure. Embodiments can capture the performance using two different camera systems, each of which can observe the same performance but capture different images of that performance. For instance, a first camera system can capture the performance within a first light wavelength spectrum (e.g., visible light spectrum), and a second camera system can simultaneously capture the performance in a second light wavelength spectrum different from the first spectrum (e.g., invisible light spectrum such as the IR light spectrum). The images captured by the first and second camera systems can be combined to generate content.