Drone Camera Calibration for Live-Action Motion Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current motion capture calibration methods in live action scenes are inefficient, requiring multiple cameras and extensive setup time, leading to increased costs and complexity in visual productions.

Innovation Solution

The use of drones equipped with cameras to calibrate camera positions and orientations in real-time by observing reference points, allowing for the computation of camera locations and orientations based on reference point data from both stationary and moving cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are used for motion capture calibration, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvecalibration accuracyVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A drone is introduced as an intermediary mobile platform to carry cameras for motion capture calibration. The drone serves as a mediator between stationary reference points and the calibration process, enabling accurate measurement while reducing the need for multiple fixed camera installations. The drone's mobile nature allows it to access various positions and angles that would otherwise require multiple stationary cameras.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple cameras are deployed for calibration, then measurement precision improves, but setup time increases

Engineering Contradiction:
Improvecalibration accuracyVSAvoidsetup time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system transitions from static multiple-camera installations to a dynamic mobile drone-based camera system. The drone can dynamically position itself to capture calibration data from various angles and locations, eliminating the need for time-consuming setup and adjustment of multiple fixed cameras. This dynamic approach maintains measurement precision while significantly reducing setup time.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If extensive camera setup is performed, then manufacturing precision improves, but productivity decreases

Engineering Contradiction:
Improvecalibration precisionVSAvoidproduction efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The mobile drone system performs calibration operations autonomously by navigating to predetermined locations and capturing images of reference points independently. This self-service capability eliminates the need for extensive manual camera setup and adjustment, maintaining high calibration precision while improving production efficiency through automated operations.

Inventive Principle:
Principle #25Self-service

4Reliability

If more cameras are used, then reliability of calibration improves, but device complexity increases

Engineering Contradiction:
Improvecalibration reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The mobile drone system serves multiple functions: it carries cameras, navigates to various positions, captures images of reference points, and can adjust its position dynamically. This multi-functional platform replaces multiple specialized stationary cameras, maintaining calibration reliability while reducing overall system complexity through consolidation of functions into a single versatile device.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11636621B2Motion capture calibration using cameras and drones
Publication Date: 2023.04.25 UNITY TECH SF
  • US11636621B2 patent drawing
  • US11636621B2 patent drawing
  • US11636621B2 patent drawing

AI summary

Embodiments facilitate the calibration of cameras in a live action scene using fixed cameras and drones. In some embodiments, a method configures a plurality of reference cameras to observe at least three known reference points located in the live action scene and to observe one or more reference points associated with one or more moving cameras having unconstrained motion. The method further configures the one or more moving cameras to observe one or more moving objects in the live action scene. The method further receives reference point data in association with one or more reference cameras of the plurality of reference cameras, where the reference point data is based on the at least three known reference points and the one or more reference points associated with the one or more moving cameras. The method further computes a location and an orientation of each moving camera of the one or more moving cameras based on one or more of the reference point data and one or more locations of one or more reference cameras of the plurality of reference cameras.