Drone-Based Camera Calibration Using Reference Points On Set

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current methods for calibrating cameras in live action scenes for visual productions are inefficient, requiring multiple cameras and manual setup, which increases costs and setup time, and struggles with accurately integrating real and digital elements in real-time.

Innovation Solution

The use of drones equipped with cameras to automate the calibration process by capturing reference points and computing the location and orientation of moving cameras, allowing for real-time calibration and reduced camera setup, enabling more efficient integration of real and digital elements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras are used for calibration, then measurement precision is improved, but device complexity increases

Engineering Contradiction:

Improvecamera calibration accuracyVSAvoidnumber of cameras

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The drone serves multiple functions: it carries the moving camera for capturing live action scenes, carries reference cameras for calibration, and acts as a mobile platform that can be positioned anywhere in the scene. This multi-functionality eliminates the need for separate calibration equipment and multiple fixed cameras, resolving the contradiction between measurement precision and device complexity

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

Reference points are introduced as intermediaries between the cameras and the calibration process. The moving camera captures images of these reference points, which provide known geometric relationships that enable accurate calibration without requiring complex multi-camera setups. The reference points mediate the calibration process, allowing precise measurement with fewer cameras

Inventive Principle:

Principle #24Intermediary (Mediator)

2Manufacturing precision

If manual setup is used for camera calibration, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:

Improvecalibration accuracyVSAvoidsetup time

Core Design Contradiction:

Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs self-calibration by using the drone's own moving camera to capture reference points and automatically compute calibration parameters through image processing algorithms. This eliminates the need for manual calibration procedures while maintaining high precision, resolving the contradiction between manufacturing precision and loss of time

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

Manual mechanical calibration procedures are replaced with an automated optical system. The moving camera captures images of reference points, and computer vision algorithms automatically compute calibration parameters, replacing time-consuming manual setup with rapid automated processing that maintains high precision

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If fixed cameras are used for calibration, then reliability is improved, but adaptability worsens

Engineering Contradiction:

Improvecalibration stabilityVSAvoidscene coverage flexibility

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The calibration system transitions from static fixed cameras to a dynamic moving camera mounted on the drone. The moving camera can be positioned anywhere in the scene and captures reference points from various angles and positions, providing both reliability through multiple observations and adaptability through flexible positioning. This dynamic approach resolves the contradiction between reliability and adaptability

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS11600022B2Motion capture calibration using drones

Publication Date: 2023.03.07 UNITY TECH SF

AI summary

Embodiments facilitate the calibration of cameras in a live action scene using drones. In some embodiments, a method configures a plurality of reference cameras to observe at least one portion of the live action scene. The method further configures one or more moving cameras having unconstrained motion to observe one or more moving objects in the live action scene and to observe at least three known reference points associated with the plurality of reference cameras. The method further receives reference point data in association with the one or more moving cameras, where the reference point data is based on the at least three known reference points. The method further computes a location and an orientation of each moving camera of the one or more moving cameras based on one or more of the reference point data and one or more locations of one or more reference cameras of the plurality of reference cameras.