Camera Calibration Using Reference Point Triangulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for calibrating cameras in live action scenes for realistic visual production integration of real and digital elements are inefficient, as they require manual adjustment and lack real-time accuracy, especially when multiple cameras capture different data types such as images and depth information.

Innovation Solution

An automated system that uses reference points in images captured by cameras to determine the location and orientation of each camera, employing techniques like triangulation and trilateration based on predetermined distances between reference points, allowing for precise calibration and real-time adjustment of camera positions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual adjustment methods are used for camera calibration, then device complexity is reduced, but measurement precision and calibration accuracy deteriorate

Engineering Contradiction:
Improvecamera calibration accuracyVSAvoidcalibration system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A calibration assembly with known geometry (serving as an intermediary object) is introduced into the scene. This assembly contains reference points with predetermined spatial relationships that mediate between the cameras and the calibration process, enabling automatic determination of camera locations and orientations through mathematical computation rather than manual adjustment

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The manual mechanical adjustment process is replaced with an automated computational system. The system uses image data from multiple cameras, reference point coordinates, and mathematical algorithms (triangulation/trilateration) to automatically calculate and determine camera calibration parameters, eliminating the need for manual mechanical positioning

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If automated calibration using reference points is implemented, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improvecamera location and orientation determination accuracyVSAvoidcalibration system structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The calibration assembly serves multiple functions: it provides reference points for triangulation, establishes spatial relationships, and works with any number of cameras simultaneously. The same assembly structure can be used for different camera configurations and scene setups, making the system universally applicable without requiring complex specialized equipment for each scenario

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Instead of requiring complex physical measurement devices at each camera position, the system uses two-dimensional image copies/projections of the three-dimensional calibration assembly. The reference points are captured as image data, and their known spatial relationships are used to computationally reconstruct camera positions and orientations, replacing physical measurement instruments with digital image processing

Inventive Principle:
Principle #26Copying

3Productivity

If real-time calibration is achieved using multiple reference points, then productivity and calibration speed improve, but measurement precision requirements increase

Engineering Contradiction:
Improvecalibration speedVSAvoidreference point distance measurement accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The spatial relationships and distances between reference points are predetermined and established before the calibration process begins. This preliminary configuration of the calibration assembly with known geometry allows the system to perform rapid real-time calibration computations without requiring complex real-time measurements, as the reference framework is already in place

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses the captured image data of reference points to computationally determine camera locations and orientations. The known predetermined distances between reference points provide a feedback reference framework that enables real-time calculation and verification of camera positions, allowing rapid iteration and adjustment while maintaining precision through the constrained geometric relationships

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11282233B1Motion capture calibration
Publication Date: 2022.03.22 UNITY TECH SF
  • US11282233B1 patent drawing
  • US11282233B1 patent drawing
  • US11282233B1 patent drawing

AI summary

Embodiments facilitate the calibration of cameras in a live action scene. In some embodiments, a system receives images of the live action scene from a plurality of cameras. The system further receives reference point data generated from a performance capture system, where the reference point data is based on at least three reference points, where the at least three reference points are positioned within the live action scene, and where distances between the at least three reference points are predetermined. The system further determines a location and orientation of each camera based on the reference point data.