Camera Formation Calibration via Reference Object Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera formations, especially in outdoor and large-scale applications, face challenges with camera calibration stability due to environmental disturbances such as vibrations and wind, leading to noticeable artefacts in VR/AR recordings.
Innovation Solution
A method for continuous calibration of cameras in a formation, involving initial calibration followed by 'online' further calibration during scene capturing. This method uses a reference video frame with a stationary reference object to adapt the six-degrees-of-freedom of cameras, either through virtual or mechanical control, to maintain accurate scene capturing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If cameras are pre-calibrated in factory with fixed parameters, then manufacturing precision is improved, but adaptability to different scene setups deteriorates
Solution Approach 1:
The patent implements an initial calibration step before scene capturing where a reference video frame with a stationary reference object is created. This preliminary calibration establishes baseline camera parameters that can be subsequently adjusted during online calibration, resolving the contradiction between factory pre-calibration and scene-specific adaptability.
Solution Approach 2:
The patent transitions from static factory calibration to dynamic online calibration during scene capturing. The system continuously monitors reference object position in captured frames and adapts camera six-degrees-of-freedom parameters in real-time, enabling both precision and adaptability.
2Reliability
If online further calibration is performed during scene capturing, then reliability of scene recording is improved, but loss of time for calibration operations increases
Solution Approach 1:
The patent performs online calibration continuously during scene capturing without interrupting the recording process. The system monitors reference object position and adjusts camera parameters in real-time, maintaining calibration reliability while avoiding time loss from stopping recording.
Solution Approach 2:
The patent implements a feedback mechanism where the position of the reference object in captured frames is continuously compared against the reference video frame. This feedback drives automatic adjustment of camera six-degrees-of-freedom parameters, ensuring reliable calibration without manual intervention or recording interruptions.
3Ease of operation
If mechanical control of cameras is used for calibration, then ease of operation is improved, but device complexity increases
Solution Approach 1:
The patent replaces complex mechanical calibration systems with virtual calibration through image processing. By detecting reference object position in images and computationally adjusting camera six-degrees-of-freedom parameters, the system achieves easy operation without complex mechanical calibration hardware.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for calibrating at least one of the six-degrees-of-freedom of all or part of cameras in a formation positioned for scene capturing, the method comprising a step of initial calibration before the scene capturing. The step comprises creating a reference video frame which comprises a reference image of a stationary reference object. During scene capturing the method further comprises a step of further calibration wherein the position of the reference image of the stationary reference object within a captured scene video frame is compared to the position of the reference image of the stationary reference object within the reference video frame, and a step of adapting the at least one of the six-degrees-of-freedom of a multiple cameras of the formation if needed in order to get an improved scene capturing after the further calibration.