Multi-Camera Timing Calibration via Display Object
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In mixed reality systems, synchronizing images captured by multiple cameras to ensure time-alignment is challenging, particularly in applications like virtual and augmented reality where precise tracking of user movements and environments is required.
Innovation Solution
A data processing system that includes a method for timing calibration, using a display object with changing characteristics (like color or brightness) to detect timing differences across multiple cameras, and applying these differences as corrections to align images captured by the cameras.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple cameras are used to capture images in a mixed reality system, then the system can track user position and environment more comprehensively, but the images captured by the various cameras become difficult to synchronise
Solution Approach 1:
The patent uses a display object that changes its display characteristic (such as color or brightness) over time during a timing calibration operation. This changing characteristic serves as a visual signal that can be detected by multiple cameras to determine timing differences in image capture, enabling synchronization without adding physical complexity to the camera system.
Solution Approach 2:
The patent introduces a display object as an intermediary element between the cameras and the timing synchronization process. This display object acts as a mediator that provides a detectable signal for calibrating timing differences, allowing the system to achieve precise time-alignment without directly modifying the camera hardware or adding complex synchronization infrastructure.
2Measurement precision
If timing calibration is performed using a display object with changing characteristics, then timing differences can be detected accurately, but the system requires an additional calibration process
Solution Approach 1:
The system performs timing calibration autonomously by detecting timing differences through the display object's changing characteristics and automatically applying timing corrections to align images from multiple cameras. This self-calibrating approach reduces the need for manual intervention and complex external calibration equipment, making the process more efficient despite the additional calibration step.
3Reliability
If timing corrections are applied to time-align images from multiple cameras, then the visual representation becomes consistent and synchronized, but processing time and computational resources increase
Solution Approach 1:
The patent performs timing calibration in advance during a dedicated timing calibration operation before normal operation. By determining timing differences beforehand and establishing correction values, the system prepares synchronization parameters ahead of time, reducing the computational burden during real-time image processing and minimizing processing delays during actual use.
Data Source
AI summary
A system comprises a display object having a characteristic of its display configured to change with time in a timing calibration operation; a plurality of video cameras configured to capture images of the display object; and a data processing apparatus comprising a detector configured to detect timing differences in the capture of images by the plurality of video cameras indicative of a change in the characteristic of the display object and to apply the detected timing differences as a timing correction so as to time-align images captured by the plurality of cameras after the timing calibration operation.