Organic Camera-Pose Map Growth for Live Augmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for obtaining camera-pose maps for video augmentation require extensive pre-event calibration, which is time-consuming and labor-intensive, often taking between 30 minutes to an hour.
Innovation Solution
A system and method for organically generating a camera-pose map by designating a target location, obtaining a target image, calibrating initial camera-pose images, and automatically determining homography to grow the camera-pose map during an event, using a digital video camera and programmable computer to calculate the camera-pose location and homography, allowing for rapid and systematic search through candidate calibration images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional calibration methods are used to obtain camera-pose maps, then measurement precision and reliability are improved, but the time required for pre-event preparation increases significantly (30-60 minutes)
Solution Approach 1:
The patent applies preliminary action by pre-establishing a set of reference images with known camera-pose parameters before the event. These reference images serve as a pre-computed map that can be quickly queried during the event without requiring time-consuming real-time calibration. The system prepares the calibration data in advance so that during the event, only quick lookups and homography calculations are needed.
Solution Approach 2:
The patent uses copying by creating a digital copy of the venue's visual appearance through a set of reference images with known camera poses. This digital copy (camera-pose map) replaces the need for continuous real-time calibration. The reference images are stored and reused during the event, allowing the system to quickly determine camera pose by matching current images against the pre-existing reference library.
2Reliability
If extensive pre-event calibration is performed to ensure accurate virtual augmentation integration, then the reliability of graphic placement is improved, but the ease of operation and preparation speed deteriorate
Solution Approach 1:
The patent performs all necessary calibration actions in advance by capturing a set of reference images at known camera positions and storing them as a pre-computed camera-pose map. This preliminary preparation ensures that during the event, the system can quickly and reliably determine camera pose by matching against the pre-existing reference library, maintaining high reliability while dramatically improving preparation speed.
Solution Approach 2:
The system applies self-service by automatically matching current event images against the pre-existing reference image library to determine camera pose. The process is automated through image recognition and homography calculations, eliminating the need for manual calibration procedures during the event. The system serves itself by using the reference map to automatically extract pose information without human intervention.
3Measurement precision
If detailed panoramic views are captured to create an accurate camera-pose map, then the measurement precision for sub-pixel accuracy matching is improved, but the time required for data collection increases (30-60 minutes)
Solution Approach 1:
The patent applies preliminary action by capturing a complete set of reference images with known camera poses before the event. This pre-computed camera-pose map contains all the necessary spatial information needed for sub-pixel accurate matching during the event. By preparing this comprehensive reference library in advance, the system achieves high measurement precision without requiring time-consuming real-time data collection.
Solution Approach 2:
The patent creates a digital copy of the venue's visual and spatial characteristics through a set of reference images with embedded camera-pose information. This copied representation (camera-pose map) allows for rapid querying and sub-pixel accurate matching during the event without requiring continuous capture of detailed panoramic views. The reference copy provides all necessary spatial relationships for accurate graphic placement.
Data Source
AI summary
A system and method of organically generating a camera-pose map is disclosed. A target image is obtained of a location deemed suitable for augmenting with a virtual augmentation or graphic. An initial camera-pose map is created having a limited number of calibrated camera-pose images having calculated camera-pose locations and homographies to the target image. Then, during the event, the system automatically obtains current images of the event venue and determines homographies to the nearest calibration camera-pose image in the camera-pose map. The separation in camera-pose space between the current images and the camera-pose images are calculated. If this separation is less than a predetermined threshold, that current image is fully calibrated and added to the camera-pose map, thereby growing the map organically.