AR Video Synchronization for Personalized Remote Event Overlays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems for viewing events, whether live or remote, fail to provide personalized and accurate graphics that correspond to individual viewers' perspectives, especially in environments with organic shapes and changing conditions, leading to a suboptimal viewing experience.
Innovation Solution
A system that uses specific feature detection and registration techniques, including the use of fiducials and surveying, to correlate a mobile device's coordinate system with the real-world coordinate system, allowing for precise overlay of augmented reality content based on the viewer's position and orientation, using photogrammetry and structure from motion to create a 3D model of the venue.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If broadcasters insert graphics into broadcast images or provide alternate views, then the viewing experience is optimized for the broadcaster's selection, but the graphics do not correspond to individual viewers' perspectives or viewpoints
Solution Approach 1:
The system pre-establishes a coordinate system for the video content and pre-determines the transformation relationships between different viewpoints. This preliminary setup enables real-time personalized graphics generation without requiring complex runtime computations for each viewer's perspective.
Solution Approach 2:
A coordinate system transformation mechanism serves as an intermediary between the video content and the augmented reality graphics. This intermediary layer enables the conversion of graphics from one coordinate system to another, allowing personalized viewpoint adaptation without direct complex calculations between all possible viewer positions and graphic elements.
2Measurement precision
If augmented reality content is overlaid on video content, then personalized viewing experience is achieved, but synchronization between separately displayed video content and augmented reality content becomes challenging
Solution Approach 1:
The system pre-establishes a coordinate system for the video content and pre-determines transformation relationships between different viewpoints. This preliminary setup enables real-time personalized graphics generation without requiring complex runtime computations for each viewer's perspective.
Solution Approach 2:
The system uses timestamp synchronization and coordinate transformation feedback mechanisms to ensure that augmented reality content remains aligned with video content across different viewpoints. The feedback loop continuously adjusts graphics positioning based on the current video frame and viewer perspective.
Data Source
AI summary
Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (mobile phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event. In a tabletop presentation, video of the event can be displayed with augmented reality graphics overlays at a remote location.