Automatic Video Event Selection via Sensor Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for tagging and editing action videos are inefficient, as they rely on manual text descriptions and require operator intervention, making it difficult to find specific events within videos, especially when videos are recorded by amateurs and performance data is not synchronized with the video footage.
Innovation Solution
A system that synchronizes video and performance data using collocated or separate devices, allowing for automatic editing, annotation, and tagging based on performance metrics, such as GPS and inertial sensor data, to identify and select specific events within videos.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual text descriptions and operator intervention are used for tagging and editing action videos, then video footage can be annotated and organized, but the process becomes inefficient and time-consuming, making it difficult to find specific events within videos
Solution Approach 1:
The system enables automatic video tagging and event identification by having the video processing system analyze and tag video content autonomously using performance data synchronization, eliminating the need for manual operator intervention while maintaining accurate event identification
Solution Approach 2:
The patent replaces manual mechanical tagging processes with automated electronic systems that synchronize performance data with video footage, using computational algorithms to automatically identify and tag events based on synchronized sensor data rather than human operators manually reviewing and annotating videos
2Ease of manufacture
If videos are recorded by amateurs without synchronized performance data, then video capture is simple and accessible, but automatic event identification and selection becomes impossible
Solution Approach 1:
The system creates a universal framework that works with both amateur and professional video recordings by implementing a standardized performance data synchronization protocol that can accommodate simple consumer cameras and sensors while enabling automated processing capabilities across different video quality and source levels
Solution Approach 2:
The patent implements preliminary synchronization of performance data with video recording, where sensors and cameras are configured to capture and time-stamp data simultaneously from the outset, enabling automatic event identification later without requiring complex post-processing or manual alignment of video and performance data
3Device complexity
If text-based tagging methods are used for video search, then implementation is simple, but the ability to find specific performance-based events (e.g., jumps longer than one second) is lost
Solution Approach 1:
The system transforms video tagging from simple text-based labels to multi-dimensional performance parameters by synchronizing and analyzing sensor data (acceleration, velocity, position, time) with video footage, enabling precise quantitative event identification such as measuring jump duration and distance while maintaining manageable system complexity through automated processing
Data Source
AI summary
A method according to one embodiment includes: receiving, by a processing system, sensor data from a sensor device carried by a user or attached to the user's sports equipment during a sporting activity; identifying, by the processing system and based on the sensor data, an event engaged in by the user during a time period; determining, based on the sensor data, a position of the user during the event; identifying a camera that is operational and has the user in view during at least a portion of the time period; and selecting video footage of the event from the identified camera.