Synchronizing Motion Data with Audio Video via Timing Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies do not effectively synchronize motion data with audio/video recordings for playback, limiting the ability to enhance viewing experiences with vibro-kinetic effects in action camera footage.
Innovation Solution
A method and system that capture and synchronize motion data with audio/video streams by producing timing markers, processing the audio/video stream to detect these markers, and aligning motion data with the stream's timing information for synchronized playback, allowing motion simulators to recreate the recorded motion experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If motion data is captured separately from audio/video recording, then motion data can be obtained for playback, but synchronization between motion data and audio/video stream cannot be achieved
Solution Approach 1:
The patent introduces timing markers as an intermediary element that bridges the audio/video stream and motion data. These markers are embedded in the audio/video stream at specific time points and serve as reference points for synchronizing the separately captured motion data with the corresponding video frames during playback.
Solution Approach 2:
The patent performs preliminary action by embedding timing markers into the audio/video stream during the recording phase. This advance preparation ensures that when motion data is captured separately and later synchronized, the timing reference information is already available, eliminating the need for complex post-processing synchronization.
2Reliability
If timing markers are embedded in the audio/video stream, then synchronization reference information is available, but the audio/video stream processing complexity increases
Solution Approach 1:
The patent extracts the timing marker detection function as a separate processing step. The audio/video stream is processed to detect and extract timing marker information, which is then used independently for synchronization purposes. This separation simplifies the overall system by isolating the complexity of timing marker handling from the main audio/video processing pipeline.
Data Source
AI summary
The present disclosure provides methods and systems for synchronizing motion data with an audio/video stream. An audio/video stream, which comprises at least one timing marker, is obtained. The audio/video stream is processed to detect the at least one timing marker. Motion data associated with the audio/video stream and timing information for the motion data are obtained, the timing information including timing information regarding the at least one timing marker. The audio/video stream, with the at least one timing marker detected, and the motion data, are output with the timing information.