Multimedia Stream Synchronization via Audio Fingerprinting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current hybrid TV services lack accurate synchronization of multimedia streams delivered over broadband and broadcast networks, particularly in second screen scenarios where companion terminals need to render content synchronized with broadcast video, but existing solutions require modifying the original media content and are not directly effective.
Innovation Solution
A method using audio fingerprinting and generalized cross-correlation techniques to synchronize multimedia streams by generating original audio fingerprints, comparing them with captured audio data, and correlating to achieve precise synchronization positions, allowing for accurate alignment of multimedia streams without modifying them, using a synchronization device that includes processors for fingerprint generation, comparison, correlation, and synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If audio fingerprinting and cross-correlation techniques are used to synchronize multimedia streams, then synchronization accuracy is improved to within a sample's accuracy, but the device complexity increases due to the need for processors to generate fingerprints, perform comparisons, and execute correlation algorithms
Solution Approach 1:
The patent replaces complex mechanical or manual synchronization methods with signal processing techniques. Specifically, it uses audio fingerprinting (generating unique identifiers from audio segments) and cross-correlation (comparing fingerprint patterns) to automatically determine synchronization positions, substituting what would otherwise require complex timing coordination mechanisms with more straightforward computational methods.
Solution Approach 2:
The patent changes the parameter being measured from raw audio waveforms to extracted audio fingerprints. By transforming the audio signal into a fingerprint representation and then performing cross-correlation on these fingerprints rather than the original signals, the system achieves high synchronization accuracy while reducing computational complexity compared to direct waveform comparison.
2Device complexity
If existing trigger mechanisms are used for interactive applications, then device complexity is reduced, but synchronization accuracy deteriorates because they cannot automatically and accurately synchronize alternative soundtracks with broadcast video
Solution Approach 1:
The patent replaces manual or simple trigger-based synchronization mechanisms with automated audio fingerprinting and cross-correlation processing. The system automatically extracts fingerprints from both the broadcast audio and the alternative soundtrack, then uses cross-correlation to precisely identify synchronization positions without requiring complex manual configuration or timing mechanisms.
Solution Approach 2:
The synchronization system is self-activating and self-adjusting. It automatically captures audio segments, generates fingerprints, performs cross-correlation comparisons, and determines synchronization positions without requiring external intervention or complex control mechanisms. The system serves itself by using the audio content's own fingerprint patterns to achieve precise alignment.
Data Source
AI summary
This method for synchronizing a first multimedia stream rendered on a first terminal and a second multimedia stream rendered on a second terminal, comprises a step of generation, from an original audio sequence of the first stream, of original audio fingerprints, and further comprises steps of:a) generation from a first sequence of the first stream first audio fingerprints;b) comparison between the first fingerprints and the original fingerprints in order to obtain one or more first synchronization positions;c) correlation of the first sequence with one or more pieces of the original sequence located around the first synchronization positions in order to obtain a second synchronization position;d) rendering of the second stream on the second terminal using the second synchronization position.