Mobile Device Video Survey Synchronization via Audio Fingerprinting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video survey methods require users to visit a facility equipped with specialized devices to provide moment-by-moment feedback, which is expensive and cumbersome, and synchronization of user input with video playback is challenging due to network delays in satellite or cable television.
Innovation Solution
A system that allows users to take surveys using their personal mobile devices, where the device records audio from the video environment and synchronizes it with the video playback on a network server, enabling accurate alignment and aggregation of survey data with the video timeline.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If users take surveys at a facility with specialized equipment, then synchronization accuracy is improved, but accessibility and convenience deteriorate
Solution Approach 1:
The patent uses audio fingerprinting to create a digital copy/representation of the video audio signal. The mobile device records audio and generates an audio fingerprint that is compared against reference fingerprints from the video to determine synchronization. This copying approach allows consumer devices to achieve professional-grade synchronization accuracy without requiring specialized survey facility equipment.
Solution Approach 2:
The patent replaces the mechanical/specialized survey facility equipment with a software-based audio processing system running on mobile devices. Instead of using specialized hardware for synchronization, the system uses audio recording, fingerprint generation, and algorithmic comparison to achieve precise timing alignment between survey responses and video content.
2Ease of operation
If users take surveys from home using mobile devices, then accessibility is improved, but synchronization accuracy deteriorates
Solution Approach 1:
The system creates audio fingerprints from both the reference video audio and the mobile device's recorded audio. By comparing these fingerprint copies, the system can accurately determine timing offsets and synchronize survey responses to the correct video moments, even when played back on different devices with different audio characteristics.
Solution Approach 2:
The patent dynamically adjusts synchronization parameters based on the specific audio characteristics of each mobile device and playback environment. The system measures actual audio playback timing on the user's device and adjusts the synchronization offset accordingly, allowing accurate results despite variations in different mobile devices and audio environments.
3Reliability
If specialized survey equipment is used, then data synchronization is improved, but device complexity and cost increase
Solution Approach 1:
The patent makes the survey system universal by using standard mobile devices that consumers already possess. The mobile device's existing microphone, processor, and software capabilities are leveraged for audio recording and fingerprint generation. This multi-functional approach eliminates the need for dedicated survey equipment while maintaining synchronization reliability.
Solution Approach 2:
The mobile device performs its own audio recording, fingerprint generation, and synchronization calculations autonomously. The device serves itself by using its built-in resources to create the audio fingerprint and determine timing offsets, rather than relying on external specialized equipment to perform these functions.
Data Source
AI summary
A method includes receiving, at a mobile device, survey data comprising real-time survey user input associated with watching a video program and survey audio from the video program, the survey audio being recorded via a microphone of the user mobile device during the real-time survey, transmitting, to a network server, the survey data as part of a data package, wherein the network server receives an audio file associated with the video program, compares the audio file with the survey audio to yield a comparison and aligns, based on the comparison, the survey audio with the audio file to yield a modified data package and receiving a confirmation of a creation of the modified data package.