Acoustic Fingerprint Synchronization for Content Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods require embedding watermark data in sound for each video scene, making content synchronization challenging, especially in silent situations or where continuous sound is present, and fail to discriminate between identical sounds in different time zones.
Innovation Solution
A content reproduction program and device that detect sound and determine the time axis of subsequent content using a sound detection unit and time axis determination unit, allowing synchronized reproduction of third content based on the detected sound.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If watermark data is embedded in sound for each video scene, then content synchronization accuracy is improved, but manufacturing workload increases
Solution Approach 1:
The patent extracts the synchronization function from watermark embedding and implements it through acoustic signal detection and fingerprint matching. Instead of embedding watermarks in every scene, the system detects acoustic signals from the video output and matches them against a database of known video fingerprints to determine timing information, thereby eliminating the need for manual watermark embedding while maintaining synchronization accuracy
Solution Approach 2:
The patent replaces the mechanical process of watermark embedding with an acoustic detection system. The system uses microphones to capture sound output from the video device, processes these acoustic signals through fingerprint matching algorithms, and automatically determines synchronization timing, substituting manual content processing with automated acoustic analysis
2Ease of manufacture
If fingerprint is used to determine video time axis, then manufacturing convenience is improved, but reliability deteriorates in silent or continuous sound situations
Solution Approach 1:
The patent creates and stores a database of video fingerprints and their corresponding time axis information in advance. This preliminary preparation allows the system to quickly match detected acoustic signals against known video content without requiring real-time analysis, improving both manufacturing convenience and reliability by pre-processing synchronization data
Solution Approach 2:
The patent introduces an acoustic signal as an intermediary between the video content and the synchronization system. Instead of directly analyzing video frames or embedded watermarks, the system detects acoustic signals produced by the video output, which serve as a reliable mediator that can be matched against the pre-stored fingerprint database to determine timing information
3Ease of operation
If fingerprint is used for sound identification, then ease of operation is improved, but measurement precision deteriorates when identical sounds occur in different time zones
Solution Approach 1:
The patent adds temporal dimension to the fingerprint matching process by associating each fingerprint with its specific time axis information and position data. When matching acoustic signals, the system not only identifies the sound content but also determines its temporal position and duration, enabling differentiation between identical sounds occurring at different times through multi-dimensional parameter comparison
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The time axis of certain content is easily and reliably determined, and other content is reproduced in synchronization with the reproduction of the content. A content reproduction program causes a computer to implement: a sound detection unit that detects sound of first content reproduced outside the computer; a time axis determination unit that determines, on the basis of the detected sound, a time axis of second content reproduced subsequent to the first content outside the computer; and a content reproduction unit that reproduces third content corresponding to the second content in synchronization with reproduction of the second content on the basis of the determined time axis.