Audio Video Signal Synchronization via Fingerprint Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for synchronizing audio and video signals require manual intervention and are not suitable for automatic synchronization, especially in complex distribution and processing scenarios, and existing systems are limited in flexibility and scalability.

Innovation Solution

The method involves generating and comparing fingerprints of audio and video signals at specific time points to determine synchronization points, allowing for automatic synchronization without modifying the signals, and enabling synchronization of multiple signals using a database of stored fingerprints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual synchronisation is used, then synchronisation accuracy can be achieved, but automation and efficiency are reduced

Engineering Contradiction:
Improvesynchronisation accuracyVSAvoidautomation level
Core Design Contradiction:
Measurement precisionVSExtent of automation

Solution Approach 1:

The patent creates a fingerprint representation of the audio signal envelope and embeds it into the video signal. This fingerprint copy allows automatic comparison and synchronization without requiring manual analysis of the original signals, thus achieving both accuracy and automation.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The embedded fingerprint acts as an intermediary element that carries synchronization information. By comparing the extracted audio envelope fingerprint with the embedded fingerprint in the video signal, the system automatically determines synchronization points without direct manual intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Extent of automation

If watermark embedding is used for synchronisation, then automatic synchronisation is enabled, but system complexity and signal modification requirements increase

Engineering Contradiction:
Improveautomatic synchronisation capabilityVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent extracts only the essential envelope information from the audio signal to create a simplified fingerprint representation. This extraction reduces the complexity compared to processing the entire audio signal, while still enabling automatic synchronization through the embedded fingerprint comparison.

Inventive Principle:
Principle #2Taking out (Extraction)

3Extent of automation

If watermark embedding is used, then synchronisation can be achieved, but flexibility for multiple audio streams is limited

Engineering Contradiction:
Improvesynchronisation capabilityVSAvoidflexibility for multiple audio streams
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent segments the audio signal into discrete fingerprint points that can be independently compared with corresponding video fingerprint points. This segmentation allows the system to handle multiple audio streams by processing and comparing discrete synchronization points rather than requiring complete signal embedding for each stream.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If signal modification is required for synchronisation, then synchronisation accuracy can be improved, but signal integrity and authenticity are reduced

Engineering Contradiction:
Improvesynchronisation accuracyVSAvoidsignal integrity
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent creates a fingerprint copy of the audio envelope and embeds it into the video signal without modifying the original audio signal. This copying approach maintains signal integrity and authenticity while still enabling accurate synchronization through the embedded fingerprint comparison.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS7907211B2Method and device for generating and detecting fingerprints for synchronizing audio and video
Publication Date: 2011.03.15 GRACENOTE INC
  • US7907211B2 patent drawing
  • US7907211B2 patent drawing
  • US7907211B2 patent drawing

AI summary

This invention relates to a device and a method of generating a first and a second fingerprint (102,104) usable for synchronisation of at least two signals (101,103) and corresponding method and device for synchronising two or more signals. A fingerprint pair is generated on the basis of a segment of a first signal e.g. an audio signal and of a segment of a second signal e.g. a video signal at each synchronisation time point. The generated fingerprint pair(s) are stored in a database (203) and communicated or distributed to a synchronisation device (303). During synchronisation, fingerprint(s) of the audio signal and fingerprint(s) of the video signal to be synchronised are generated and matched against fingerprints in the database. When a match is found, the fingerprints also determine the synchronisation time point, which is used to synchronise the two signals. In this way, a simple, reliable and efficient way of synchronising at least two signals is obtained. Further, this is enabled without modifying either the first and second signal (or subsequent signals). The signals may even be distorted or changed to some extent while still enabling synchronisation.