Audio Fingerprint Synchronization for Multichannel Extension Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio multichannel technologies face challenges in synchronizing multichannel extension data with audio signals, leading to potential time offsets and quality losses during reconstruction, especially when using non-synchronized data paths and systems with unknown or unpredictable delay times.

Innovation Solution

The implementation of block-based fingerprint technology for synchronizing multichannel extension data with audio signals, where block division information is used to calculate and embed reference fingerprints within the audio signal and extension data, allowing for precise correlation and compensation of time offsets, ensuring sample-exact synchronization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multichannel extension data and audio signal are transmitted through separate data paths, then transmission flexibility and compatibility are improved, but time synchronization between the two data streams deteriorates

Engineering Contradiction:
Improvetransmission flexibilityVSAvoidtime synchronization
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces fingerprint information as an intermediary element that is embedded in both the audio signal and multichannel extension data. This mediator enables the receiver to correlate and synchronize the two separately transmitted data streams by matching fingerprint sequences, thus maintaining time synchronization reliability while preserving transmission path flexibility.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The synchronization mechanism uses feedback through fingerprint correlation results to adjust and compensate for time offsets between audio signal and extension data. The receiver calculates time offsets based on fingerprint matching and applies compensation to align the data streams, creating a closed-loop feedback system that maintains synchronization.

Inventive Principle:
Principle #23Feedback

2Device complexity

If decoder delay time is unknown or unpredictable, then system complexity is reduced, but synchronization precision deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidsynchronization precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by embedding fingerprint information into the audio signal and extension data before transmission. This pre-prepared synchronization marker allows the receiver to determine time offsets and apply compensation in advance, achieving sample-exact synchronization without needing to know or predict decoder delay times, thus maintaining low system complexity while achieving high precision.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If time offset compensation is not applied, then processing complexity is reduced, but audio reconstruction quality deteriorates

Engineering Contradiction:
Improveprocessing complexityVSAvoidaudio reconstruction quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The synchronization system uses self-service by having the receiver autonomously calculate time offsets through fingerprint correlation and automatically apply compensation without external intervention. This self-contained mechanism achieves precise audio reconstruction quality while keeping processing complexity manageable through efficient fingerprint-based correlation algorithms.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS8676364B2Apparatus and method for synchronizing multichannel extension data with an audio signal and for processing the audio signal
Publication Date: 2014.03.18 FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV
  • US8676364B2 patent drawing
  • US8676364B2 patent drawing
  • US8676364B2 patent drawing

AI summary

For synchronizing multichannel extension data with an audio signal, wherein the audio signal includes block division information and the multichannel extension data include reference audio signal fingerprint information, the block division information in the audio signal is detected by means of a block detector. Thereupon, block division of the audio signal is performed by a fingerprint calculator according to the block division information in order to obtain a sequence of test audio signal fingerprints. In addition to that, a sequence of reference audio signal fingerprints is extracted from the reference audio signal fingerprint information of the multichannel extension data. Both sequences of fingerprints are correlated in order to obtain a correlation result, by which a compensator is controlled in order to reduce or eliminate a time offset between the multichannel extension data and the audio signal.