Multi-Channel Audio Synchronization Verification Using Reference Samples

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As the number of audio channels increases and transitions from a 2D to a 3D layout, audio data synchronization becomes complex, particularly in broadcast networks, leading to challenges in time alignment and data transmission between media processing nodes.

Innovation Solution

A method involving the reception of audio data blocks and associated metadata, where reference audio samples are used to determine synchronization by comparing values obtained at a reference time with values from the data block, utilizing metrics like RMS and loudness to assess alignment, and adjusting accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the number of audio channels increases from 2D to 3D layout, then the audio spatial representation is improved, but the time alignment complexity increases

Engineering Contradiction:
Improveaudio spatial representationVSAvoidtime alignment complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the time alignment verification process into separate channels, where each channel is processed independently using its own reference audio samples and metadata. This segmentation allows the complex 3D audio time alignment problem to be broken down into multiple simpler 1D channel verification tasks, reducing the overall computational complexity while maintaining spatial accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces reference audio samples and associated metadata as intermediary elements that mediate between the transmitted audio data and the expected synchronized output. These reference samples serve as a benchmark for verification, allowing the system to detect and correct time alignment issues without requiring complex real-time adjustment algorithms for each channel.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Quantity of substance

If more audio data is stored and streamed for 3D audio, then the audio quality is improved, but the synchronization issues become more complex

Engineering Contradiction:
Improveaudio data amountVSAvoidsynchronization reliability
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent performs preliminary verification by comparing transmitted audio data against pre-established reference audio samples and metadata before the audio is fully processed or played back. This preliminary action allows synchronization issues to be detected and corrected early in the data stream, preventing accumulation of timing errors as more audio data is processed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a feedback mechanism where the verification results from comparing current audio data with reference samples are used to adjust or correct synchronization parameters. This feedback loop ensures that as more audio data is streamed, the system can adapt to maintain reliable synchronization by using information from previously processed data to guide future alignment decisions.

Inventive Principle:
Principle #23Feedback

3Productivity

If audio data is transmitted between media processing nodes, then the audio distribution is improved, but time alignment issues arise

Engineering Contradiction:
Improveaudio distribution efficiencyVSAvoidtime alignment precision
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent uses reference audio samples and metadata as intermediary verification mechanisms that travel with the audio data stream between media processing nodes. These intermediaries serve as synchronization anchors, allowing each node to verify and adjust its timing independently without requiring complex coordination protocols between nodes, thus maintaining both efficiency and precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces complex mechanical synchronization systems (requiring precise hardware timing and coordination) with a software-based verification approach using audio signal analysis. By substituting hardware-level timing mechanisms with software-based sample comparison and metadata verification, the system achieves time alignment precision while maintaining the high productivity of networked audio distribution.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP3249646B1Measurement and verification of time alignment of multiple audio channels and associated metadata
Publication Date: 2019.04.17 DOLBY LABORATORIES LICENSING CORP
  • EP3249646B1 patent drawingFigure 1
  • EP3249646B1 patent drawingFigure 2
  • EP3249646B1 patent drawingFigure 3

AI summary

Some methods may involve receiving a block of audio data, the block including N pulse code modulated (PCM) audio channels, including audio samples for each of the N channels, receiving metadata associated with the block of audio data and receiving a first set of values corresponding to reference audio samples. A second set of values, corresponding to audio samples from the block of audio data, may be determined. The first and second set of values may be compared. Based on the comparison, it may be determined whether the block of audio data is synchronized with the metadata.