Microphone Timestamp Embedding for Audio Video Sync

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for synchronizing audio and video signals, especially in wireless transmission, often result in unpredictable time delays due to uncoordinated wireless transmission paths and bidirectional data protocols, leading to disruptive delays when viewed together.

Innovation Solution

A method involving a microphone unit that generates and stores timestamps with the audio signal and outputs an optical synchronization signal, allowing for post-synchronization with video signals by extracting optical timestamps from the video signal, enabling correct time association without additional hardware or initial synchronization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If wireless transmission protocols (WLAN, Bluetooth, DECT, wifi) are used to transmit audio signals, then wireless transmission without cables is achieved, but unpredictable time delays occur due to coordinated data packet transmission and bidirectional protocols

Engineering Contradiction:
Improvewireless transmissionVSAvoidtime delay
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent embeds synchronization information (timestamps, frame numbers, or pattern signals) into the audio signal before transmission. This preliminary action allows the receiving device to later align the audio with the video signal without requiring real-time coordination or bidirectional communication, thereby eliminating unpredictable time delays while maintaining wireless transmission convenience

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces synchronization signals as an intermediary element carried within the audio signal stream. These signals act as a mediator between the audio and video streams, enabling precise temporal alignment without requiring direct coordination between the transmitting and receiving devices during the actual audio transmission

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If additional synchronization hardware is added to correct time delays, then accurate audio-video synchronization is achieved, but device complexity and cost increase

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidhardware complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the existing audio signal serve multiple functions: it carries both the audio information and the synchronization information (timestamps, frame numbers, or pattern signals). This multi-functionality eliminates the need for separate synchronization hardware, as the audio signal itself becomes the carrier of timing data that enables precise synchronization with the video stream

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The audio signal performs self-synchronization by embedding timing information within itself. The receiving device extracts this synchronization information from the audio stream and uses it to align the audio with the video signal, allowing the system to correct its own timing issues without external intervention or additional specialized hardware

Inventive Principle:
Principle #25Self-service

3Measurement precision

If initial synchronization between microphone unit and camera unit is performed, then accurate time association is achieved, but additional hardware and complex setup procedures are required

Engineering Contradiction:
Improvetime association accuracyVSAvoidsetup complexity
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent embeds synchronization information into the audio signal at the source before transmission begins. This preliminary action ensures that timing data is already available for alignment without requiring any initial synchronization setup or configuration between the microphone unit and camera unit, simplifying the overall system deployment

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach ensures accurate synchronization of audio and video signals, even with unknown time delays, allowing for seamless integration of audio into video recordings without additional hardware, and supports both wireless transmission and subsequent alignment of audio and video signals.

Implementation Method 1

an optical synchronization signal is output by the microphone unit, wherein the optical synchronization signal contains optical timestamps

Methodology Applied
Scientific EffectOptical transmission: Light

Data Source

PatentUS10567827B2Method of detecting and synchronizing audio and video signals and audio/video detection and synchronization system
Publication Date: 2020.02.18 SENNHEISER ELECTRONICS GMBH & CO KG
  • US10567827B2 patent drawing
  • US10567827B2 patent drawing
  • US10567827B2 patent drawing

AI summary

There is provided a method of detecting and synchronizing audio/video signals. At least one audio signal is detected by means of at least one microphone unit. Timestamps are generated and stored together with the detected audio signal in the microphone unit. An optical synchronization signal is output by the microphone unit, wherein the optical synchronization signal contains optical timestamps which are respectively associated with one of the generated timestamps. At least one video signal is detected by means of at least one camera unit. The video signal at least partially has the optical synchronization signal output by the microphone unit. The optical timestamps contained in the optical synchronization signal are extracted. The video signal and the audio signal are synchronized on the basis of the timestamps in the audio signal and the optical timestamps extracted from the detected optical synchronization signal.