Audio Stream Timestamping via Embedded Timing Signal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Audio synchronization across multiple microphones and devices is challenging due to differences in timing references and unknown delays, especially in portable devices with size constraints, which affects the accuracy of sound localization and data combination.

Innovation Solution

Embedding a common periodic timing signal, such as a GPS 1PPS signal, Wi-Fi, or cellular signal, into the audio stream to provide a synchronized timing reference, allowing for precise timestamping and alignment of audio samples across devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple microphones are used across multiple devices for audio recording, then audio quality and sound localization accuracy are improved, but timing synchronization between devices deteriorates due to unknown delays and different timing references

Engineering Contradiction:
Improvesound localization accuracyVSAvoidtiming synchronization
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces a common periodic timing signal (such as GPS 1PPS, Wi-Fi, or cellular signal) as an intermediary reference that all devices in the audio system can access. This mediator provides a synchronized timing benchmark that eliminates unknown delays between devices, allowing precise alignment of audio samples from multiple microphones across different devices without requiring complex inter-device communication protocols.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If a common timing reference is introduced across multiple devices, then timing synchronization is improved, but device complexity increases due to additional hardware and signal processing requirements

Engineering Contradiction:
Improvetiming synchronizationVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent leverages universally available timing signals such as GPS 1PPS, Wi-Fi, or cellular signals that are already present in most modern portable devices. By utilizing these existing multi-functional components, the system achieves timing synchronization without adding dedicated hardware, thereby minimizing the increase in device complexity while still providing reliable synchronized timing across multiple devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If high-resolution timing information is embedded in the audio stream, then audio sample alignment precision is improved, but data processing requirements increase

Engineering Contradiction:
Improveaudio sample alignment precisionVSAvoiddata processing energy
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent embeds timing information in advance within the audio data stream itself, rather than performing complex post-processing alignment. By preliminarily tagging audio samples with precise timing markers from the common periodic signal, the system achieves high-resolution audio sample alignment without requiring intensive real-time processing or energy-consuming synchronization algorithms during playback or analysis.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240020334A1Audio with embedded timing for synchronization
Publication Date: 2024.01.18 QUALCOMM INC
  • US20240020334A1 patent drawing
  • US20240020334A1 patent drawing
  • US20240020334A1 patent drawing

AI summary

Techniques are described herein for audio processing. For instance, a technique can include receiving, from one or more microphones, an audio signal; receiving a periodic timing signal based on the periodic timing signal; combining the audio signal and the periodic timing signal into an audio stream; generating a time stamp based on the received periodic timing signal; and adding the generated time stamp to the audio stream based on the periodic timing signal in the audio stream.