Audio Video Stream Synchronization via Dynamic Time Delay Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The synchronization of audio and video streams in online live events is often compromised due to differences in network connectivity and bandwidth, leading to desynchronization issues when users access alternative audio sources not provided by the video provider, such as commentary streams from social media communities.

Innovation Solution

A method and system that allow users to select and synchronize alternative audio streams with video streams by receiving and indexing multiple audio and video data streams, using time delay values and common sound synchronization techniques to ensure synchronization, even when the audio and video are not natively synchronized.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If alternative audio streams from social media communities are used, then user engagement and community interaction are improved, but synchronization reliability deteriorates due to differences in network connectivity and bandwidth

Engineering Contradiction:
Improveuser engagementVSAvoidsynchronization reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system continuously monitors the synchronization status between audio and video streams and uses this feedback to dynamically adjust the audio stream timing. This closed-loop control ensures that even when using alternative audio streams from social media communities with varying network conditions, the synchronization is maintained by constantly detecting drift and applying corrective time delays.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes the time delay parameter of the audio stream dynamically based on detected synchronization errors. By adjusting this parameter in real-time, the system adapts to network condition variations while maintaining synchronization, allowing users to engage with community audio streams without compromising audio-video alignment.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If multiple audio and video data streams are received and synchronized, then user selection flexibility is improved, but system complexity increases due to monitoring and synchronization requirements

Engineering Contradiction:
Improveuser selection flexibilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically monitors synchronization status and applies corrective time delays without requiring user intervention. This self-service approach handles the complexity of managing multiple audio and video streams internally, while users simply benefit from the ability to select different audio sources without needing to understand or manage the synchronization process.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system introduces a synchronization management component that acts as an intermediary between multiple audio/video streams and the user interface. This intermediary handles the complex tasks of receiving, monitoring, and synchronizing multiple streams, thereby simplifying the overall system architecture by centralizing synchronization logic and isolating complexity from both user interactions and stream sources.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If time delay values are applied to correct synchronization errors, then synchronization accuracy is improved, but additional processing time is required

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-calculates and applies time delay values to audio streams based on initial synchronization assessment. By performing this adjustment in advance rather than reactively correcting errors in real-time, the system achieves high synchronization accuracy without adding significant processing delay during stream playback, as the correction is applied proactively before desynchronization becomes apparent.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9979997B2Synchronization of live audio and video data streams
Publication Date: 2018.05.22 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US9979997B2 patent drawing
  • US9979997B2 patent drawing
  • US9979997B2 patent drawing

AI summary

Embodiments of the present invention disclose a method, computer program product, and system for audio and video synchronization. A plurality of audio and video data streams are received on a computer system through a network. Selected audio and video are synchronized, in response to receiving a user selection input of based on the received plurality of audio data streams and the received plurality of video data streams. The synchronized audio and video is monitored periodically. The synchronized audio and video streams are indexed in a data store, based on a synchronization determination of the monitored audio and video data streams. In response to an error in the monitored synchronization, a time delay value option is communicated, to a computing device, through the network, for display. A time delay value is received, based on a user input. A second synchronization based on the received time delay value is performed.