AV Stream Synchronization via Common Reference Clock

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In traditional broadcasting systems, live events are captured using multiple cameras, but viewers can only access an AV stream produced by the event owner, limiting their choice and synchronization of different AV streams due to varying timing parameters and transmission latencies.

Innovation Solution

A system for presentation timeline synchronization across AV streams allows viewers to mark points in time in one stream and correlate them with other streams, even when timing parameters are not synchronized, using a metadata server and common reference clock timestamps to synchronize video streams and enable seamless switching between different AV streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple AV streams are provided for a live event, then viewer choice and content diversity are improved, but synchronization between streams deteriorates due to varying timing parameters and transmission latencies

Engineering Contradiction:
Improveviewer choiceVSAvoidsynchronization
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces a common reference clock timestamp as an intermediary element that mediates between multiple AV streams with different timing parameters. Each stream is tagged with timestamps from this common reference clock, allowing the viewer's device to act as a mediator that reconstructs synchronized playback by selecting packets from different streams that share the same reference timestamp, thus resolving the synchronization problem while maintaining multiple stream options

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the timing parameter representation by converting absolute timing parameters from individual stream clocks into relative timing offsets from a common reference clock. This parameter transformation allows streams with different clock rates and offsets to be synchronized by comparing their relative positions to the common reference, enabling seamless switching between streams while maintaining temporal coherence

Inventive Principle:
Principle #35Parameter changes

2Ease of manufacture

If each AV stream uses independent timing parameters, then stream production flexibility is improved, but cross-stream correlation becomes difficult

Engineering Contradiction:
Improvestream production flexibilityVSAvoidcross-stream correlation
Core Design Contradiction:
Ease of manufactureVSDifficulty of detecting and measuring

Solution Approach 1:

The common reference clock serves as a mediator that bridges independent stream timing systems. Each stream continues to use its own production timing independently, but packets are annotated with the reference clock timestamp corresponding to their presentation time. This allows cross-stream correlation without interfering with the independence and flexibility of individual stream production

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the timing information into two independent components: the stream-specific timing parameters that maintain production flexibility, and the common reference clock timestamps that enable cross-stream correlation. This segmentation allows each component to serve its specific function without compromising the other

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9609373B2Presentation timeline synchronization across audio-video (AV) streams
Publication Date: 2017.03.28 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US9609373B2 patent drawing
  • US9609373B2 patent drawing
  • US9609373B2 patent drawing

AI summary

A system for presentation timeline synchronization across audio-video (AV) streams associated with a common event may include memory and a processor. The processor may be configured to receive metadata items from a user device during a live event, the metadata items corresponding to points-in-time marked by the user while being presented with an audio-video (AV) stream associated with the live event. The metadata items may include timing indicators that are indicative of the marked points-in-time relative to the start of the live event. The processor may be configured to provide to the user device with other AV streams associated with the live event that were available at one of the points-in-time marked by the user. The processor may be configured to provide the other AV streams to the user device beginning with a frame that corresponds to the one of the points-in-time marked by the user.