Remote Media Collaboration Synchronization via Delayed Streaming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remote media production faces challenges due to connection latency and jitter, unreliable internet for real-time isochronous connections, and compromised 'talkback' capabilities, making collaborative workflows difficult and affecting the quality of audio and video transmission.

Innovation Solution

The method involves a master system that streams pre-recorded media components to remote talent devices, synchronizing newly-recorded components with delayed streams to ensure near real-time collaboration, including automated dialog replacement and contextual video overlay based on media editing application states, addressing latency and communication issues through delayed signal processing and video buffering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If participants are located remotely for media production, then collaboration flexibility and accessibility are improved, but connection latency and jitter increase making real-time collaboration difficult

Engineering Contradiction:
Improvecollaboration flexibilityVSAvoidreal-time connection reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system segments the media stream into discrete packets that can be independently transmitted and reassembled. This allows the system to handle network latency and jitter by processing individual packets rather than requiring continuous uninterrupted streams, enabling reliable remote collaboration despite network conditions.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-synchronizing clock timestamps and establishing synchronization protocols before actual media transmission begins. This preliminary synchronization enables the system to compensate for subsequent network variability and maintain temporal alignment between distributed participants.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If internet transmission is used for remote media production, then geographic accessibility is improved, but delays and drop-outs occur rendering takes unusable

Engineering Contradiction:
Improvegeographic accessibilityVSAvoidmedia quality consistency
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system implements feedback mechanisms where clock timestamps are continuously exchanged and monitored between distributed systems. This feedback loop enables dynamic adjustment and synchronization compensation, allowing the system to maintain media quality consistency despite network delays and drop-outs by detecting and correcting synchronization drift.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes parameters by dynamically adjusting buffer sizes, timing offsets, and synchronization thresholds based on observed network conditions. These parameter adjustments allow the system to adapt to varying network quality and maintain media quality consistency across different geographic locations.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If real-time audio and video are transmitted over wide area connections, then remote collaboration capability is improved, but quality varies unpredictably

Engineering Contradiction:
Improveremote collaboration capabilityVSAvoidaudio and video quality stability
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system applies dynamics by continuously adapting transmission parameters, buffer sizes, and quality settings based on real-time network conditions. This dynamic adjustment allows the system to maintain relatively stable audio and video quality despite the inherent variability of wide area network connections, preserving remote collaboration capability.

Inventive Principle:
Principle #15Dynamics

4Ease of operation

If talkback capabilities are implemented for remote participants, then interactive communication is improved, but network bandwidth and synchronization complexity increase

Engineering Contradiction:
Improveinteractive communication capabilityVSAvoidsynchronization system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system achieves universality by using the same clock timestamp synchronization mechanism for both media transmission and talkback communication. This multi-functional approach allows talkback capabilities to be implemented without requiring separate synchronization systems, reducing overall complexity while maintaining interactive communication capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11528307B2Near real-time collaboration for media production
Publication Date: 2022.12.13 AVID TECHNOLOGY INC
  • US11528307B2 patent drawing
  • US11528307B2 patent drawing
  • US11528307B2 patent drawing

AI summary

Near real-time collaborative media production by parties located remotely from each other is facilitated by the described methods. Automated dialog replacement with voice talent, editing system operator, and director located remotely from each other is supported by generating synchronized near real-time feeds for the operator and director. Pre-recorded media played back from the editing system is streamed without delay to the talent. A pre-recorded media feed is also delayed to synchronize it with the incoming talent stream, which was recorded in sync with the pre-recorded media stream when received by the talent. The synchronized feed is output to the operator and streamed to the director. Talkback channels and webcam video with appropriate synchronization delays support communication among the parties. Other methods support automatic punch-in and punch-out of remotely recorded dialog replacement, and automatic contextual switching and overlaying of inter-party communication video based on the state of the media editing application.