Dual-Stream Video Encoding for Latency-Quality Trade-off
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cloud-based video production systems face challenges in delivering real-time interaction with broadcast quality video, as latency issues hinder seamless communication and control during live events, such as news broadcasts or video conferences.
Innovation Solution
A cloud-based video production system encodes video content from multiple sources into two separate streams: a low-latency, low-quality stream for real-time interaction and a high-latency, high-quality stream for broadcast production, with corresponding frames having identical timestamps, allowing for synchronized control and buffering to enable features like instant replay and graphics overlays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video content is transmitted as a single high-quality stream, then broadcast quality is improved, but latency increases making real-time interaction difficult
Solution Approach 1:
The video transmission system is segmented into two separate streams: a high-quality stream for broadcast output and a low-latency proxy stream for real-time control and interaction. This segmentation allows each stream to be optimized for its specific purpose without compromising the other, resolving the contradiction between video quality and latency.
2Loss of time
If video content is transmitted as a low-latency stream, then real-time interaction is improved, but video quality deteriorates
Solution Approach 1:
A proxy video stream serves as an intermediary between the video source and the control system. This proxy stream has reduced quality requirements and lower latency, enabling real-time control decisions to be made based on acceptable-quality video feedback, while the actual high-quality broadcast stream continues independently.
3Device complexity
If a single video stream is used, then system complexity is reduced, but the ability to provide both real-time control and broadcast quality output simultaneously is compromised
Solution Approach 1:
The video encoding system is designed to produce multiple output streams simultaneously from a single input, making the system multi-functional. The same encoding infrastructure handles both real-time control needs and broadcast quality requirements, increasing versatility without proportionally increasing complexity.
Data Source
AI summary
The present invention relates to a cloud-based video production system and corresponding methods that deliver real time or near real time video with broadcast quality. Video from the same source is encoded into at least two separate streams, one with low latency and another with higher latency and higher quality. Corresponding frames of each stream have identical timestamps. The two streams are sent over separate signal paths. A first signal path is a real time control (RTC) path having low latency, and used to communicate the lower quality video content from video sources to a producer user interface. The second signal path provides the same video content at a higher video quality than that provided over the first signal path, but with longer latency. Commands from the user interface based on the lower latency stream can then be carried out on the higher latency stream.