Unified RTP Redundancy Scheme for Video Packet Loss
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video delivery systems face challenges in providing robust, loss-free video transmission due to packet losses caused by congestion, link errors, and re-routing events, where Forward Error Correction (FEC) and selective retransmission techniques are inefficient for longer bursts, and require different algorithmic structures and transport encapsulations for spatial and temporal redundancy.
Innovation Solution
A retransmission-based redundancy scheme where redundant media streams are transmitted continuously, using the same transport protocol and logic as primary streams, providing both spatial and temporal redundancy, and allowing receivers to process packets identically regardless of the redundancy method, leveraging Realtime Transport Protocol (RTP) and incorporating spatial and temporal redundancy techniques within the same RTP sessions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If Forward Error Correction (FEC) is used for packet loss repair, then short burst losses can be adequately repaired, but for longer bursts FEC has poor engineering tradeoffs in terms of delay, bandwidth, and complexity
Solution Approach 1:
The patent segments the redundancy mechanism into two distinct modes: spatial redundancy for short-term protection and temporal redundancy for long-term protection. This segmentation allows each mode to be optimized independently, avoiding the complexity of a single universal FEC system while maintaining effectiveness across different loss scenarios.
Solution Approach 2:
The system dynamically switches between spatial and temporal redundancy modes based on network conditions and loss patterns. This dynamic adaptation allows the system to optimize performance for current conditions without being constrained by fixed FEC parameters, reducing overall system complexity while maintaining reliability.
2Reliability
If selective retransmission techniques are used, then packet loss can be repaired, but it is workable only where there is a very short round-trip time between receivers and transmitter
Solution Approach 1:
The patent implements preliminary action by continuously transmitting redundant packets in advance before loss occurs. This eliminates the need for round-trip retransmission requests, as the repair packets are already available at the receiver side, making the system workable regardless of network latency.
Solution Approach 2:
The system creates copies of the media stream (redundant packets) that are transmitted alongside the primary stream. These copies can immediately replace lost packets without requiring retransmission requests, thereby eliminating round-trip time constraints while maintaining repair capability.
3Reliability
If spatial or temporal redundancy techniques are used, then stream redundancy can be provided, but each technique required both different algorithmic structure and different transport encapsulation and encoding
Solution Approach 1:
The patent employs a universal RTP packet structure that can carry both spatial and temporal redundancy information. The same transport encapsulation and algorithmic framework handles both redundancy types, eliminating the need for separate processing paths and reducing system complexity while maintaining both redundancy capabilities.
Solution Approach 2:
The system merges spatial and temporal redundancy techniques into a unified framework using identical RTP encapsulation and processing logic. This consolidation allows transmitters and receivers to support multiple redundancy techniques through a single implementation, significantly reducing design and implementation difficulty.
Data Source
AI summary
In one embodiment, a network session is established for transmitting a media stream. The media stream is encoded into a first set of media stream packets and the first set of media stream packets transmitted according to the established network session. The media stream is also encoded into a second set of retransmission-based repair packets and used as a second redundant copy of the media stream. The second set of retransmission packets are transmitted regardless of receiving any indication of lost or dropped packets during the network session.