In-band Control Information Encapsulation in Real-Time Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Real-time streaming control information is often stripped by intermediate devices in networks, leading to poor performance due to the reliance on out-of-band communication channels, which are complex and frequently not utilized, resulting in inadequate redundancy and quality control in real-time streaming connections.
Innovation Solution
Encapsulating control information within the real-time streaming protocol, allowing it to be sent via the same communication channel as the streaming data, using identifiers to mark control packets and adjust redundancy levels in-band, thereby ensuring control information reaches the remote party and enabling adaptive quality management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If control information is transmitted out of band using a separate communication channel, then control information can be sent periodically to monitor streaming quality, but the control information is frequently stripped by intermediate network devices such as NATs and firewalls
Solution Approach 1:
The patent combines control information transmission with the real-time streaming data channel by encapsulating control information within RTCP packets that are transmitted through the same RTP/RTCP channel used for streaming data. This merging eliminates the need for separate out-of-band control channels and ensures that control information traverses the same network path as streaming data, preventing intermediate devices from stripping control information while reducing overall system complexity.
2Reliability
If control information is sent through multiple intermediate network devices, then comprehensive quality monitoring is possible, but the likelihood of control information being stripped increases with each device traversed
Solution Approach 1:
The patent merges control information with streaming data transmission through the same RTP/RTCP channel, ensuring that control information follows the identical network path as streaming data. This approach ensures that if streaming data successfully traverses intermediate devices, control information embedded within the same channel also reaches its destination reliably, eliminating the problem of control information being selectively stripped by intermediate devices.
3Ease of operation
If out of band communication is used for control information, then periodic quality reports can be exchanged, but the process becomes excessively complex and is often not utilized
Solution Approach 1:
The patent merges control information transmission with the existing real-time streaming protocol infrastructure by encapsulating control information within RTCP packets that travel through the same RTP/RTCP channel used for data streaming. This integration eliminates the need for separate out-of-band control channels and their associated complex management, making control information transmission as straightforward as data streaming itself and significantly improving ease of operation.
4Reliability
If control information is encapsulated within the real-time streaming protocol and sent via the same communication channel, then control information reaches the remote party reliably, but the channel must handle both data and control information simultaneously
Solution Approach 1:
The patent applies local quality by differentiating control information from streaming data through encapsulation markers within RTCP packets. Each packet is clearly marked with payload type identifiers that enable receiving devices to distinguish control information from media data at the local processing level. This approach allows reliable transmission of both data and control information through the same channel while maintaining simple protocol processing through clear local differentiation.
Data Source
AI summary
Providing control information is disclosed. A real-time streaming communication channel is established with a communication party using a real-time streaming protocol. It is determined that control information is to be provided to the communication party. The control information is encapsulated using the real-time streaming protocol. The encapsulated control information is marked as including control information content. Streaming content is provided to the communication party via the real-time streaming communication channel using the real-time streaming protocol. The marked encapsulated control information is provided via the real-time streaming communication channel.