Ultra-Low Latency Live Streaming via Embedded Playlist Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current live streaming technologies face challenges in achieving ultra-low latency while scaling, due to limitations in protocols like RTP and RTMP, which result in high costs and resource inefficiencies, and PULL-STREAMING introduces higher latency and complexity.
Innovation Solution
The method involves ahead-of-time requests for Media Segments and embedding incremental Playlist Data into Media Segments, allowing for real-time transfer and reduced latency, using a hybrid PUSH-PULL-STREAMING distribution network that optimizes resource utilization and reduces playback delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If PULL-STREAMING is used to deliver live content, then scalability and resource efficiency are improved, but latency increases and complexity is introduced
Solution Approach 1:
The system performs preliminary actions by having the viewer send requests for media segments ahead-of-time before the segments are actually generated. This allows the server to prepare and transfer segments as soon as they become available, eliminating the traditional delay where the viewer must wait for the segment to be generated, listed in a playlist, and then requested. The patent implements this by allowing requests for future segments and automatically transferring segments when they come into existence.
Solution Approach 2:
The invention extracts the playlist data from the traditional separate playlist file and embeds it directly within the media segment data. This eliminates the need for separate playlist requests and reduces the number of HTTP requests required. The essential playlist information is now contained within the media segment itself, allowing the viewer to receive both the media content and the necessary playback information in a single transfer.
2Loss of time
If RTP or RTMP protocols are used for live streaming, then ultra-low latency is achieved, but cost and infrastructure complexity increase
Solution Approach 1:
The system makes HTTP/2 serve multiple functions by using it not only for standard web content delivery but also for ultra-low latency live streaming. By leveraging HTTP/2's capabilities for binary data transfer, server push, and multiplexing, the patent enables a single protocol to handle both traditional web traffic and real-time streaming requirements, eliminating the need for specialized streaming protocols like RTMP or RTP.
Solution Approach 2:
The invention replaces the complex mechanical systems of specialized streaming protocols (RTP, RTMP) with a simpler HTTP/2-based system. Instead of requiring dedicated streaming servers, custom protocol implementations, and complex signaling mechanisms, the system uses standard HTTP/2 requests and responses over TCP, leveraging existing web infrastructure to achieve ultra-low latency streaming.
3Loss of time
If media segment duration is reduced to decrease latency, then playback delay is reduced, but network overhead and request frequency increase
Solution Approach 1:
The system merges the playlist data with the media segment data by embedding essential playlist information directly within the media segment. This consolidation eliminates the need for separate playlist files and reduces the number of HTTP requests required. The viewer receives both the media content and the necessary playback metadata in a single transfer, reducing network overhead despite using short segment durations.
Data Source
AI summary
The present invention provides a major innovative development in low latency live streaming at scale which includes a Viewer to transmit a series of requests for Media Segments ahead-of-time the Media Segment data is expected to exist and a Server capable of delivering Media Segment data, as it is being generated, to one or more Viewers. Specifically, the invention incorporates a method of embedding Playlist Data into Media Segment data to enhance ultra-low latency playback, while providing an immediate transferring of essential Playlist Data to the Viewer.