HLS Streaming Helper Data for Trick Play and Stream Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional HLS streaming systems face challenges in supporting trick plays and switching between variant streams at intermediate points due to the need to analyze and download entire media files, leading to sluggish performance and limited support for fast forward, reverse, and seek operations, especially in low bandwidth situations.
Innovation Solution
The solution involves a streaming server generating and providing playlist files with URLs for media files containing reference frames, along with helper data files that include location, size, and timestamp information for each reference frame, allowing client devices to efficiently download and access specific frames for quick trick play operations and seamless switching between variant streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional HLS streaming systems download and analyze entire media files to support trick plays and switching, then complete media content is available for playback, but system performance becomes sluggish and latency increases
Solution Approach 1:
The patent extracts only the essential reference frames (I-frames) from media files and stores them in a helper data file with metadata information, rather than requiring clients to download and analyze entire media files. This extraction principle enables fast forward, reverse, and seek operations by providing access points without the overhead of processing complete files, thus reducing latency while maintaining trick play functionality.
Solution Approach 2:
The patent segments media content into individual reference frames that can be independently accessed and downloaded. By dividing the media file into discrete reference frame units with associated metadata (location, size, timestamp), the system allows clients to download only specific frames needed for trick plays rather than entire files, improving operational efficiency and reducing time delays.
2Adaptability or versatility
If conventional systems download entire media files to enable switching between variant streams, then seamless switching is possible, but data transfer volume increases and bandwidth is consumed
Solution Approach 1:
The patent extracts reference frame information and metadata into a separate helper data file, allowing clients to switch between variant streams by downloading only essential reference frames rather than entire media files. This extraction enables stream switching capability while dramatically reducing the quantity of data that must be transferred over the network.
3Measurement precision
If conventional HLS systems analyze entire media files to locate reference frames, then accurate frame positioning is achieved, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary action by pre-generating and storing helper data files that contain metadata information about reference frame locations, sizes, and timestamps before clients need to perform trick plays. This preliminary preparation eliminates the need for real-time analysis of entire media files, achieving accurate frame positioning instantaneously without processing delays.
Solution Approach 2:
The patent creates a simplified copy of media file information in the form of a helper data file that contains essential metadata (location, size, timestamp) without duplicating the actual media content. This copying approach provides accurate reference frame positioning information while avoiding the computational overhead of analyzing original media files.
Data Source
AI summary
A method includes downloading a playlist file for a multimedia presentation over a network from a streaming server using a transfer protocol, the playlist file including an ordered list of URIs for a plurality of media files, each of the plurality of media files including compressed video data corresponding to a segment of the multimedia presentation and containing reference frames; downloading a data file that includes reference frame information indicating a location of the reference frame in the media file; performing a trick play related to a displaying of the multimedia presentation; selecting, from a plurality of variant streams, a first variant stream for use in displaying the multimedia presentation; and reassembling segments included in media files associated with a first variant stream of the plurality of variant streams to play the multimedia presentation as a continuous stream.