OTT Trick Play via Key Frame Extraction and Bitrate Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Over-the-top (OTT) media delivery systems face challenges in implementing trick play functionality, such as fast forward and rewind, in HTTP adaptive video streams, particularly in bandwidth-limited environments like mobile devices, where traditional methods require duplicate content downloads, wasting bandwidth.
Innovation Solution
The solution involves segment-based HTTP delivery protocols, where trick play is achieved by reordering and rendering key frames at adjusted rates and directions, using segment boundaries for bitrate adaptation, and optimizing bandwidth by downloading only initial portions of segments and aborting unnecessary data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If trick play is implemented by downloading duplicate content for fast forward and rewind, then trick play functionality is achieved, but bandwidth is wasted
Solution Approach 1:
The patent extracts only the necessary key frames from video segments for trick play operations. Instead of downloading duplicate content, the system identifies and retrieves only key frames that are needed for fast forward and rewind functionality, significantly reducing bandwidth consumption while maintaining operational capability
Solution Approach 2:
The system performs preliminary analysis of video segments to identify key frame locations before trick play operations. By pre-processing segments to locate key frames and their timestamps, the system can efficiently retrieve only necessary data during trick play without downloading entire duplicate segments
2Loss of energy
If key frames are extracted from segments for trick play, then bandwidth is saved, but trick play smoothness may be affected
Solution Approach 1:
The patent applies different quality levels to different parts of the trick play process. Key frames are extracted at full quality to ensure visual accuracy, while intermediate frames are handled through temporal repetition or interpolation. This local differentiation maintains smooth playback while minimizing bandwidth usage
Solution Approach 2:
The system makes key frames serve multiple functions: they provide both the visual content for trick play and the temporal reference points for smooth playback. By repeating key frames at appropriate intervals and using them for both display and timing synchronization, the system achieves smooth trick play without requiring additional frame data
3Stability of the object's composition
If segments are prefetched into buffer for playback, then playback continuity is ensured, but bandwidth is wasted downloading duplicate content
Solution Approach 1:
The patent divides video content into segments with clearly defined boundaries and identifies key frames within each segment. This segmentation allows the system to prefetch only necessary key frame data from segments rather than entire duplicate segments, maintaining playback continuity while reducing bandwidth consumption
Solution Approach 2:
The system performs partial prefetching by downloading only the portions of segments containing key frames that are needed for upcoming trick play operations, rather than prefetching complete segments. This partial action approach ensures sufficient data is available for continuous playback while avoiding wasteful duplicate downloads
Data Source
AI summary
A method for trick play (fast forward, rewind, etc.) in video streams using adaptive bitrate HTTP delivery protocols includes playing only portions of a video at a current bitrate to achieve the initial trick play functionality. A new trick play bitrate is selected based on a trick play playout rate, the trick play bitrate for the duration of the trick play is retrieved, and operation is switched back to a previous bitrate when normal playback resumes. A system is also specified for implementing a client and server infrastructure in accordance with the method.