Placeshifting Thumbnail Generation from I-Frame Key Frames
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional placeshifting systems face difficulties in providing seamless seeking and trick play functions for live-encoded media streams due to the real-time encoding and network communication challenges, making it hard for users to skip ahead or backward during live broadcasts.
Innovation Solution
Deriving thumbnail images from I-frames or key frames of the source video stream, tagging them with presentation time stamps, and providing these images to the media player to allow precise seeking and trick play functionality by resuming encoding at the identified frame.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If live encoding is used for placeshifting, then real-time transmission is achieved, but seeking and trick play functions become difficult
Solution Approach 1:
The system generates and stores thumbnail images from I-frames in advance during the live encoding process. These pre-generated thumbnails are associated with their corresponding presentation time stamps (PTS) and made available to the media player before seeking operations are needed, enabling fast and accurate seeking without disrupting real-time encoding
Solution Approach 2:
The system creates thumbnail copies of key frames (I-frames) from the live video stream. These thumbnail images serve as visual representations that can be displayed in the media player's interface, allowing users to select desired playback positions without requiring the entire video stream to be pre-encoded or stored
2Ease of operation
If conventional streaming is used, then seeking is straightforward, but live encoding capability is lost
Solution Approach 1:
The system divides the video stream into discrete key frames (I-frames) and generates separate thumbnail images for each. Each thumbnail is independently associated with its PTS value, allowing the media player to jump to specific segments of the video by selecting appropriate thumbnails, thus enabling seeking functionality in live-encoded streams
3Loss of time
If thumbnails are derived from live-encoded stream, then real-time preview is possible, but future imagery is unavailable
Solution Approach 1:
The placeshifting device generates thumbnails from incoming I-frames as soon as they are received during live encoding, storing them with their PTS associations in advance. This preliminary generation of thumbnails from available key frames allows the media player to display previews and enable seeking without waiting for future video content to arrive
Data Source
AI summary
Seek and other trick play functions can be improved in placeshifting and similarly live-encoded video streams. Thumbnail images are derived from I-frames (or similar key frames) of the source video stream rather than from the live-encoded stream. The thumbnail images are tagged to indicate a presentation time stamp (PTS) or similar identification of the source video frame that was used to create the thumbnail image. The tagged thumbnails are provided to the media player, which renders the images to indicate different portions of the video stream as the viewer scans or performs other functions. When the viewer selects to skip to a different part of the video stream, the PTS or similar identifier associated with the presented thumbnail image is sent to the placeshifting encoder to identify the appropriate starting point to resume live encoding.