Adaptive Streaming PES Collection Splicing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current adaptive streaming systems face challenges in seamlessly transitioning between variant streams of different bitrates due to misalignment of video and audio segments, leading to disruptions in playback quality.
Innovation Solution
A method for selecting and splicing video segments by generating packetized elementary streams (PES) collections for old and new bitrates, determining a tolerance-based splicing location, and aligning them to ensure smooth playback, using a processor and memory system to manage variant segments and adjust bitrates based on network conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If adaptive streaming systems transition between variant streams of different bitrates, then bandwidth utilization is optimized, but playback continuity is disrupted due to segment misalignment
Solution Approach 1:
The system performs preliminary actions by pre-generating and buffering PES collections at multiple bitrate variants before playback. When a bitrate transition is needed, the already-prepared alternative PES collection can be immediately switched to, avoiding playback disruptions. This is achieved by maintaining multiple variant PES collections in the buffer, ready for rapid switching based on network conditions.
Solution Approach 2:
The patent introduces an intermediary mechanism - the PES collection structure with splicing capabilities - that mediates between different bitrate variants. The splicing point allows seamless transition by joining PES packets from different bitrate collections at a defined boundary, acting as an intermediary that smooths the transition and maintains playback continuity during bitrate changes.
2Adaptability or versatility
If variant segments are spliced to enable bitrate transitions, then adaptability is improved, but segment alignment precision deteriorates
Solution Approach 1:
The video stream is segmented into discrete PES (Packetized Elementary Stream) collections that can be independently managed and spliced. Each PES collection contains a defined set of video and audio packets with synchronized timestamps. This segmentation allows precise control over transition points, as splicing occurs at defined PES collection boundaries rather than within arbitrary segment boundaries, thereby maintaining alignment precision while enabling adaptability.
Solution Approach 2:
The system changes parameters by adjusting the bitrate selection based on network conditions while maintaining consistent temporal parameters (timestamps, synchronization points) across different bitrate variants. The splicing mechanism preserves temporal parameter alignment by joining PES collections that share compatible timestamp structures, allowing bitrate parameter changes without sacrificing temporal synchronization precision.
Data Source
AI summary
Disclosed herein are system, apparatus, article of manufacture, method, and/or computer program product embodiments for selection of video segments for adaptive streaming. An embodiment operates by receiving one or more variant segments, the one or more variant segments including an old bitrate variant segment having an old bitrate and a new bitrate variant segment having a new bitrate for decoding and playback. The embodiment further operates by generating an old bitrate packetized elementary stream (PES) collection based on the old bitrate variant segment and a new bitrate PES collection based on the new bitrate variant segment and determining a first in-tolerance splicing location between the old bitrate PES collection and the new bitrate PES collection based on a maximum tolerance offset. The embodiment still further operates by splicing the old bitrate PES collection and the new bitrate PES collection based on the first in-tolerance splicing location.