Adaptive Bitrate Video Segmentation with Selective Picture Buffer Resets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional Adaptive Bitrate (ABR) streaming systems incur unnecessary resets of the picture reference buffer due to the use of instantaneous decoder refresh (IDR) frames, leading to inefficient video quality and compression.
Innovation Solution
Implementing a system where segments with I-frames do not reset the picture reference buffer, while segments following a bitrate switch start with IDR frames, allowing seamless transitions and improved video quality by referencing previous frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If IDR frames are used for each SAP in conventional ABR streaming, then the decoder can prevent referencing previous frames from previous streams with different bitrate/resolution/quality, but the picture reference buffer is reset unnecessarily even when network conditions are steady, degrading video quality and compression efficiency
Solution Approach 1:
The patent segments SAPs into two types: IDR SAPs for bitrate switching scenarios and non-IDR SAPs for steady network conditions. This segmentation allows the system to apply different buffer reset behaviors based on the operational context, avoiding unnecessary resets while maintaining decoder accuracy when needed.
Solution Approach 2:
The patent introduces dynamic selection of SAP types based on network condition changes. When network conditions change, IDR SAPs are used to reset the buffer; when conditions are steady, non-IDR SAPs allow the buffer to be maintained. This dynamic adaptation resolves the contradiction between always resetting (ensuring accuracy) and never resetting (maintaining efficiency).
2Ease of operation
If IDR frames are used throughout an ABR stream, then stream access points are properly defined with buffer resets, but video quality and compression efficiency deteriorate due to unnecessary buffer resets during steady network conditions
Solution Approach 1:
The patent applies different qualities of SAPs to different locations in the stream based on local needs. IDR SAPs with buffer resets are applied at locations where bitrate switching may occur, while non-IDR SAPs without buffer resets are applied at locations where network conditions are steady. This local differentiation maintains both proper SAP definition and high video quality.
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
Systems and methods are described herein for processing video. An encoder may generate, for a sequence of video frames, a plurality of first segments and a plurality of second segments. The plurality of first segments may comprise stream access points (SAPs) of a first type that do not reset a picture reference buffer. The plurality of second segments may comprise SAPs of a second type that do reset the picture reference buffer. The encoder may send segments of the plurality of first segments to a computing device streaming video when network conditions are steady. The encoder may send a segment of the plurality of second segments following a switch, by the computing device, to a different bitrate based on a change to the network conditions. Once the computing device has decoded the segment the plurality of second segments, the encoder may send subsequent first segments at the different bitrate.