Gradual Decoder Refresh Frame Partitioning for Video Error Resiliency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video coding technologies face challenges in error resiliency due to operational errors, such as packet loss, which can lead to loss of prediction references and subsequent frames, disrupting video decoding and playback.
Innovation Solution
The implementation of Gradual Decoder Refresh (GDR) frames, which are partitioned into IDR-coded regions and other regions, allowing for synchronized refresh operations between encoders and decoders, and generating replacement content for non-refreshed portions to maintain prediction references, thereby enhancing error resiliency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If prediction references are used for differential coding to achieve bandwidth compression, then compression efficiency is improved, but error resiliency deteriorates because operational errors can cause loss of prediction references and subsequent frames
Solution Approach 1:
The GDR frame is segmented into multiple slices, where at least one slice is coded using IDR techniques while other slices use inter-picture prediction. This segmentation allows the frame to function both as a prediction reference for bandwidth efficiency and as a refresh point for error resiliency, resolving the contradiction between compression efficiency and error resiliency.
Solution Approach 2:
Different portions of the GDR frame are assigned different coding qualities - the IDR-coded slice provides high-quality reference data for error recovery, while other slices maintain standard compression. This local quality differentiation enables the system to maintain overall compression efficiency while ensuring critical error recovery capability in specific regions.
2Productivity
If a coded frame is designated as a prediction reference to improve compression, then bandwidth utilization is improved, but reliability deteriorates because loss of the prediction reference causes loss of subsequent frames
Solution Approach 1:
The system performs preliminary error recovery action by embedding an IDR-coded slice within the GDR frame before subsequent frames are decoded. This preliminary refresh mechanism ensures that if errors occur, the decoder can recover using the IDR slice without needing to wait for the next I-frame, thus maintaining both bandwidth efficiency and frame recovery reliability.
3Reliability
If Gradual Decoder Refresh frames are partitioned into IDR-coded regions and other regions, then error resiliency is improved, but device complexity increases due to synchronized refresh operations and replacement content generation
Solution Approach 1:
The decoder uses its own existing reference picture buffer to generate replacement content for non-IDR slices by performing prediction operations. This self-service approach eliminates the need for complex external replacement mechanisms, achieving error resiliency through relatively simple operations that leverage already-available decoder resources.
4Reliability
If replacement content is generated for non-refreshed portions of GDR frames, then prediction reference availability is improved, but loss of information increases due to content replacement
Solution Approach 1:
The replacement content generated for non-IDR slices serves as a temporary, disposable solution to maintain prediction reference availability. The system accepts that this replacement content may not perfectly match the original and is used only until the next GDR frame provides an updated reference, balancing prediction reference availability against acceptable information loss.
Data Source
AI summary
Techniques are disclosed for managing reference frames for gradual coder refresh (GDR) operation. A GDR frame may be partitioned into a plurality of units, at least one of which is coded by instantaneous decoder refresh (IDR) techniques and other(s) of which are coded by other techniques such as inter-coding. The coded GDR frame may be exchanged between an encoder and a decoder. The encoder and decoder both may decode the GDR frame. The encoder and decoder may store the IDR-coded portion of the GDR frame in a reference picture buffer in a modified frame that includes, for the other portion(s) of the GDR frame, replacement content instead of the content obtained by decoding. The modified reference frame are expected by bias prediction search operations performed on later frame toward selection of the IDR-coded content as opposed to the replacement content.