Reference Picture Switching for Error-Resilient Video Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video coding methods using hierarchical coding structures face inefficiencies and error resilience issues when switching from lower to higher temporal levels due to restrictive referencing structures, leading to error propagation and sub-optimal coding efficiency.
Innovation Solution
A resilient picture referencing scheme is introduced, defining boundary pictures for limiting picture referencing and using a predetermined scheme for reference picture list construction, allowing efficient inter-picture prediction and error recovery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a temporal nesting scheme is used to enable switching from lower to higher temporal levels, then switching flexibility is improved, but coding efficiency deteriorates due to highly restrictive referencing structure
Solution Approach 1:
The patent segments the reference picture list into multiple lists (first reference picture list and second reference picture list) based on temporal levels. The encoder can selectively use different reference picture lists for different picture types (e.g., BLA pictures vs. non-BLA pictures), allowing flexible switching between temporal levels while maintaining efficient prediction for each segment type.
Solution Approach 2:
The patent introduces dynamic control mechanisms where the selection of reference pictures and reference picture lists is adaptively determined based on picture type, temporal level, and decoding context. The encoder dynamically adjusts which reference pictures are available and how they are ordered in the reference picture list, enabling efficient switching between lower and higher temporal levels without rigid restrictions.
2Reliability
If restrictive referencing structure is used for temporal scalability switching, then error propagation is reduced, but coding efficiency deteriorates
Solution Approach 1:
The patent applies different referencing strategies to different local contexts (picture types). For BLA pictures, a more restrictive referencing approach is used to ensure error resilience, while for non-BLA pictures, a more flexible referencing approach is used to maximize coding efficiency. This local differentiation allows the system to achieve both error resilience and coding efficiency in their respective contexts.
Solution Approach 2:
The patent changes the parameter of reference picture selection based on picture type and temporal level. By dynamically adjusting which reference pictures are selected and how they are ordered in the reference picture list, the system can optimize for error resilience when needed (using earlier, more reliable reference pictures) and for coding efficiency when possible (using closer, more accurate reference pictures).
Data Source
AI summary
A video encoding method using a plurality of reference pictures includes: selecting whether or not a resilient picture referencing scheme is to be used for encoding video; writing a parameter indicating the selection into a header of an encoded video bitstream; and encoding a picture using inter-picture prediction using a result of the selection.