Reference Picture Set Management for Video Coding Error Resilience
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems face challenges in preventing temporal and spatial error propagation during inter-frame coding, particularly in environments with limited reference picture memories, which can lead to inefficiencies in compression and error resilience.
Innovation Solution
The implementation of a modified inter-frame coding system that includes error recovery mechanisms, such as remapping instructions and flexible buffer management, to ensure accurate reference frame selection and maintenance, even in the presence of packet loss, using H.264 standards and RTP/AVPF protocols for efficient error handling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If inter-frame differential coding is used to improve compression efficiency, then compression ratio is improved, but error propagation increases
Solution Approach 1:
The reference picture buffer is segmented into multiple regions (first region for L0 list, second region for L1 list, third region for additional references) to organize reference frames differently for different prediction lists, allowing selective management of reference frames to limit error propagation while maintaining compression efficiency
Solution Approach 2:
The patent changes the organizational parameters of reference picture buffer by introducing separate region assignments for different prediction lists (L0 and L1) and implementing selective clearing of reference frames based on their region assignments, thereby controlling error propagation dynamics
2Reliability
If reference picture buffer size is increased to improve error resilience, then error recovery capability is improved, but memory usage increases
Solution Approach 1:
The patent implements selective clearing of reference frames from specific regions of the buffer based on their assignment to prediction lists, allowing the system to discard potentially erroneous references while preserving useful ones, thereby maintaining error recovery capability without requiring excessive buffer size
Solution Approach 2:
The reference picture buffer management is made dynamic through selective clearing operations that adaptively remove reference frames from specific regions based on current encoding needs and error conditions, optimizing the balance between error resilience and memory utilization
3Reliability
If selective clearing of reference frames is implemented to reduce error propagation, then error control is improved, but buffer management complexity increases
Solution Approach 1:
The reference picture buffer is divided into distinct regions (first region, second region, third region) with specific assignment rules for different prediction lists, enabling targeted clearing operations that simplify error control logic by operating on well-defined segments rather than the entire buffer
Solution Approach 2:
Different regions of the reference picture buffer are assigned different qualities or priorities based on their association with specific prediction lists, allowing the system to apply different clearing strategies to different regions, thereby improving error control while maintaining manageable complexity through localized management
Data Source
Figure 1
Figure 2A~2B
Figure 3~5
AI summary
A video encoder using inter-frame differential coding has a store (3) for containing a plurality of reference pictures. For each incoming picture it chooses one (or more) of the stored reference pictures to use. Control means (10) select which locally decoded pictures are to be entered into, and removed from, so that the store always contains at least one relatively older picture that lies within a defined time window and at least one relatively younger picture that is more recent than the time window. When it receives an error message from a receiver, it switches the coder from its normal a state (in which it is allowed to choose any picture as predictor) into a state in which it is permitted to choose only a said relatively older picture for prediction. The beginning of the time window is preferably set according to the estimated (or observed) round trip time between the encoder and decoder such that at least one of the relatively older pictures always predated the error message.