RAP Identifier Embedding for Video Frame Error Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video coding systems face synchronization issues between encoders and decoders due to transmission errors, particularly when Random Access Pictures (RAPs) are lost, leading to mismatches in coding states and potential decoding failures.
Innovation Solution
Incorporating RAP identifiers in coded frames to detect lost RAP frames and initiate error recovery processes, including clearing reference picture caches and engaging error concealment techniques, while allowing RAP frames to be transmitted mid-session without severe consequences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If RAP frames are transmitted in the middle of a coding session to reset decoder states, then the ability to recover from coding state mismatches is improved, but the risk of synchronization loss increases when RAP frames are lost during transmission
Solution Approach 1:
The patent embeds RAP identifiers in non-RAP frames before transmission, so that when a RAP frame is lost, the decoder can still access the identifier through subsequent non-RAP frames. This preliminary placement of identification information allows the decoder to detect and respond to RAP frame losses without complete synchronization loss, resolving the contradiction between enabling error recovery and avoiding synchronization loss.
Solution Approach 2:
Non-RAP frames serve as intermediaries that carry RAP identifiers. When a RAP frame is lost, these intermediary non-RAP frames transmit the RAP identifier information to the decoder, allowing the decoder to maintain synchronization state knowledge without requiring the direct presence of every RAP frame. This mediator approach enables error recovery while preventing total synchronization loss.
2Reliability
If RAP frames are used to reset coding states, then the ability to clear reference picture caches is improved, but the complexity of tracking coding state increases when RAP frames are lost
Solution Approach 1:
The patent implements a feedback mechanism where the decoder monitors RAP identifiers in received frames and compares them against expected values. When a mismatch is detected indicating a lost RAP frame, the decoder automatically triggers state reset procedures. This feedback loop simplifies state tracking by providing clear, unambiguous signals about coding state conditions, eliminating the need for complex continuous tracking algorithms.
Solution Approach 2:
The patent uses RAP identifiers as distinct markers or signals within the bit stream that clearly indicate coding state boundaries. These identifiers act as visual or signal-based markers that make state transitions explicit and easy to track, transforming the complex continuous state tracking problem into a simpler marker-based detection problem. The RAP identifiers serve as distinctive signals that clearly delimit coding states.
3Adaptability or versatility
If RAP frames are transmitted mid-session, then the versatility of coding protocols is improved, but the loss of information increases when RAP frames are lost
Solution Approach 1:
The patent embeds RAP identifiers in non-RAP frames as a preliminary action, ensuring that even if a RAP frame is lost, the identification information is already prepared and can be transmitted through subsequent non-RAP frames. This preliminary embedding of state information prevents complete information loss while maintaining the versatility of mid-session RAP transmission.
Solution Approach 2:
The patent creates a copy of the RAP identifier information in non-RAP frames. Instead of relying solely on the original RAP frame for state information, the system creates redundant copies of the identification data in subsequent frames. This copying ensures that if the original RAP frame is lost, the state information can still be recovered from the copies, reducing information loss while maintaining protocol versatility.
Data Source
AI summary
Error mitigation techniques are provided for video coding system in which input frames are selected for coding either as a Random Access Pictures (“RAP frames”) or as a non-RAP frame. Coded RAP frames may include RAP identifiers that set an ID context for subsequent frames. Coded non-RAP frames may include RAP identifiers that match the RAP identifiers that were included in the coded RAP frames. Thus, in the absence of transmission errors, a coded non-RAP frame should include a RAP identifier that matches the identifier of the preceding RAP frame. If the identifier of a non-RAP frame does not match the identifier of the RAP frame that immediately preceded it, then it indicates that a RAP frame was lost during transmission. In this case, the decoder may engage error recovery processes.