Video Decoder Frame Loss Detection via POC Gap Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current H.264 video decoders cannot detect lost non-reference frames, leading to display speed jitter and a compromised viewing experience due to skipped frames, while they can only stop decoding upon detecting lost reference frames.
Innovation Solution
Implementing a method to detect lost non-reference frames using picture order count (POC) gaps and concealing both reference and non-reference frames through a modified 'motion-copy' operation, where missing motion information is predicted from neighboring regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the decoder stops decoding upon detecting lost reference frames, then decoding reliability is improved, but video continuity deteriorates
Solution Approach 1:
The patent applies preliminary action by detecting lost reference frames before they cause decoding failures, using POC gap analysis to identify missing frames in advance. This allows the system to prepare concealment strategies proactively, maintaining video continuity while ensuring decoding reliability by addressing frame losses before they derail the decoding process.
Solution Approach 2:
The patent implements beforehand cushioning by using motion-copy concealment to compensate for lost reference frames before they can cause decoding crashes. The system prepares alternative reference data from previously decoded frames, creating a cushion that protects against the harmful effects of frame loss and maintains continuous video playback.
2Device complexity
If the decoder skips lost non-reference frames, then decoding complexity is reduced, but video quality stability deteriorates
Solution Approach 1:
The patent applies self-service by enabling the decoder to automatically detect and conceal lost non-reference frames using the motion-copy method. The system serves itself by using previously decoded frame data to reconstruct missing frames, maintaining video quality stability without requiring external intervention or significantly increasing decoding complexity.
Solution Approach 2:
The patent implements copying by creating concealed versions of lost non-reference frames through motion-copy concealment. The system copies motion information and macroblock data from previously decoded frames to generate substitute frames, ensuring video quality stability while keeping the decoding process relatively simple through straightforward data replication and interpolation.
3Measurement precision
If the decoder detects lost non-reference frames using POC gaps, then frame loss detection accuracy is improved, but processing complexity increases
Solution Approach 1:
The patent applies mechanics substitution by replacing complex frame-by-frame analysis with a simpler POC gap-based detection mechanism. Instead of performing detailed content comparison between frames to detect losses, the system uses the lightweight POC variable arithmetic to identify missing frames, significantly reducing processing complexity while maintaining high detection accuracy.
Solution Approach 2:
The patent implements parameter changes by utilizing the POC (Picture Order Count) parameter to detect frame losses. By monitoring changes in the POC variable sequence and identifying gaps in expected increments, the system achieves accurate frame loss detection through simple arithmetic operations on this existing parameter, avoiding the need for complex processing while maintaining high precision.
4Duration of action of stationary object
If motion-copy concealment is used for lost frames, then video continuity is improved, but computational load increases
Solution Approach 1:
The patent applies partial or excessive action by selectively applying motion-copy concealment only to lost non-reference frames rather than all frames. The system performs concealment operations partially, targeting only the specific frames that are lost and identified through POC gap analysis, thereby maintaining video continuity while minimizing unnecessary computational load on frames that don't require concealment.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
There are provided method and apparatus for detecting and concealing reference and non-reference video frames. A video decoder includes an entropy decoder (110), an error detector (176), and an error concealer (178). The entropy decoder (110) is for decompressing a video bitstream intended to have a fixed frame rate and parsing the decompressed video bitstream to find picture order counts for frames of the decompressed video bitstream. The error detector (176) is for determining that a particular frame of the decompressed video bitstream is missing based upon the picture order counts. The error concealer (178) is for concealing the particular frame. The method is accomplished by decompressing and parsing the video bitstream to find picture order counts for frames of the decompressed video bitstream and then determining (224, 228) that a particular frame of the decompressed video bitstream is missing based upon comparison of their associated picture order counts, and then concealing (244) that particular frame.