Video Frame Sequence Protection Against Packet Loss
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video stream protection methods, such as lost packet retransmission and forward error correction, are inefficient in handling random and burst packet losses in IP networks, leading to significant video quality degradation and increased algorithmic delay, especially in VVoIP systems.
Innovation Solution
The method involves dividing the video frame sequence into interleaved sub-sequences, encoding them independently, and using special recovery P frames with redundant B frames to restore lost streams, allowing decoder state recovery without waiting for synchronization frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If lost packet retransmission (NACK) is used for packet loss protection, then packet loss can be recovered, but algorithmic delay increases significantly and video quality deteriorates
Solution Approach 1:
The patent applies preliminary action by embedding forward error correction codes and redundancy information during the encoding phase before transmission. This allows the receiver to reconstruct lost packets without waiting for retransmission, thereby reducing algorithmic delay while maintaining packet loss recovery capability
Solution Approach 2:
The patent introduces an intermediary mechanism using redundant B frames and error correction codes that act as mediators between the transmitted video data and the received video stream. These intermediaries enable error recovery without direct retransmission, reducing the delay caused by traditional NACK-based retransmission protocols
2Reliability
If forward error correction is used with several video frames encoded by one code word, then packet loss protection is provided, but algorithmic delay increases
Solution Approach 1:
The patent segments the video stream into multiple independent subsequences with different error protection levels. By dividing the video data into separate streams that can be decoded independently, the system reduces the algorithmic delay associated with processing large blocks of encoded frames while maintaining packet loss protection through distributed redundancy
3Reliability
If interleaved source coding is used to protect video streams, then random and burst packet loss protection is achieved, but decoder state recovery time increases and frame rate decreases
Solution Approach 1:
The patent applies local quality by implementing differential error protection where different subsequences receive different levels of redundancy based on their importance and error susceptibility. Critical subsequences receive stronger protection while less critical ones use lighter redundancy, optimizing the balance between packet loss protection and frame rate maintenance
4Reliability
If periodic INTRA frames are inserted frequently to restore decoder state, then decoding reliability improves, but coding efficiency deteriorates
Solution Approach 1:
The patent enables the decoder to skip waiting for periodic INTRA frames by providing alternative recovery mechanisms through redundant B frames and error correction codes. The decoder can rush through the error recovery process using these pre-encoded redundancy elements, maintaining decoding reliability without the energy cost of frequent INTRA frame insertion
Data Source
AI summary
The invention relates to a method for protecting a video frame sequence against random and/or burst packet losses, the method comprising: partitioning the video frame sequence into a plurality of interleaved video frame subsequences; independently encoding the plurality of interleaved video frame subsequences by a differential video codec; generating for at least one of the plurality of interleaved video frame subsequences at least one B frame predicted from another one of the plurality of interleaved video frame subsequences; and using the at least one B frame as redundant B frame for protecting the video frame sequence.