Video Encoder Reference Frame Switching for Packet Loss
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Real-time video stream distribution over networks is hindered by frame dropping due to packet loss and delay, leading to degraded image quality and increased memory requirements for retransmission, especially in time-critical applications like chat systems.
Innovation Solution
An encoding processing apparatus that interframe-encodes moving images and includes a request manager to switch the encoding type to a reference frame when frame dropping occurs, allowing for efficient retransmission and minimizing further frame loss by setting subsequent frames as reference frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If retransmission of dropped frames is implemented, then frame loss is recovered, but memory capacity increases and real-timeliness is degraded
Solution Approach 1:
The patent applies preliminary action by proactively inserting reference frames at predetermined intervals before frame dropping occurs. This preventive approach ensures that receivers have valid reference frames ready to decode subsequent frames even when packet loss occurs, eliminating the need for reactive retransmission and maintaining real-timeliness while ensuring frame reception completeness.
Solution Approach 2:
The patent extracts the essential decoding reference information into standalone reference frames that are transmitted independently. By separating the reference frame transmission from the regular interframe-encoded sequence, the system enables receivers to recover from frame dropping using these extracted reference points without requiring retransmission of the entire affected frame sequence, thus preserving real-timeliness while improving reliability.
2Reliability
If retransmission of dropped frames is implemented, then frame loss is recovered, but device complexity increases
Solution Approach 1:
The patent employs disposable reference frames that are inserted at regular intervals and used once for decoding recovery. These reference frames serve as single-use recovery points that receivers can utilize independently without requiring complex coordination or state management between sender and receiver, significantly reducing device complexity compared to traditional retransmission systems while maintaining frame reception completeness.
3Quantity of substance
If interframe-encoding is used, then compression efficiency is improved, but vulnerability to packet loss increases
Solution Approach 1:
The patent applies preliminary action by pre-inserting reference frames at predetermined intervals within the interframe-encoded sequence. These reference frames act as predetermined recovery points that break the dependency chain of interframe encoding, allowing receivers to resume decoding after packet loss without compromising the overall compression efficiency of the interframe-encoded video stream.
Solution Approach 2:
The patent changes the encoding parameter by periodically inserting reference frames with different encoding characteristics (intra-coded vs. inter-coded) into the video stream. This parameter variation creates a hybrid structure where most frames maintain high compression through interframe encoding, while periodic reference frames provide robustness against packet loss, achieving both compression efficiency and reliable decoding.
Data Source
AI summary
A video encoder interframe-encodes a moving image captured by a camera and generates a video code stream. An I frame send request manager receives from a receiver of the video code stream a request signal for requesting to send an I frame that has not been interframe-encoded, when any frame of the moving image is not properly received at the receiver. Then the request manager determines whether or not to accept the received request signal. When the request manager determines to accept the request signal, the request manager supplies an I frame setting signal to the video encoder. Upon receiving the I frame setting signal, the video encoder sets the type of a next frame to be encoded to an I frame and then interframe-encodes the moving image.