UDP Video Packetization With Unequal Error Protection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video transmission over UDP networks is unreliable due to higher latency and packet loss, which affects the quality of compressed video streams, especially when using advanced compression standards like H.265 or HEVC, as it lacks robust error correction mechanisms compared to TCP.
Innovation Solution
The method involves generating sets of N packets per video frame using UDP over IP, with each packet containing Coarse and Fine video data portions and utilizing Reed-Solomon error correction, applying unequal error protection, and dynamic adjustment of packet sizes to prioritize Coarse video data, ensuring robust transmission even with packet loss.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If video data is transmitted over UDP network, then transmission speed and latency are improved, but reliability and packet loss resistance deteriorate
Solution Approach 1:
The video frame is divided into multiple packets for transmission over UDP. Each packet contains a portion of the video data, allowing selective retransmission or error correction of only the affected packets rather than the entire frame, thus maintaining high transmission speed while improving reliability through granular error handling.
Solution Approach 2:
Forward error correction codes are pre-calculated and embedded into the video data packets before transmission. This preliminary action enables the receiver to reconstruct lost or corrupted packets without requiring retransmission, thereby maintaining both high transmission speed and improved packet loss resistance.
2Productivity
If advanced compression standards like H.265 are used, then compression efficiency is improved, but error correction capability deteriorates
Solution Approach 1:
The patent combines advanced H.265 compression encoding with traditional forward error correction techniques. The error correction codes are integrated into the compressed video bitstream, allowing the system to maintain high compression efficiency while simultaneously providing robust error correction capability that compensates for the reduced error resilience of modern compression standards.
3Loss of time
If packetization is performed for each video frame, then transmission latency is reduced, but complexity of error protection increases
Solution Approach 1:
The patent segments the error protection mechanism to operate independently on each packetized video frame. This allows simple, frame-level forward error correction to be applied without requiring complex cross-frame error analysis, thereby reducing the computational complexity of error protection while maintaining low transmission latency through independent frame processing.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
System, device, and method for transmitting a video via a User Datagram Protocol (UDP) over Internet Protocol (IP) communication link. A method includes: generating by a video encoder a set of N packets of compressed data per each frame of the video, wherein N is a natural number; and upon generation of each set of N packets for a specific frame of that video, immediately performing the transmitting of the set of N packets that corresponds to a single encoded video frame, via that UDP over IP communication link, without waiting for encoding or packetization of any other video frame of that video. Each packet of that video frame includes at least: a Coarse video data packet-portion, and a Fine video data packet-portion, and optionally also a Header packet-portion that includes sub-frames mapping information.