Robust Video Transmission via Auxiliary Correlation Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video transmission methods over lossy channels face challenges such as increased encoder complexity, difficulty in extending motion estimation accuracy, overestimation of correlation noise when applying algorithms in the DCT domain, and the need for packet loss rate estimation, which complicates robust video coding.
Innovation Solution
A method that reduces computational complexity by using a fixed worst-case distortion value for video encoding, transmitting encoded data and auxiliary data over separate channels, with the auxiliary data calculated as a correlation between predictors from preceding frames, allowing for efficient error correction without requiring packet loss rate estimation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the ROPE algorithm is applied in the DCT domain to reduce drift, then video transmission robustness is improved, but encoder complexity increases significantly due to recursive updates of each DCT coefficient
Solution Approach 1:
The patent extracts only the essential correlation information between predictors into auxiliary data, rather than applying complex recursive updates to all DCT coefficients. This selective extraction reduces encoder complexity while maintaining robustness by transmitting only the most critical drift compensation information through the auxiliary channel.
Solution Approach 2:
Instead of fully implementing the computationally intensive ROPE algorithm with recursive updates, the patent applies a simplified version that calculates auxiliary data based on predictor correlation without recursive coefficient updates. This partial action provides sufficient drift mitigation while avoiding the exponential complexity growth of the full ROPE implementation.
2Manufacturing precision
If motion estimation accuracy is increased to improve prediction quality, then video quality is improved, but computational complexity and difficulty of implementation increase
Solution Approach 1:
The auxiliary data mechanism is designed to be universal and compatible with multiple motion estimation accuracies (integer-pixel, half-pixel, quarter-pixel). The same auxiliary data calculation approach works across different precision levels, allowing the system to benefit from higher motion estimation accuracy without requiring separate complex processing paths for each precision level.
3Reliability
If the ROPE algorithm is applied to mitigate drift, then synchronization between encoder and decoder is improved, but packet loss rate estimation is required which complicates the system
Solution Approach 1:
The auxiliary data calculation is self-adaptive and does not require external packet loss rate estimation. The method automatically computes correlation between predictors and generates appropriate auxiliary information based on actual frame conditions, eliminating the need for separate channel characterization and packet loss estimation modules that would otherwise be required.
4Reliability
If auxiliary information is transmitted over a separate channel to correct drift, then video transmission robustness is improved, but transmission bandwidth requirements increase
Solution Approach 1:
The auxiliary data provides localized correction information specifically targeted at drift-prone regions and time periods. Rather than transmitting redundant global correction data, the method sends compact auxiliary information that addresses local synchronization issues, optimizing the trade-off between robustness and bandwidth consumption.
Data Source
Figure 1
Figure 2A~2B
Figure 3
AI summary
A method of transmitting video data related to a sequence of video frames, comprising: encoding the video frames (X) according to a first predictive encoding to generate encoded video data, the encoded video data comprising a prediction error (N) based on the difference between a portion of a current video frame in the sequence and a first predictor (Y) thereof based on a first preceding video frame in the sequence; generating auxiliary video data related to said portion of the current video frame; and transmitting the encoded video data and the auxiliary video data to a receiver, the encoded video data being transmitted over a first channel (125), and the auxiliary video data being transmitted over a second channel (155). The step of generating auxiliary video data includes calculating a correlation between the first predictor and a predetermined second predictor based on a second preceding video frame in the sequence, the second preceding video frame preceding in the sequence the first preceding video frame.