Distributed Video Coding With Receiver-Side Prediction Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern video encoding processes are resource-intensive and require complex processors, fast memory, and significant energy consumption, which is undesirable for devices like XR headsets that need to minimize weight and power consumption while maintaining high-quality, low-latency video transmission.
Innovation Solution
A distributed video coding (DVC) approach where a transmitting device performs a limited encoding process and sends error correction data, allowing a receiving device with more resources to estimate and fully encode pictures using complex coding tools, reducing the need to transmit all encoded data and applying decimation patterns to further reduce data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a transmitting device performs full video encoding with complex coding tools, then video quality is improved, but computational complexity and energy consumption increase
Solution Approach 1:
The encoding process is segmented into two parts: the transmitting device performs limited encoding (intra prediction only) and sends encoded video data plus side information, while the receiving device performs the remaining encoding operations (inter prediction, motion compensation) using received reference pictures. This divides the computational workload between two devices, reducing complexity at the transmitting device while maintaining overall video quality.
Solution Approach 2:
Reference pictures serve as an intermediary mechanism. The transmitting device sends encoded video data and side information that enables the receiving device to reconstruct reference pictures, which then act as intermediaries for the receiving device to perform inter prediction and motion compensation operations without requiring the transmitting device to perform these complex operations.
2Measurement precision
If a transmitting device performs full video encoding with complex coding tools, then video quality is improved, but energy consumption increases
Solution Approach 1:
The encoding process is segmented into two parts: the transmitting device performs limited encoding (intra prediction only) and sends encoded video data plus side information, while the receiving device performs the remaining encoding operations (inter prediction, motion compensation) using received reference pictures. This divides the computational workload between two devices, reducing complexity at the transmitting device while maintaining overall video quality.
Solution Approach 2:
Reference pictures serve as an intermediary mechanism. The transmitting device sends encoded video data and side information that enables the receiving device to reconstruct reference pictures, which then act as intermediaries for the receiving device to perform inter prediction and motion compensation operations without requiring the transmitting device to perform these complex operations.
3Measurement precision
If all encoded video data is transmitted to the receiving device, then reconstruction accuracy is improved, but data transmission volume increases
Solution Approach 1:
The patent extracts only the essential components needed for reconstruction at the receiving device: encoded video data and side information. The side information contains parameters necessary for the receiving device to perform prediction and reconstruction operations locally, eliminating the need to transmit complete reference pictures or all encoded data, thus reducing transmission volume while maintaining reconstruction accuracy.
4Device complexity
If a transmitting device uses limited encoding process, then device complexity is reduced, but reconstruction quality at receiving device deteriorates
Solution Approach 1:
Reference pictures serve as an intermediary mechanism. The transmitting device sends encoded video data and side information that enables the receiving device to reconstruct reference pictures, which then act as intermediaries for the receiving device to perform inter prediction and motion compensation operations without requiring the transmitting device to perform these complex operations.
Solution Approach 2:
The receiving device is empowered to perform encoding operations independently using received side information and its own processing capabilities. The side information enables the receiving device to self-service by performing inter prediction, motion compensation, and reconstruction operations locally, compensating for the limited encoding performed by the transmitting device.
Data Source
AI summary
A device is configured to obtain, from a transmitting device, error correction data that provides error correction information and is generated based on encoded video data of one or more blocks of a picture of the video data; generate prediction data for the picture using one or more coding tools not used for generating the encoded video data, wherein the prediction data for the picture comprises predictions of the blocks based at least in part on previously reconstructed pictures; generate encoded video data based on the prediction data for the second picture; generate error-corrected encoded video data using the error correction data to perform an error correction operation on the encoded video data; and perform a reconstruction operation that reconstructs the blocks of the picture based on the error-corrected encoded video data, wherein the reconstruction operation is controlled by the values of one or more parameters.


