Multi-View Video Coding With Receiver-Offloaded Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern video encoding processes are resource-intensive and require complex processors, fast memory, and significant energy consumption, which is not suitable for devices with limited resources, especially in wireless communication systems like 5G and 6G, particularly when transmitting high-quality video data over short distances.
Innovation Solution
A transmitting device performs a limited video encoding process and transmits error correction data, allowing a receiving device to estimate and fully encode pictures using more complex coding tools, reducing the need to transmit all encoded video data, and applying decimation patterns to further reduce data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a full video encoding process is performed at the transmitting device, then video quality is improved, but computational complexity and energy consumption increase significantly
Solution Approach 1:
The encoding process is segmented into two parts: the transmitting device performs a limited encoding process (first video encoding process) and sends only error correction data, while the receiving device performs the remaining encoding operations (second video encoding process) using received coding tools. This segmentation reduces computational complexity at the transmitting device while maintaining video quality through collaborative encoding.
Solution Approach 2:
The receiving device is empowered to perform encoding operations autonomously by receiving coding tools and parameters from the transmitting device. The receiving device uses these tools to complete the encoding process locally, reducing the burden on the transmitting device while ensuring high-quality output through the receiving device's own processing capabilities.
2Manufacturing precision
If all encoded video data is transmitted, then reconstruction accuracy is improved, but data transmission volume increases
Solution Approach 1:
The transmitting device extracts and transmits only the essential error correction data needed for accurate reconstruction, rather than transmitting all encoded video data. The receiving device then uses received coding tools to generate the remaining encoded data locally, significantly reducing transmission volume while maintaining reconstruction accuracy through the combination of transmitted error correction data and locally generated encoding data.
3Productivity
If complex coding tools are used at the transmitting device, then video compression efficiency is improved, but processing time and energy consumption increase
Solution Approach 1:
The system dynamically distributes encoding tasks between the transmitting and receiving devices based on their respective capabilities. The transmitting device sends coding tools and parameters that enable the receiving device to perform complex encoding operations, allowing the system to adapt to different device configurations and optimize energy consumption by performing computationally intensive operations at the receiving end rather than the transmitting end.
Data Source
AI summary
A device is configured obtain a first set of multiview pictures, wherein the first set of multiview pictures includes first pictures and second pictures, the first pictures being from a first viewpoint and the second pictures being from a second viewpoint; transmit first encoded video data to a receiving device, wherein the first encoded video data is based on the first set of multiview pictures; receive multiview encoding cues from the receiving device; obtain a second set of multiview pictures of the video data, wherein the second set of multiview pictures includes third pictures and fourth pictures, the third pictures being from the first viewpoint and the fourth pictures being from the second viewpoint; perform, based on the multiview encoding cues, a multiview encoding process on the second set of multiview pictures to generate second encoded video data; and transmit the second encoded video data to the receiving device.