Video Codec Data Recovery for Lossy Wireless Links
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wireless VR video streaming faces challenges with low latency and quality issues due to lossy links, leading to poor user experience, as traditional methods do not effectively handle packet loss and channel fluctuations.
Innovation Solution
The system splits the video stream into low and high frequency components, using robust modulation coding schemes for transmission, with motion estimation data calculated from the low frequency component and sent at a lower MCS level to ensure reliability, allowing for extrapolation and reconstruction of lost chunks at the receiver.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If video data is transmitted wirelessly without buffering, then low latency is achieved, but video quality deteriorates when link conditions deteriorate
Solution Approach 1:
The video data is divided into frequency components (low frequency and high frequency parts), allowing differential protection strategies. The low frequency component containing essential visual information is protected with robust error correction, while high frequency details receive less protection, enabling quality reconstruction even when some data is lost during transmission.
2Reliability
If robust error correction is applied to all video data, then video quality is maintained, but transmission latency increases
Solution Approach 1:
Different error correction strengths are applied to different parts of the video data. The low frequency component receives strong error correction to ensure essential visual information is preserved, while high frequency components receive weaker correction, optimizing the balance between quality and latency by protecting only what is most important.
3Reliability
If motion estimation data is transmitted with high reliability, then data reception is ensured, but transmission bandwidth is consumed
Solution Approach 1:
The system extracts and transmits only the essential motion estimation data derived from the low frequency component separately with robust protection, while the remaining video data is transmitted normally. This extraction of critical motion information allows for efficient bandwidth usage while ensuring reliable reception of the most important reconstruction data.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems, apparatuses, and methods for implementing data recovery techniques for lossy wireless links are disclosed. A transmitter is configured to encode a video stream and wirelessly transmit the encoded video stream to a receiver, with the video stream representing a virtual reality (VR) rendered environment. The transmitter partitions the video stream into a plurality of substream components based on frequency. Motion vector parameters are calculated for the lowest frequency substream component of the video stream only, and the motion vector parameters are sent to the receiver using a low MCS level. When the receiver receives the motion vector parameters, but the receiver does not receive the lowest frequency component of a given chunk, the receiver uses the motion vector parameters to reconstruct the lowest frequency component of the given chunk by extrapolating from a corresponding chunk of the previous video frame.