Multichannel Video Slice Transmission for VR Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote virtual reality (VR) and augmented reality (AR) systems experience data packet losses and timeouts during transmission, leading to latency issues and incomplete frame rendering due to the need for in-order delivery of packets, which can result in higher latency and dropped slices if any packet is lost.
Innovation Solution
Implementing multichannel reliable transmission protocols with latency-constrained retransmissions, where data packets are mapped to separate communication channels and retransmitted within a calculated timeout period, allowing for independent transmission and decoding of slices, reducing latency and ensuring complete frame rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If in-order delivery of packets is implemented, then reliability of frame rendering is improved, but latency increases due to waiting for lost packets
Solution Approach 1:
The video frame is divided into multiple slices that can be independently decoded. Each slice contains a portion of the frame data and can be processed separately, allowing the decoder to render visible portions of the frame even when some packets are lost or delayed.
Solution Approach 2:
The system calculates a timeout period in advance for each packet and prepares to handle packet loss scenarios before they occur. By pre-segmenting frames into slices and establishing timeout mechanisms, the system can immediately switch to alternative rendering paths when packets are lost, rather than waiting indefinitely.
2Reliability
If retransmission of lost packets is implemented, then data completeness is improved, but latency increases due to retransmission delays
Solution Approach 1:
The system implements selective retransmission based on timeout detection rather than retransmitting all packets. When a packet exceeds its calculated timeout period, only that specific packet is retransmitted, allowing the system to achieve sufficient data completeness without the excessive delay of comprehensive retransmission protocols.
Solution Approach 2:
The timeout period for each packet is dynamically calculated and adjusted. The system adapts the waiting time for each packet based on its specific characteristics and transmission conditions, allowing flexible handling of retransmissions that balances data completeness with latency constraints.
3Reliability
If multiple communication channels are used for slice transmission, then transmission reliability is improved, but system complexity increases
Solution Approach 1:
The communication system divides the transmission task into multiple independent channels, with each channel handling specific slices of the video frame. This segmentation allows parallel transmission and improves reliability through diversity, while keeping each individual channel relatively simple.
Solution Approach 2:
The multichannel transmission system uses a unified protocol and processing framework that handles multiple channels in a standardized manner. The same encoding, transmission, and decoding logic is applied across all channels, reducing overall system complexity despite the increased number of communication paths.
Data Source
AI summary
The present disclosure relates to methods and apparatus for video processing. In one aspect, the apparatus may configure at least one frame of plurality of frames in a video stream. The apparatus may also divide the at least one frame into one or more slices, each of the one or more slices including one or more data packets. The apparatus may also map each of the one or more slices to one of one or more communication channels. The apparatus may also transmit each of the one or more slices including the one or more data packets via the one of the one or more communication channels. In another aspect, the apparatus may receive each of one or more slices via one of one or more communication channels. The apparatus may also decode each of the one or more slices including one or more data packets.