Remote Display Protocol Video Bitstream Error Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote display protocol sessions, video bitstream glitches can persist due to dropped frames, especially in low entropy conditions where I-frames are sent infrequently, causing display glitches that may last for an extended period.
Innovation Solution
A decoder in the remote display protocol client detects errors in the video bitstream and requests an I-frame through the remote display protocol, forcing the encoder to send an I-frame, thereby minimizing glitch duration without modifying the video stream protocol.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If the encoder sends I-frames infrequently in low entropy conditions to save bandwidth, then bandwidth efficiency is improved, but glitch persistence increases
Solution Approach 1:
The system implements feedback by having the decoder detect errors in received frames and send feedback messages back to the encoder requesting an I-frame. This closed-loop feedback mechanism allows the system to maintain bandwidth efficiency during normal operation while quickly recovering from errors when they occur, resolving the contradiction between bandwidth efficiency and glitch persistence.
Solution Approach 2:
The system dynamically adjusts the I-frame sending frequency based on real-time conditions. During low entropy conditions, P-frames are used to save bandwidth, but when errors are detected, the system dynamically switches to sending I-frames. This dynamic adaptation resolves the contradiction by allowing the system to optimize for bandwidth efficiency most of the time while being able to quickly switch to error recovery mode when needed.
2Device complexity
If the decoder requests an I-frame through the remote display protocol instead of modifying the video stream protocol, then system complexity is reduced, but error recovery speed may be affected
Solution Approach 1:
The remote display protocol is designed to be multi-functional, handling both desktop graphics transmission and error recovery requests. By using the existing remote display protocol for both purposes rather than creating a separate video stream protocol modification, the system reduces complexity while maintaining effective error recovery capability.
Solution Approach 2:
The system uses the remote display protocol as an intermediary channel to communicate error recovery requests between the decoder and encoder. This intermediary approach allows error recovery functionality to be added without modifying the core video stream protocol, reducing complexity while maintaining communication efficiency for error recovery.
Data Source
AI summary
Fault recovery of a video bitstream can be performed in a remote session. A decoder of a remote display protocol client can be configured to process a video bitstream that is transferred over a virtual channel of a remote session. As part of processing the video bitstream prior to passing it to a hardware decoder, the decoder can detect the occurrence of an error in the bitstream and then cause the remote display protocol client to employ the remote display protocol which encapsulates the virtual channel to request an I-frame from the remote display protocol service. This will force the encoder to send an I-frame even if the desktop has low entropy thereby minimizing how long a glitch may persist. Because the remote display protocol itself is employed to request the I-frame, there is no requirement to modify the video stream protocol.