Region-Based Remote Display Transfer for Low-Latency Graphics
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Virtual Desktop Infrastructure (VDI) solutions face challenges with high latency and poor performance in delivering low-latency, high-quality remote computing experiences, especially for graphics-intensive applications and full-motion video, due to limitations in handling unreliable networks and synchronizing audio and video streams.
Innovation Solution
A low-latency transfer protocol system that captures and encodes computer-generated output from a server, utilizing a hybrid network stack and multicasting to transmit data to multiple clients with varying bandwidth, and includes a region detector to optimize encoding schemes for different regions of the output, ensuring efficient transmission and synchronization across unreliable networks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional VDI protocols (RDP, ICA) are used to transmit screen updates, then compatibility with existing systems is maintained, but latency increases to roughly 100 milliseconds which is unsuitable for modern graphics-intensive applications
Solution Approach 1:
The patent changes the fundamental parameter of transmission frequency from traditional 100ms intervals to continuous or near-continuous transmission at higher frame rates (e.g., 60Hz or higher). This parameter change enables the system to achieve low latency suitable for graphics-intensive applications while maintaining compatibility through protocol design that can adapt to different transmission rates.
Solution Approach 2:
The protocol implements dynamic adaptation by adjusting transmission characteristics based on content type and network conditions. Different encoding schemes are applied dynamically - video compression for dynamic content, lossless compression for static content - allowing the system to optimize between latency and bandwidth usage while maintaining compatibility with various client devices.
2Loss of time
If screen updates are transmitted at high frequency to reduce latency, then responsiveness improves for graphics-intensive applications, but network bandwidth consumption increases
Solution Approach 1:
The patent applies different quality levels and encoding schemes to different regions or types of screen content. Video compression is used for dynamic video regions, while lossless or differential compression is used for static or slowly changing areas. This local differentiation allows high-frequency transmission for latency-critical content while conserving bandwidth for less dynamic content.
Solution Approach 2:
The protocol transmits only the necessary portions of screen updates rather than complete frames every time. By using differential encoding and region-based transmission, it sends partial updates containing only changed areas, reducing overall bandwidth consumption while maintaining the appearance of high-frequency full-screen updates.
3Loss of energy
If video compression is used to reduce bandwidth consumption, then network efficiency improves, but synchronization between audio and video streams becomes difficult to maintain
Solution Approach 1:
The patent implements feedback mechanisms where the server receives timing and synchronization information from clients and adjusts its encoding and transmission timing accordingly. This closed-loop approach allows the system to maintain audio-video synchronization even when using aggressive compression, as the server can adapt its encoding rate and timing based on actual network conditions and client playback status.
Solution Approach 2:
The system performs preliminary synchronization by pre-buffering and timing-stamping video and audio data before transmission. By establishing synchronization markers and timing references in advance, the system can compensate for variable compression ratios and network jitter, ensuring that audio and video remain synchronized at the client side even when bandwidth optimization is applied.
4Manufacturing precision
If the protocol transmits complete screen updates frequently, then image quality is maintained, but latency and bandwidth usage increase making it unsuitable for unreliable networks
Solution Approach 1:
The patent dynamically changes transmission parameters including compression ratio, frame rate, and resolution based on network conditions and content type. For unreliable networks, it adjusts parameters to prioritize latency reduction over maximum image quality, using smarter differential encoding that maintains perceptual quality while transmitting less data more frequently.
Solution Approach 2:
The protocol implements dynamic adaptation by adjusting transmission characteristics based on content type and network conditions. Different encoding schemes are applied dynamically - video compression for dynamic content, lossless compression for static content - allowing the system to optimize between latency and bandwidth usage while maintaining compatibility with various client devices.
Data Source
AI summary
A method and system for providing computer-generated output and in particular graphical output. An output capturing and encoding engine is configured to intercept graphical output from an application on a server, organize the output into regions having similar motion and/or graphical characteristics, and convert the data from each region into a format suitable to balance transmission efficiencies versus display quality or capability at the receiving end.