Remote Display Generator Bandwidth Fidelity Tradeoff
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote computing platforms face challenges in providing high-fidelity displays and responsive interactive experiences across a wide range of network bandwidths, especially with display-intensive multimedia applications, due to performance degradation and inefficient compression mechanisms.
Innovation Solution
The Remote Display Generator employs a compression-friendly architecture that reads screen data frame by frame, uses unified screen codecs, and integrates timer-driven screen update models and adaptive transmission mechanisms to improve display quality and responsiveness by compressing non-overlapping pixel blocks and marking unchanged blocks to reduce bandwidth and computational overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If low-level pixel compression methods (VNC, THINC) are used to reduce bandwidth consumption, then bandwidth efficiency improves, but display fidelity deteriorates for high spectral content screens
Solution Approach 1:
The patent segments the screen into multiple non-overlapping pixel blocks and processes each block independently through classification and type-specific compression. This segmentation allows different compression strategies to be applied to different regions, achieving both bandwidth efficiency and display fidelity by matching compression methods to content characteristics.
Solution Approach 2:
The patent applies different compression techniques to different pixel blocks based on their content type (text, image, video, mixed). Text blocks use one compression method, image blocks use another, and video blocks use yet another, ensuring that each region is compressed with the most appropriate technique for its specific content, thereby maintaining local quality while optimizing overall bandwidth usage.
2Manufacturing precision
If high-fidelity screen transmission is provided to maintain display quality, then display fidelity improves, but bandwidth consumption increases
Solution Approach 1:
The patent changes compression parameters dynamically based on pixel block classification. Different compression algorithms and parameter settings are applied to text, image, video, and mixed content blocks, optimizing the balance between display fidelity and bandwidth consumption for each content type rather than using a single fixed compression approach.
Solution Approach 2:
The patent introduces dynamic adaptation by classifying pixel blocks in real-time and selecting compression strategies based on current content characteristics. The system dynamically adjusts compression intensity and method according to the spectral content and type of each block, achieving optimal fidelity-bandwidth tradeoff that adapts to varying display content.
3Loss of energy
If compression is applied to reduce bandwidth requirements, then bandwidth efficiency improves, but computational overhead increases
Solution Approach 1:
The patent segments the screen into pixel blocks that can be independently classified and compressed. This segmentation enables parallel processing of different blocks, distributing computational overhead across multiple independent operations rather than requiring a single complex compression pass over the entire screen, thereby managing computational complexity more effectively.
4Ease of operation
If responsive interactive experience is provided to match local application performance, then user experience improves, but system complexity increases
Solution Approach 1:
The patent performs preliminary classification of pixel blocks into content types (text, image, video, mixed) before compression. This preliminary action enables the system to select the most appropriate compression strategy in advance, reducing latency and improving interactive responsiveness by avoiding complex decision-making during the compression phase itself.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A "Remote Display Generator," as described herein, provides various techniques for providing high-fidelity displays with highly responsive interactive application experiences to clients across a wide range of network bandwidths for remotely hosted applications. In general, the Remote Display Generator uses a compression-friendly remote display architecture as a core. With this compression architecture, actual screen data from a remote server is read out from the display buffer frame by frame, and then compressed with a unified screen codec. Other technologies, including timer-driven screen update models and adaptive transmission mechanisms, are then integrated with various embodiments of the Remote Display Generator to improve overall user experience by improving display quality and responsiveness to user interaction with remotely hosted applications