Graphics Remoting Using Augmentation Data Hints
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote presentation systems face challenges in efficiently transmitting graphics data, requiring high bandwidth and processing power, especially when handling virtual desktop experiences, as they typically rely on either transmitting primitives or full bitmaps without combining the benefits of both approaches effectively.
Innovation Solution
The method involves transmitting bitmap data while providing metadata hints to assist in rendering, which reduces bandwidth and processing needs by indicating changes, such as moved windows, scrolled areas, and priority regions, allowing for efficient direct access to rendered content and partial data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full bitmaps are transmitted in remote presentation systems, then image quality and completeness are improved, but bandwidth consumption and processing requirements increase
Solution Approach 1:
The patent divides the desktop into multiple tiles or regions, transmitting only the changed portions rather than the entire bitmap. This segmentation allows the system to maintain image quality for updated areas while reducing overall bandwidth consumption by excluding unchanged regions from transmission.
Solution Approach 2:
The patent extracts only the essential changed information from the full bitmap and transmits this extracted data remotely. By taking out only the necessary changes (such as moved windows, scrolled areas, or priority regions) rather than the complete image, the system reduces bandwidth requirements while preserving image quality for the updated portions.
2Loss of energy
If primitives are transmitted instead of full bitmaps, then bandwidth consumption is reduced, but rendering complexity and processing requirements increase
Solution Approach 1:
The patent introduces metadata as an intermediary layer between primitives and full bitmaps. This metadata contains hints and information about the rendered content (such as which areas changed, what types of objects are present, and rendering priorities), allowing the remote system to efficiently process and render only the necessary portions without requiring complete primitive streams, thus reducing rendering complexity.
3Loss of information
If all bitmap data is transmitted, then complete graphics information is provided, but processing time and system resources increase
Solution Approach 1:
The patent performs preliminary identification and classification of changed areas before transmission. By pre-determining which regions have changed and prioritizing them based on importance, the system can transmit only the essential information needed, reducing processing time while maintaining completeness of critical graphics information.
Solution Approach 2:
The patent applies partial action by transmitting only the necessary changed portions rather than all bitmap data. This selective transmission maintains information completeness for updated areas while significantly reducing processing time and system resources by excluding unchanged regions from processing.
Data Source
AI summary
Methods and systems are disclosed in which bitmap data transmission is improved by using some of the advantages of primitive remoting, thus allowing for the reduction of the bandwidth and processing needed to remote a virtual desktop experience. In an embodiment, rendering is performed and bitmaps are remoted, but metadata comprising shortcuts or hints are provided to assist in the rendering of the bitmap data.