Local Virtual UI Overlay for Scrollable Content Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In desktop virtualization systems, high latency and packet loss between client computing devices and remote servers lead to a poor user experience, particularly when navigating user interface elements due to increased time lag during actions like scrolling and tabbing.
Innovation Solution
A computing system that includes a virtualization server configured to run virtual machine sessions and provide hosted applications with scrollable content, where client devices display local virtual UI elements, cache adjacent content, generate graphics overlays for predicted responses, and send user input to the server, which updates and sends back actual graphics, replacing local overlays based on estimated latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If desktop virtualization is implemented with remote server hosting, then flexibility and centralized management are improved, but network latency and packet loss increase causing poor user experience
Solution Approach 1:
The system pre-loads and caches scrollable content adjacent to the currently visible portion on the client device before it is actually needed. This preliminary action stores content in local memory, so when scrolling occurs, the cached content is immediately displayed without waiting for network round-trip to the remote server, thus reducing perceived latency while maintaining centralized hosting benefits
2Measurement precision
If all scrollable content is transmitted from remote server, then data accuracy is improved, but network bandwidth consumption and latency increase
Solution Approach 1:
The system differentiates between content that requires high fidelity (currently visible and actively scrolled content) and content that can be approximated (adjacent scrollable content). Cached adjacent content is stored locally with sufficient quality for immediate display, while maintaining the option to refresh from server when needed. This local quality approach reduces network bandwidth consumption while preserving data accuracy where it matters most
3Stability of the object's composition
If real-time content synchronization is implemented, then data consistency is improved, but user experience during scrolling deteriorates due to latency
Solution Approach 1:
Adjacent scrollable content is cached in advance on the client device, creating a local buffer that enables immediate scrolling without real-time server communication. This preliminary caching action decouples the scrolling operation from network dependency, improving responsiveness while maintaining data consistency through periodic synchronization with the remote server
4Speed
If cached adjacent content is displayed locally, then scrolling responsiveness is improved, but potential data inconsistency with remote server increases
Solution Approach 1:
The system implements a feedback mechanism where the client device monitors scrolling behavior and determines when to synchronize cached content with the remote server. After caching adjacent content locally for responsive scrolling, the system periodically or event-drivenly checks for updates from the server and refreshes the cache when changes are detected, thus maintaining data consistency while preserving scrolling performance
Data Source
AI summary
A computing system includes a virtualization server that runs virtual machine sessions and provides a hosted application with user interface (UI) elements having scrollable content. A client computing device accesses the hosted application during one of the virtual machine sessions and receives the scrollable content. The client computing device displays at least a portion of the scrollable content as local virtual UI elements, applies user input to scroll the portion of the scrollable content in focus, caches scrollable content that is positioned adjacent the portion of the scrollable content being scrolled that is not in focus, and generates a local virtual UI element graphics overlay that includes at least a portion of the cached scrollable content for display corresponding to a predicted response to the user input.