Predictive UI Overlay for Virtual Machine Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Desktop virtualization systems experience high latency and packet loss due to increased network conditions between workloads and client computing devices, leading to a poor user experience, especially when navigating user interface elements in cloud-based environments.

Innovation Solution

A computing system that includes a virtualization server configured to run virtual machine sessions and provide hosted applications with user interface elements, where client computing devices display local virtual UI elements, generate predicted responses, and replace them with actual responses from the server, optimizing latency by estimating and managing network latency between the server and client.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If desktop virtualization is implemented with remote server hosting, then flexibility and resource consolidation are improved, but network latency and packet loss increase

Engineering Contradiction:
ImproveflexibilityVSAvoidnetwork latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by predicting UI element responses before actual server processing completes. The client device generates predicted response graphics locally based on user input, displaying them immediately to eliminate perceived latency, then replaces them with actual server responses when they arrive.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary mechanism - the predicted response graphics - that mediates between user input and actual server processing. This intermediary provides immediate visual feedback while the real data travels through the slow network channel, decoupling user perception from actual network latency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If cloud-based virtualization is used, then resource consolidation is improved, but user experience deteriorates due to latency

Engineering Contradiction:
Improveresource consolidationVSAvoiduser experience
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system creates local copies of UI element responses at the client device. These copied graphics are generated locally as predictions and displayed immediately, providing a seamless user experience while the actual data is being retrieved from the remote server through the network.

Inventive Principle:
Principle #26Copying

3Loss of time

If local virtual UI elements are displayed with predicted responses, then perceived latency is reduced, but network bandwidth usage increases

Engineering Contradiction:
Improveperceived latencyVSAvoidnetwork bandwidth
Core Design Contradiction:
Loss of timeVSLoss of energy

Solution Approach 1:

The system performs partial action by sending only user input data to the server while generating the response graphics locally. This reduces network traffic to essential data only, while the bandwidth-intensive response rendering is performed locally through prediction algorithms.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11693672B2Providing user interface (UI) elements in virtual machine sessions at reduced latency
Publication Date: 2023.07.04 CITRIX SYSTEMS INC
  • US11693672B2 patent drawing
  • US11693672B2 patent drawing
  • US11693672B2 patent drawing

AI summary

A computing system includes a virtualization server that runs virtual machine sessions and provides a hosted application having user interface (UI) elements. A client computing device receives the UI elements and displays the UI elements as local virtual UI elements, applies user input to one of the local virtual UI elements in focus, generates a local virtual UI element graphics overlay corresponding to a predicted response to the user input and sends the user input to the virtualization server, which generates an updated UI element graphics corresponding to an actual response to the user input. The client computing device replaces at least a portion of the local virtual UI element graphics overlay corresponding to the predicted response with the received updated UI element graphics.