Remote Display Quality Measurement via Embedded Frame Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for measuring remote display quality in Virtual Desktop Infrastructure (VDI) environments are inadequate, as they fail to account for changes in display output caused by applications running on computing devices and do not allow for differential compression of desktop screen regions, leading to incomplete quality assessments.

Innovation Solution

The method involves embedding performance data, such as frame identifiers and reference images, into display frames, which are then transmitted to a remote client for quality measurement, allowing for real-time assessment of remote display quality across varying regions of the screen.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If performance data is embedded in all display frames, then measurement accuracy is improved, but network bandwidth consumption increases

Engineering Contradiction:
Improveremote display quality measurement accuracyVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent applies local quality by differentiating between critical and non-critical display regions. Performance measurement data is embedded only in specific regions or frames where quality assessment is most needed, rather than uniformly across all display content. This allows accurate quality measurement in key areas while reducing overall data transmission requirements.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by selectively embedding performance data in only certain display frames or regions rather than all frames. The system determines which frames contain critical information requiring quality measurement, embedding data only in those specific instances to balance measurement accuracy with bandwidth efficiency.

Inventive Principle:
Principle #16Partial or excessive action

2Productivity

If differential compression is applied to different screen regions, then transmission efficiency is improved, but quality assessment complexity increases

Engineering Contradiction:
Improvedisplay transmission efficiencyVSAvoidquality assessment system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the display into different regions with varying quality requirements. Critical regions (e.g., active application windows) are identified and marked for higher quality transmission, while less critical regions (e.g., desktop background) can use lower quality compression. This segmentation enables differential compression strategies tailored to each region's importance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different quality levels to different display regions based on their importance. Performance measurement data is embedded in a manner that accounts for regional differences, allowing the system to assess quality differently across various screen areas and apply appropriate compression levels to each.

Inventive Principle:
Principle #3Local quality

3Reliability

If performance measurement is implemented in real-time, then user experience monitoring is improved, but system resource consumption increases

Engineering Contradiction:
Improveuser experience monitoring accuracyVSAvoidsystem resource consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent implements periodic action by measuring performance quality at specific intervals or triggered events rather than continuously. Performance data is embedded and measured periodically or when significant display changes occur, rather than maintaining constant measurement overhead. This reduces system resource consumption while still providing timely quality monitoring.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent applies self-service by having the performance measurement system utilize existing display rendering infrastructure. The same API calls that generate display content are also used to embed performance data, eliminating the need for separate measurement processes. This allows real-time quality monitoring with minimal additional system resource consumption.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9578373B2Remote display performance measurement triggered by application display upgrade
Publication Date: 2017.02.21 OMNISSA LLC
  • US9578373B2 patent drawing
  • US9578373B2 patent drawing
  • US9578373B2 patent drawing

AI summary

Methods, systems, and computer programs are provided for measuring the performance of display images received on a remote computer display. One method includes an operation for detecting calls from an application to an application programming interface (API), which is provided for rendering images on a display image, each call causing an update of the display image. Further, the method includes an operation for embedding data for measuring performance in display frames of the display image based on the detecting. The embedding results in modified displayed frames with respective data for measuring performance. The modified displayed frames are transmitted to a remote client, which results in received modified display frames having respective received data for measuring the performance. In addition, the method includes an operation for calculating the remote display quality for the given application based on the received modified display frames and the respective received data for measuring performance.