Remote Display Quality Measurement via Embedded Watermarks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing solutions for measuring remote display quality in Virtual Desktop Infrastructure (VDI) environments fail to account for changing display outputs caused by applications and do not effectively measure image quality across different regions of the screen, which is necessary due to varying compression techniques.

Innovation Solution

Embedding performance data, such as frame identifiers and reference images, into display frames, allowing for real-time measurement of remote display quality by intercepting API calls and inserting watermarks that are immune to compression errors, enabling accurate quality assessment even as applications change the display output.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If compression techniques are applied to transmit display frames over the network, then network bandwidth efficiency is improved, but image quality and measurement accuracy deteriorate

Engineering Contradiction:
Improvenetwork bandwidth efficiencyVSAvoidimage quality
Core Design Contradiction:
Loss of energyVSManufacturing precision

Solution Approach 1:

The patent introduces an intermediary watermarking mechanism that embeds reference images and frame identifiers into the display output. These watermarks serve as mediators between the compressed transmission channel and the quality assessment system, allowing accurate measurement of image quality despite compression artifacts. The watermarks are designed to be robust against compression while maintaining measurement precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If existing quality measurement methods are used, then implementation simplicity is maintained, but measurement precision deteriorates due to inability to account for changing display outputs

Engineering Contradiction:
Improveimplementation simplicityVSAvoidquality measurement accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by embedding watermarks and reference images into the display frames before transmission. This allows the quality measurement system to have a known reference point against which to compare received frames, enabling precise measurement of quality degradation due to compression and transmission issues, rather than attempting to measure quality of unknown changing content.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent utilizes visual changes in the display output by embedding watermarks that appear as visible or invisible patterns in the display frames. These watermarks leverage changes in pixel values, colors, and patterns to encode measurement information that can be detected and compared at the receiving end, providing precise quality measurement despite application-induced display changes.

Inventive Principle:
Principle #32Color changes

3Measurement precision

If watermarking is applied to all display frames, then measurement accuracy is improved, but computational resources and processing time increase

Engineering Contradiction:
Improvequality measurement accuracyVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by embedding watermarks only in specific regions of the display frames rather than processing every pixel uniformly. The watermarking is concentrated in strategically chosen areas that provide sufficient measurement information while minimizing the computational overhead of processing the entire frame. This selective approach maintains measurement accuracy while reducing resource consumption.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8910228B2Measurement of remote display performance with image-embedded markers
Publication Date: 2014.12.09 OMNISSA LLC
  • US8910228B2 patent drawing
  • US8910228B2 patent drawing
  • US8910228B2 patent drawing

AI summary

Methods, systems, and computer programs are provided for measuring the performance of a remote display. One method includes an operation for embedding in display frames a respective frame identifier and a respective frame picture. The respective frame picture is placed in a respective region that depends of the value of the respective frame identifier. Additionally, the method includes operations for sending the plurality of display frames to a remote client, and for extracting each received frame picture from the respective region of each received display frame at the remote client based on the received frame identifier. The received frame quality is calculated for each received display frame based on the comparison of the extracted received frame picture with the respective frame picture. Further, the method includes an operation for calculating a remote display quality for the remote client based on the calculated received frame quality for the received display frames.