WPF Application Remoting via Structural Representation Transfer

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The inefficiency of remoting desktop compositions in computing systems leads to improper utilization of network resources, resulting in slow and inefficient processes, particularly when transferring data for applications like Windows Presentation Foundation (WPF) applications.

Innovation Solution

A method and system that remotes structural representations of visual content, such as visual trees, from a server to a client device without rendering, allowing for the recreation and rendering of visual content on the client end based on structural information, including attributes like location and relationships between visual elements, enabling efficient display without composing the desktop at the remote end.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the desktop is fully composed and then remoted to a client, then the visual representation is complete and accurate, but network resources are improperly utilized making the remoting process inefficient and slow

Engineering Contradiction:
Improvevisual representation accuracyVSAvoidremoting efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the desktop remoting process into two distinct phases: composition phase (where visual components are structured and attributes are assigned) and remoting phase (where only the structural representation is transferred to the client). This segmentation allows the heavy composition work to be done once on the server, while the client receives only lightweight structural data for rendering, thereby improving remoting efficiency without compromising visual accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs the composition process as a preliminary action before remoting. The server completes the entire desktop composition, creating a structural representation of all visual components and their attributes in advance. This preliminary composition allows subsequent remoting operations to simply transfer the already-processed structural data, eliminating the need for repeated composition cycles and significantly improving remoting speed.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If structural representations are transferred instead of rendered content, then network resource utilization improves, but the client must perform additional processing to recreate visual content

Engineering Contradiction:
Improvenetwork resource utilizationVSAvoidclient processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent uses copying by transferring a structural representation (a lightweight data model) of the desktop instead of copying the actual rendered pixel data. This structural copy contains all necessary information about visual components, their attributes, and relationships, enabling the client to reconstruct the visual content efficiently. This approach dramatically reduces network bandwidth requirements while the client's rendering engine handles the reconstruction using its own processing capabilities.

Inventive Principle:
Principle #26Copying

Data Source

PatentEP3525093B1Remoting of windows presentation framework based applications in a non-composed desktop
Publication Date: 2022.06.15 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3525093B1 patent drawingFigure 1
  • EP3525093B1 patent drawingFigure 2
  • EP3525093B1 patent drawingFigure 3

AI summary

Described are systems and methods for remoting applications, such as those based on Windows® Presentation Foundation (WPF). The systems and methods are based on remoting information associated with a structural representation. The structural representation corresponds to visual contents or elements of a desktop to be displayed at a remote end or client end, without rendering the contents at a client or remoted end. The information associated with the structural representation or structural information includes data that specifies the placement of the visual contents on the desktop when displayed. The information is used for recreating the structural representation at the client end and displaying the visual contents in conformance with the structural representation.