Loss-Tolerant Protocol for Remote Desktop Graphics

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remote desktop protocols like RDP experience high latency over wide area networks due to stream-oriented protocols like TCP, leading to delayed delivery of desktop graphics data, which negatively impacts user experience.

Innovation Solution

Implementing a loss-tolerant graphics exchange protocol using UDP for transmitting desktop graphics data, where each frame is self-contained and can be retransmitted over a separate UDP link, allowing the client to detect lost packets and request refreshes through a lossless TCP channel.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If TCP protocol is used for transmitting desktop graphics data, then data delivery reliability is improved, but transmission latency increases

Engineering Contradiction:
Improvedata delivery reliabilityVSAvoidtransmission latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the data transmission into two independent channels: a reliable TCP channel for control and acknowledgment messages, and an unreliable UDP channel for actual graphics data transmission. This segmentation allows each protocol to be optimized for its specific function, reducing overall latency while maintaining reliability where needed

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism where the client detects lost UDP packets and requests retransmission through the TCP channel. This intermediary approach allows the system to use fast UDP transmission while compensating for packet loss through a controlled retransmission process, rather than relying solely on TCP's built-in retransmission which adds latency

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of time

If UDP protocol is used for transmitting desktop graphics data, then transmission latency is reduced, but packet delivery reliability deteriorates

Engineering Contradiction:
Improvetransmission latencyVSAvoidpacket delivery reliability
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent implements dynamic adaptation by allowing the system to switch between UDP's fast transmission mode and TCP's reliable retransmission mode based on network conditions and packet loss detection. The client dynamically requests retransmissions only when necessary, optimizing the balance between speed and reliability in real-time

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the delivery guarantee parameter from binary (guaranteed or not) to a selective approach where critical control messages use guaranteed delivery via TCP while graphics data uses best-effort delivery via UDP. This parameter change allows the system to optimize for speed where possible while maintaining reliability where necessary

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9225784B2Loss tolerant protocol for remoting desktop graphics
Publication Date: 2015.12.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9225784B2 patent drawing
  • US9225784B2 patent drawing
  • US9225784B2 patent drawing

AI summary

In various embodiments, remote presentation encoding techniques may be modified in such a way that the data can be transmitted over transports without guaranteed packet delivery. In one embodiment, the desktop graphics data may be encoded in individual frames, each frame comprising self-contained graphics elements that fit in a small number of User Datagram Protocol (UDP) protocol data units (PDUs). The PDUs may then be sent to the client on a separate lossy link instead of the lossless link. On the client side, the client may detect which graphic elements within a frame were “lost” as a result of dropped UDP packets and request a refresh from the server through the lossless channel.