Remote Graphics Client Multimedia Rendering via Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In desktop virtualization environments, there is a lack of efficient mechanisms to improve network traffic and processing efficiency, leading to increased bandwidth usage and processing loads on clients.

Innovation Solution

The solution involves a method where a virtual machine on a server detects multimedia data objects about to be rendered and transmits them to the client for local execution, rather than rendering them on the server, thereby reducing network traffic by not streaming the display output. This decision is dynamically made based on network conditions and client processing bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multimedia data objects are rendered on the server and display output is streamed to the client, then centralized desktop management is maintained, but network bandwidth usage increases and client processing load increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidnetwork traffic
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent segments the rendering process by identifying multimedia data objects within the display output and separating them for local rendering at the client, while the rest of the desktop environment continues to be rendered and streamed from the server. This segmentation allows selective optimization of network traffic by excluding multimedia objects from the streamed display output.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts multimedia data objects from the display output stream before transmitting it to the client. By taking out these specific objects and handling them locally at the client through injected executable instructions, the system reduces the amount of data that needs to be transmitted over the network while maintaining centralized management of the desktop environment.

Inventive Principle:
Principle #2Taking out (Extraction)

2Quantity of substance

If multimedia data objects are transmitted to the client for local execution, then network traffic is reduced, but client processing bandwidth requirements increase

Engineering Contradiction:
Improvenetwork trafficVSAvoidclient processing bandwidth
Core Design Contradiction:
Quantity of substanceVSPower

Solution Approach 1:

The patent introduces an intermediary component that detects multimedia data objects in the display output and generates executable instructions for local rendering. This intermediary handles the complexity of determining what should be rendered locally versus remotely, allowing the client to efficiently process only the essential executable instructions rather than entire display frames, thus reducing the processing bandwidth requirement.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If all display output is streamed from the server, then centralized management is simplified, but network bandwidth consumption increases

Engineering Contradiction:
Improvecentralized desktop managementVSAvoidbandwidth usage
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The patent implements a dynamic approach where the rendering location of multimedia data objects is determined based on real-time conditions. The system dynamically decides whether to render objects locally at the client or remotely at the server by detecting multimedia data objects in the display output and selectively injecting executable instructions for local rendering, thus adaptively optimizing network bandwidth usage while maintaining centralized management.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9135024B2Playing multimedia content at remote graphics display client
Publication Date: 2015.09.15 RED HAT ISRAEL
  • US9135024B2 patent drawing
  • US9135024B2 patent drawing
  • US9135024B2 patent drawing

AI summary

Method and apparatus for playing multimedia content at a remote graphics display client are described herein. According to one embodiment, a stream of data objects is sequentially transmitted to a client over a network. The stream is generated by a desktop application representing a snapshot of a display output of the desktop application. The data objects are to be rendered at the client for graphics remoting purposes. It is detected that a multimedia object is to be rendered by the desktop application. The multimedia object is caused to be rendered remotely at the client without having to render the multimedia object locally and without having to transmit a display result of the rendering to the client over the network. Other methods and apparatuses are also described.