Offloading RTC Media Encoding to Client Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual desktop environments face challenges in multimedia transmission due to additional network hops and increased CPU load when real-time communication applications operate within them, leading to adverse effects on user experience and hardware utilization.
Innovation Solution
Offloading multimedia encoding and decoding from the virtual desktop to the client device, allowing direct communication between the client device and remote peer without involving the virtual desktop, by intercepting API calls and establishing a secured channel for multimedia content transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If RTC application is executed in web browser of virtual desktop, then user can access RTC application through virtual desktop infrastructure, but additional network hops are introduced causing increased latency
Solution Approach 1:
The patent extracts the multimedia transmission path from the virtual desktop infrastructure by enabling direct peer-to-peer communication between client devices. The RTC application is accessed through the virtual desktop browser interface, but the actual media flow bypasses the virtual desktop server, removing the intermediate network hops that cause latency.
Solution Approach 2:
The virtual desktop browser acts as an intermediary for application launch and control, while a background service on the client device establishes direct peer-to-peer connections. This dual-role approach maintains the virtual desktop's accessibility function while eliminating its role as a media relay, reducing latency.
2Productivity
If multimedia encoding and decoding is performed on virtual desktop, then application can process multimedia content, but CPU load on server increases reducing hardware utilization efficiency
Solution Approach 1:
The patent extracts the computationally intensive encoding and decoding operations from the virtual desktop server and relocates them to the client device. The virtual desktop browser retains control and coordination functions, while the heavy lifting of multimedia processing is performed locally on the user's device, significantly reducing server CPU load.
Solution Approach 2:
The client device is empowered to perform its own multimedia encoding and decoding operations independently, without relying on the virtual desktop server's processing resources. This self-service approach allows the client to handle its own multimedia workloads, freeing up server resources for other users and tasks.
3Loss of time
If direct peer-to-peer communication is established between client devices, then network latency is reduced, but security requirements and implementation complexity increase
Solution Approach 1:
The patent leverages the existing WebRTC framework, which is a universal, standardized protocol already widely supported in modern web browsers. By building upon this established foundation, the solution achieves direct peer-to-peer communication without having to develop custom protocols, thereby reducing implementation complexity while maintaining security through proven, industry-standard mechanisms.
Solution Approach 2:
A background service on the client device acts as an intermediary that manages the complex peer-to-peer connection establishment, negotiation, and maintenance. This service handles the protocol complexity behind the scenes, allowing the virtual desktop browser to maintain a simple interface while the background service manages the sophisticated direct communication requirements.
Data Source
AI summary
Techniques are described for offloading the encoding and decoding of multimedia content transmitted during a real-time communication (RTC) session from the virtual desktop to the client device so that the multimedia content can be communicated directly between the client device and the remote peer device without the involvement of the virtual desktop. The offload eliminates the additional network hop of the multimedia content to the virtual desktop that is present in conventional virtual desktop environments, thereby reducing network latency and improving performance, CPU utilization and network load on the virtual machine hosting the virtual desktop. In order to offload the multimedia encoding/decoding, the techniques described herein intercept a number of Application Programming Interface (API) calls to override the messages used to establish a multimedia communication session between the RTC application and the remote peer device.