Client Device Audio Video Stream Arbitration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In Unified Communications (UC) environments, audio and video devices at client endpoint devices are often locked for use by hosted virtual desktop (HVD) applications, preventing their use for local applications, and there is a lack of mechanisms to detect and arbitrate between HVD and local UC stacks, especially when devices are already locked even if not actively used.
Innovation Solution
A client device with a local UC protocol stack controls audio and video devices to selectively suspend or share media data streams with both HVD server applications and remote party devices, allowing simultaneous use without altering the HVD applications, enabling the client device to manage device access and prioritize media streams based on current requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If audio and video devices are permanently redirected to HVD applications, then HVD applications can reliably access these devices, but the devices become unavailable for local applications
Solution Approach 1:
The patent implements dynamic device redirection where audio and video devices are not permanently locked to HVD applications but can be flexibly redirected based on current usage context. The system monitors device usage state and allows temporary redirection to local applications when HVD applications are not actively using the devices, enabling both reliable HVD access and local application availability.
Solution Approach 2:
The system periodically checks the usage state of audio and video devices between HVD application sessions. When devices are determined to be idle or not actively used by HVD applications, the system periodically offers or automatically redirects device access to local applications, creating a rhythm of shared access that satisfies both HVD reliability requirements and local application availability needs.
2Ease of operation
If audio and video devices are locked for local UC applications, then local applications can use these devices, but HVD applications cannot access them
Solution Approach 1:
The patent introduces an intermediary layer (the system or mediator component) that sits between local applications and audio/video devices. This intermediary monitors HVD application needs and manages device redirection requests from local applications, ensuring that HVD applications maintain reliable access while allowing local applications to use devices during periods of HVD non-usage through coordinated arbitration.
Solution Approach 2:
The system changes the operational parameters of audio and video device access by transitioning between different access modes (HVD-locked, local-access, idle states) based on usage conditions. This parameter-based control allows the same physical devices to serve different purposes at different times, enabling local application ease of operation without permanently compromising HVD application reliability.
3Device complexity
If there is no arbitration mechanism between HVD and local UC stacks, then system complexity is reduced, but device access conflicts cannot be resolved
Solution Approach 1:
The patent implements a self-service arbitration mechanism where the system automatically monitors device usage states and performs redirection without requiring complex external arbitration protocols. The local UC stack and HVD application environment self-manage device access through built-in state detection and automatic redirection logic, providing adaptability while keeping the arbitration mechanism relatively simple and integrated into the existing architecture.
Data Source
AI summary
A communication is established between a client device and a server device, where the server device executes one or more hosted virtual desktop (HVD) applications for the client device. A media data stream including at least one of audio content and video content is transmitted from the client device to the server device, where audio and video content of the media data stream is captured by one or more input devices at the client device and is utilized by an HVD application at the server device. In response to a request for the media data stream by a second application that is local to the client device or is operating at a remote device, transmission of the media data stream to the server device is selectively suspended or shared with the second application.