Active Region Detection in Collaborative Sessions via Audio Correlation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional collaborative computing session technologies struggle to efficiently focus on active content during shared presentations, especially when participants use devices with limited display capabilities, leading to cluttered and difficult-to-view shared content.
Innovation Solution
The method involves determining active regions within shared data by correlating audio streams with visual content, using speech-to-text and graphic/video-to-text conversion to prioritize relevant content, and rendering it prominently on viewer devices, adapting to their display capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the presenter's computer captures and transmits the entire screen or a predefined portion of the screen to attendees, then the shared content is complete and comprehensive, but the display becomes cluttered and difficult to view on devices with limited screen real estate
Solution Approach 1:
The system segments the shared screen content into multiple regions of interest based on audio activity. Instead of transmitting the entire screen uniformly, it divides the display into active regions (where speakers are located) and inactive regions, selectively emphasizing and transmitting only the relevant segments to attendees' devices.
Solution Approach 2:
The system applies different quality levels and transmission priorities to different regions of the shared content. Active regions corresponding to speaker locations receive enhanced transmission quality and prominence, while inactive regions are reduced or omitted, optimizing the use of limited display real estate while maintaining completeness of information.
2Loss of information
If the system shares all application content and screen areas with attendees, then no information is lost, but the attendee's limited display becomes overwhelmed and unusable
Solution Approach 1:
The system extracts and prioritizes only the relevant portions of shared content based on audio correlation. By identifying active regions where speakers are present and extracting only those portions for prominent display, it prevents information loss in critical areas while eliminating unnecessary content that would consume limited display space.
Solution Approach 2:
The system adds an audio dimension to the visual content sharing process. By correlating audio streams with screen regions, it creates a multi-dimensional approach where content priority is determined not just by spatial position but by audio activity, enabling intelligent prioritization that preserves essential information while managing display constraints.
3Reliability
If the system transmits high-resolution and complete shared content to all attendees, then the quality of shared information is maintained, but the network bandwidth and processing requirements increase significantly
Solution Approach 1:
The system transmits only the necessary portion of shared content at high quality rather than the entire screen. By focusing transmission resources on active regions identified through audio correlation, it maintains high reliability and quality for relevant content while reducing overall network bandwidth and processing requirements through selective transmission.
Data Source
AI summary
In an example embodiment disclosed herein, there is described methods and a system for sharing of content in collaborative computing sessions. The methods and the system are operable to maintain a collaborative computing session between a plurality of participant devices, wherein at least one participant device operates as a presenter device to share data with at least one other participant viewer device. The methods and system are further operable to designate data to be shared with at least one viewer device and to identify at least one active region contained within the shared data. The methods and system are also operable to transmit the designated shared data to the at least one viewer device, render the shared data for display on at least one viewer device to maximize the display of the at least one active region, and display the rendered shared data on the at least one viewer device.