Live Share Engagement Monitoring Using Multi-Modal Participant Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing videoconferencing systems lack the capability to monitor participant engagement during a live share session, making it difficult to assess whether participants are attentive, especially when presentations are being made or with multiple participants involved.
Innovation Solution
A communication system and method that analyze live audio-video content against engagement baselines to calculate metrics, including visual, audio, and tactile cues, and provide real-time engagement metrics to participating devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If videoconferencing systems provide live share capability, then users can exchange AV content in real-time, but the systems cannot monitor participant engagement during the session
Solution Approach 1:
The patent introduces an intermediary engagement monitoring system that analyzes participant behavior through camera feeds, audio input, and device interaction data. This intermediary layer processes multiple data streams to infer engagement levels without disrupting the live share functionality, thereby preserving engagement information that would otherwise be lost.
Solution Approach 2:
The patent replaces direct human observation of participant engagement with automated computational analysis. Machine learning models and algorithms process video, audio, and interaction data to objectively measure engagement metrics, substituting manual assessment with automated systems that can continuously monitor multiple participants simultaneously.
2Adaptability or versatility
If multiple participants are involved in a live share session, then collaboration is enhanced, but it becomes difficult to assess individual participant attention
Solution Approach 1:
The patent segments the engagement monitoring process by creating individual engagement profiles for each participant. The system separately analyzes video feeds, audio patterns, and device interactions for each participant, then aggregates these segmented data streams to produce individualized engagement metrics, enabling precise assessment even in multi-participant scenarios.
Solution Approach 2:
The patent implements a universal engagement monitoring framework that functions across multiple participants simultaneously. The same analytical algorithms and measurement protocols are applied universally to each participant's data streams, ensuring consistent and comparable engagement assessment across the entire group while maintaining individual precision.
3Object-affected harmful factors
If cameras or microphones are turned off to improve privacy, then participant comfort increases, but engagement monitoring capability is reduced
Solution Approach 1:
The patent applies local quality by using different data sources and analysis methods depending on available inputs. When cameras are off, the system relies more heavily on audio analysis and device interaction patterns. When microphones are off, it emphasizes visual cues and interaction data. This localized adaptation maintains monitoring reliability by optimizing the mix of available data sources for each specific situation.
Solution Approach 2:
The patent dynamically changes monitoring parameters and weighting factors based on available data streams. The system adjusts the relative importance of different engagement indicators (visual, audio, interaction) according to what data is currently available, maintaining reliable engagement assessment even when some sensors are disabled by adjusting the parameters of analysis rather than requiring all original data sources.
Data Source
AI summary
A communication system and a computer-implemented method for providing a screenshare to one or more computing devices as a live share. In embodiments of the communication solution, a communication system and a computer-implemented method are configured to provide the screenshare to the one or more computing devices in the live share and, contemporaneously, monitor participant engagement at one or more of the computing devices during the live share. The communication system and computer-implemented method can be configured to provide engagement metrics in real-time based on the monitored participant engagement.