Spotlight Audience Server for Online Meeting Reaction Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
During online meetings, presenters have limited visibility into audience reactions due to the constraints of traditional video-conferencing platforms, making it difficult for them to gauge audience feedback and adjust their presentations accordingly.
Innovation Solution
The system dynamically highlights expressive and active participants by analyzing video frames using convolutional neural networks for facial expressions and Hidden Markov Models for head gestures, generating expressiveness scores, and determining which participants to spotlight for the presenter.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the presenter focuses on presentation materials displayed on the computer screen, then the presentation content can be clearly displayed, but the presenter has limited visibility to see the audience reactions
Solution Approach 1:
The system segments the audience feedback information by analyzing individual video frames to detect facial expressions and head gestures of different audience members separately. This allows the presenter to see specific reactions from specific audience members rather than a blurred group view, resolving the contradiction between screen space and reaction visibility.
Solution Approach 2:
The system adds a new dimension to the presentation display by overlaying detected facial expressions and gestures as visual indicators on top of the existing presentation materials. This multi-layered display approach allows the presenter to perceive audience reactions without sacrificing the visibility of presentation content, effectively resolving the screen space limitation.
2Adaptability or versatility
If traditional video-conferencing platforms are used, then the meeting can be conducted remotely, but the presenter cannot gauge audience feedback effectively
Solution Approach 1:
The system implements a feedback mechanism by continuously monitoring audience video feeds, detecting facial expressions and head gestures, and providing real-time visual indicators to the presenter. This closed-loop feedback system enables the presenter to gauge audience reactions and adjust the presentation accordingly, resolving the information loss inherent in traditional video-conferencing platforms.
Solution Approach 2:
The system replaces the mechanical limitation of direct visual observation with an automated computer vision system using convolutional neural networks and hidden Markov models. This substitution enables the detection and interpretation of subtle audience reactions that would be imperceptible in traditional video-conferencing, restoring the ability to gauge feedback effectively.
3Measurement precision
If the screen display size is limited, then the system remains simple and cost-effective, but the presenter cannot see spontaneous reactions from audience members
Solution Approach 1:
The system employs self-service mechanisms by using automated convolutional neural networks and hidden Markov models to independently analyze audience video frames and detect facial expressions and gestures without requiring manual intervention. This automation enables precise detection of spontaneous reactions while keeping the operational complexity manageable through algorithmic self-processing.
Solution Approach 2:
The system changes the parameter of reaction detection from direct visual observation to automated computational analysis. By transforming the detection mechanism into an algorithmic process that processes video frames and extracts facial expression and gesture parameters, the system achieves high detection precision while maintaining reasonable system complexity through software-based solutions.
Data Source
AI summary
The present disclosure relate to highlighting audience members with reactions to a presenter of an online meeting. Unlike physical, fact-to-face meeting that enables spontaneous interactions among the presenter and the audiences that are collocated with the presenter, presenting materials during an online meeting raises an issue of the present not being able to see real-time reactions or feedback by the audience members. The present disclosure addresses the issue by dynamically determining one or more audience members who indicate reactions during the online meeting or presentation and displaying faces of the one or more audience members under spotlight to the presenter. The presenter sees faces of the audience members with reactions during the online presentation and responds to the audience members and keep the audience engaged. The spotlight audience server analyzes video frames and determines types of reactions of the audience members.