Audience Interestingness Ranking for Video Conference Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video teleconferencing systems struggle to effectively manage large numbers of participants, making it difficult to view and interact with non-speaking participants due to uniform display settings.
Innovation Solution
An audiovisual communication system that utilizes an audiovisual server to analyze sensor input data from client devices, determining an interestingness rating for each participant and selectively transmitting and displaying audiovisual streams based on these ratings, allowing the presenter to focus on more engaging audience members.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If uniform display settings are used for all participants, then the system maintains simplicity in display management, but the presenter cannot effectively gauge audience sentiment or identify engaging participants
Solution Approach 1:
The system changes the display parameter from uniform sizing to variable sizing based on interestingness ratings. Participants are displayed at different scales where the speaker is enlarged and other participants are displayed at reduced sizes, allowing the presenter to gauge audience sentiment while maintaining automated display management
Solution Approach 2:
The system replaces manual display management with an automated interestingness algorithm that automatically determines which participants to highlight and at what size, substituting the mechanical process of manual arrangement with an automated computational system
2Ease of operation
If all participants are displayed uniformly, then the system maintains ease of operation, but the presenter loses the ability to focus on and interact with engaging audience members
Solution Approach 1:
The display system serves itself by automatically analyzing sensor data from client devices, computing interestingness ratings, and configuring the display layout without presenter intervention. The system self-adjusts participant visibility based on engagement metrics while maintaining ease of operation
Solution Approach 2:
The system dynamically changes display parameters including participant size, position, and visibility based on interestingness ratings, enabling the presenter to focus on engaging participants while the system automatically manages the complexity of display configuration
3Productivity
If sensor data analysis and interestingness algorithms are implemented, then the system can identify and highlight engaging participants, but the computational complexity and processing requirements increase
Solution Approach 1:
The system introduces an intermediary interestingness algorithm that processes sensor data from client devices and translates it into display configuration decisions. This intermediary layer enables automated participant highlighting while managing the complexity of coordinating multiple sensors and display parameters
Solution Approach 2:
The system performs preliminary analysis of sensor data to compute interestingness ratings before configuring the display, allowing the presenter to immediately see highlighted participants without real-time processing delays during the presentation
Data Source
AI summary
Technologies for audiovisual communication include an audiovisual server and a number of audiovisual client devices, including a presenter device and a number of audience devices. Each audience device captures an audiovisual stream and transmits the audiovisual stream to the audiovisual server. Each audience device also captures sensor input data such as eye tracking data or facial expression data and transmits abstracted sensor input data to the audiovisual server. The abstracted sensor input data may be based on the captured audiovisual stream. The audiovisual server determines an interestingness rating associated with each audience device based on the sensor input data, and selects one or more audiovisual streams based on the interestingness ratings. The audiovisual server transmits the selected audiovisual streams to the presenter device. The audiovisual server may update the interestingness rating algorithm based on feedback from the presenter device or the audience devices. Other embodiments are described and claimed.