Video Conferencing System Event Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video conferencing systems fail to incorporate non-verbal cues and video events into the display, resulting in a lack of a 'full duplex' communication experience, which is more engaging in face-to-face meetings.
Innovation Solution
A video conferencing system that monitors multiple video streams for designated video events, such as hand raising or head shaking, and independently switches or supplements the video stream transmission to focus on these events, allowing for enriched communication experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the system focuses on the speaker by analyzing audio signals, then the audio communication quality is improved, but the video event information (non-verbal cues) is lost
Solution Approach 1:
The system segments the video conferencing functionality into independent audio processing and video event detection modules. The audio module continues to identify speakers while the video module independently detects non-verbal cues like hand raising and head shaking. This segmentation allows both audio quality and video event information to be preserved and integrated in the final display composition.
Solution Approach 2:
The system merges audio-based speaker identification with video-based event detection to create a unified person-of-interest determination mechanism. By combining these independent detection streams, the system can simultaneously maintain audio communication quality while capturing video event information, resolving the contradiction between these two requirements.
2Loss of energy
If the system transmits only the speaker's video stream, then the bandwidth usage is reduced, but the non-verbal interactions are lost
Solution Approach 1:
The system dynamically adjusts video stream transmission based on detected events. During normal speech, only the speaker's video stream is transmitted to conserve bandwidth. When video events such as hand raising or head shaking are detected, the system dynamically switches to transmit the relevant participant's video stream, ensuring non-verbal interactions are captured while maintaining bandwidth efficiency during regular communication.
Solution Approach 2:
The system implements periodic monitoring of video streams for events and periodically switches transmission based on detected conditions. This periodic event detection and conditional transmission approach ensures that bandwidth is used efficiently during normal operation while still capturing important non-verbal interactions when they occur.
3Measurement precision
If the system monitors all video streams for events, then the video event detection accuracy is improved, but the system complexity increases
Solution Approach 1:
The system extracts and monitors only specific pre-defined video events (such as hand raising, head shaking, nodding) rather than analyzing all possible video content. By focusing on a limited set of meaningful events with specific detection algorithms, the system achieves high detection accuracy while avoiding the excessive complexity that would result from comprehensive video analysis.
4Ease of operation
If the system switches video stream based on video events, then the communication experience is improved, but the switching complexity increases
Solution Approach 1:
The system uses feedback from video event detection to automatically control video stream switching. When events such as hand raising or head shaking are detected, the feedback mechanism triggers automatic switching to display the relevant participant's video, improving communication experience without requiring complex manual control logic. The switching rules are pre-defined based on event types, simplifying the overall system architecture.
Data Source
AI summary
After a video conference is established, a video conferencing system receives a video stream from the participants of the video conference. One of the received video streams is transmitted to the conference participants (e.g. the video stream of the person currently speaking). The video conferencing system monitors a second one (or typically all) of the received video streams to determine if a designated video event (e.g. someone raising his hand) has occurred. If the designated video event has occurred, the video conferencing system switches or supplements the currently transmitted video stream to or with the second one of the received video streams that contains the designated video event. The second video stream is then transmitted to participants in the video conference. The switching of the video stream and the switching of the audio stream may be independent.