Video-Based Voice Transmission Failure Detection in Calls
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Participants in communication sessions often remain unaware that they are not being heard by others due to issues like mute settings, microphone problems, or connection issues, leading to fruitless speaking and difficulty in identifying the cause.
Innovation Solution
An audio issue detection system that analyzes video of participants to determine if their audio corresponds to their speech, notifying them of any discrepancies, such as no audio, out-of-sync audio, or low quality, and optionally switching to secondary microphones.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If participants rely on others to inform them about audio issues, then social interaction is maintained, but communication efficiency deteriorates due to delayed detection and fruitless speaking
Solution Approach 1:
The system enables self-service by having the endpoint automatically detect audio issues through video analysis without requiring other participants to notify the speaker. The endpoint independently monitors its own audio status by comparing video speech detection with actual audio transmission, allowing immediate self-correction and eliminating wasted speaking time.
Solution Approach 2:
The system implements feedback by continuously monitoring audio-video correspondence and providing real-time notifications to the participant when audio issues are detected. This closed-loop feedback mechanism allows participants to immediately adjust their audio settings or switch microphones based on system feedback, significantly improving communication efficiency.
2Measurement precision
If the system analyzes video to detect audio issues in real-time, then audio issue detection accuracy is improved, but processing complexity increases
Solution Approach 1:
The system achieves multi-functionality by using the existing video stream for dual purposes: primary video communication and secondary audio issue detection. The video analysis framework serves both display functions and diagnostic functions, eliminating the need for separate detection hardware and reducing overall system complexity while maintaining high detection accuracy.
3Loss of information
If the system provides detailed audio issue notifications, then participant awareness is improved, but information processing load increases
Solution Approach 1:
The notification system segments audio issue detection into distinct categories (no audio, out-of-sync audio, low quality audio) and provides targeted notifications for each type. This segmentation allows the system to convey comprehensive information about audio status without overwhelming participants with undifferentiated details, managing information load effectively while maintaining high awareness.
Data Source
AI summary
The technology disclosed herein enables detection of audio issues for a participant on a communication session from analysis of video of the participant. In a particular embodiment, a method includes receiving video of a first participant communicating over a communication session between a first endpoint of the participant and a second endpoint of a second participant. The method further includes determining from the video that the participant is speaking. In response to determining that the participant is speaking, the method includes determining an audio issue exists due to audio of the first participant not corresponding to the video and notifying the first participant about the audio issue.