Mixed Modality Conferencing System for Inclusive Participation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current conferencing solutions often exclude participants who lack access to audio or video devices or are in environments where using such devices is not convenient, leading to reduced participation and delayed feedback.
Innovation Solution
The implementation of mixed modality conferencing systems that allow users to participate using video conferencing, audio conferencing, or text conferencing, with the ability to translate between these modalities, enabling users to communicate effectively regardless of their device or location.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional audio/video conferencing is used, then real-time communication quality is improved, but participant accessibility and inclusivity deteriorate
Solution Approach 1:
The conferencing system is designed to support multiple communication modalities (audio, video, text-based) within a single platform, allowing participants to choose their preferred mode of interaction. This multi-functionality ensures that the system accommodates diverse participant needs and environments while maintaining reliable communication quality across all modalities.
Solution Approach 2:
The system introduces an intermediary translation layer that converts between different communication modalities. Text-based participants can communicate through chat or text messages that are translated into audio/video context, while audio/video participants can have their speech transcribed into text. This intermediary mechanism bridges the gap between different modalities, improving both accessibility and communication quality.
2Productivity
If audio/video devices are required for conference participation, then communication effectiveness is improved, but system complexity and device requirements worsen
Solution Approach 1:
The system extracts the core communication function from the traditional audio/video-only model and separates it into independent modalities. Text-based communication can function independently without requiring audio/video devices, while audio/video communication remains available for those who need it. This extraction reduces device complexity requirements while maintaining communication effectiveness for all participant types.
Solution Approach 2:
The system allows dynamic switching between different communication parameters (modalities) based on participant capabilities and environmental conditions. Participants can change their communication mode from audio/video to text-based if device availability or environmental factors change, maintaining communication effectiveness without being constrained by fixed device requirements.
3Loss of information
If post-conference transcripts are used for absent participants, then information delivery is improved, but feedback timeliness deteriorates
Solution Approach 1:
The system performs preliminary actions by continuously transcribing and making conference content available in real-time during the conference, rather than waiting until after the conference ends. Text-based participants and absent participants can access this preliminary transcript information during the conference itself, enabling timely feedback without waiting for post-conference processing.
Solution Approach 2:
The system implements real-time feedback mechanisms where text-based participants can provide input during the conference that is immediately visible to all participants. This continuous feedback loop eliminates the delay inherent in post-conference transcripts, as feedback is processed and delivered during the actual conference proceedings rather than after completion.
4Adaptability or versatility
If chat is used as a separate communication channel, then alternative participation is improved, but user engagement and chat monitoring worsen
Solution Approach 1:
The system merges the chat interface with the main conference video window rather than keeping it as a separate window. This integration allows participants to view and interact with chat messages within the same visual space as the conference content, improving ease of operation by eliminating the need to switch between windows and maintaining user engagement while still providing alternative text-based participation options.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods for conferencing are disclosed. The systems and methods receive, by a computer-based system in electronic communication with a first communication endpoint and a second communication endpoint, a first communication comprising communication data. The systems and methods determine, by the computer-based system, a first communication media type of the first communication endpoint and a second communication media type of the second communication endpoint. Additionally, the systems and methods convert, by the computer-based system, the communication data into a second communication formatted according to the first communication media type or the second communication media type and transmit, by the computer-based system, the first communication or the second communication to the first communication endpoint and the second communication endpoint based on a communication media type of each communication endpoint.