Haptic Feedback System for Video Conference Non-Verbal Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Individuals with limited sight are disadvantaged in video conferences as they cannot easily perceive non-verbal cues from participants, such as facial expressions and body language, which are crucial for understanding the context and dynamics of the meeting.
Innovation Solution
An electronic device integrated with a video camera, touchscreen display, and haptics feedback system that converts speech to text and provides feedback on non-verbal cues through tactile, auditory, or visual means, including Braille, large text, or audio formats, allowing impaired attendees to sense participant actions and emotions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video conference is conducted using standard visual interfaces, then communication efficiency is maintained for sighted participants, but impaired participants with limited sight cannot perceive non-verbal cues such as facial expressions and body language
Solution Approach 1:
The patent introduces an intermediary system that includes video cameras to capture non-verbal cues, processors to analyze the captured data, and output devices (tactile, auditory, or visual) to convey the analyzed information to impaired participants. This intermediary chain bridges the gap between visual video conference content and accessible formats for participants with limited sight.
Solution Approach 2:
The patent replaces the purely visual mechanical system of traditional video conferences with a multi-sensory system that incorporates tactile feedback through haptic devices, auditory feedback through speakers or headphones, and visual feedback through displays. This substitution allows impaired participants to perceive non-verbal cues through alternative sensory channels.
2Adaptability or versatility
If multiple feedback modalities (tactile, auditory, visual) are integrated into the video conference system, then impaired participants can access non-verbal cues, but device complexity increases
Solution Approach 1:
The patent implements a universal feedback system where a single integrated apparatus performs multiple functions: capturing video and audio, processing and analyzing non-verbal cues, and providing feedback through multiple modalities (tactile, auditory, visual). This multi-functional design consolidates what could be separate complex systems into one unified device.
Solution Approach 2:
The patent merges the video camera, processing unit, and multiple output devices (haptic feedback system, audio output, visual display) into a single integrated video conference system. This combining of components simplifies the overall system architecture compared to having separate systems for each function.
3Loss of information
If real-time analysis and feedback of non-verbal cues is provided, then impaired participants can understand participant emotions and actions, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary action by continuously capturing and pre-processing video and audio data during the video conference, preparing the information for rapid analysis and feedback delivery. This ensures that when non-verbal cues need to be communicated to impaired participants, the processing can occur with minimal delay.
Solution Approach 2:
The patent implements a feedback loop where the system continuously monitors video and audio inputs, analyzes non-verbal cues in real-time, and immediately provides feedback through appropriate output modalities. This closed-loop feedback system ensures that information is delivered promptly as it is detected, maintaining real-time communication flow.
Data Source
AI summary
An electronic device is communicatively coupled to at least one video camera during a video conference, and also includes a touchscreen display having video conference participant representations displayed on the touchscreen display. A haptics feedback system is integrated into the touchscreen display and is responsive to a user touching the video conference participant representations displayed on the touchscreen display. A speech-to-text controller converts video conference participant's speech into text and creates an identification tag for each video conference participant. In addition, an ongoing commentary controller provides feedback on non-verbal cues about the video conference participants.