Video Conference Engagement Correction via Visual Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During video conferences, participants often exhibit disengagement behaviors such as looking away from the screen, slouching, or facing their phones, which are not effectively addressed by existing technologies, leading to reduced engagement and attention among participants.

Innovation Solution

A method and system that utilize visual characteristics like gaze, facial direction, and posture to determine disengagement, employing a classifier model and visual overlays to notify and re-engage users, with user preferences configuring the intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If visual monitoring and overlays are implemented to detect and correct disengagement, then participant engagement is improved, but device complexity and processing requirements increase

Engineering Contradiction:
Improveparticipant engagementVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses each participant's own device camera to capture their visual characteristics, eliminating the need for external monitoring equipment. The device monitors itself autonomously, reducing infrastructure complexity while maintaining engagement detection capability

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system transforms physical visual parameters (gaze direction, facial orientation, posture) into digital engagement metrics through image processing and machine learning classification, enabling automated engagement assessment without complex human observation systems

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If continuous monitoring of visual characteristics is performed to detect disengagement, then engagement accuracy is improved, but energy consumption and processing load increase

Engineering Contradiction:
Improveengagement detection accuracyVSAvoidprocessing energy
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs engagement detection at periodic intervals rather than continuously, analyzing visual characteristics at specific moments during the video conference. This reduces processing energy while maintaining accurate detection of engagement states through strategically timed assessments

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system monitors only the most critical visual characteristics (gaze direction, facial orientation) rather than all possible parameters, achieving sufficient detection accuracy with reduced processing requirements by focusing on key engagement indicators

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If visual overlays are displayed to notify users of disengagement, then user awareness is improved, but user experience and comfort may deteriorate

Engineering Contradiction:
Improveuser awarenessVSAvoiduser comfort
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system provides gentle visual feedback through overlays that notify users of their disengagement state, allowing them to self-correct. The feedback is informative rather than punitive, maintaining user comfort while improving awareness through non-intrusive notifications

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system alerts users to disengagement before it significantly impacts conference participation quality, giving them advance notice to adjust their posture or attention. This preliminary warning prevents complete disengagement while maintaining a positive user experience

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11695897B2Correcting engagement of a user in a video conference
Publication Date: 2023.07.04 ADVANCED MICRO DEVICES INC
  • US11695897B2 patent drawing
  • US11695897B2 patent drawing
  • US11695897B2 patent drawing

AI summary

Correcting engagement of a user in a video conference includes: receiving video data of a user of a participant device of a video conference; determining that one or more visual characteristics of the video data satisfy one or more criteria; and displaying, by the participant device, a visual overlay in response to the one or more criteria being satisfied.