Videoconference Self-View PIP for Framing Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In multipoint videoconferencing, participants often go unnoticed when they are improperly framed by video cameras, leading to self-consciousness due to constant reminders of being on-camera, as existing systems lack effective feedback mechanisms to alert them of framing issues without continuously displaying their image.

Innovation Solution

A system employing a face detection algorithm to temporarily display a self-view image as a picture-in-picture (PIP) when participants are improperly framed, allowing them to correct their positioning, using a hysteresis mechanism to smooth out responses and determine the expected number of participants based on multiple video frames or user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a continuous self-view PIP is displayed to provide feedback to participants, then framing accuracy is improved, but participant comfort and realism deteriorate due to constant self-awareness

Engineering Contradiction:
Improveframing accuracyVSAvoidparticipant self-consciousness
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The self-view PIP is displayed periodically rather than continuously - specifically triggered when face detection algorithm identifies improper framing. The PIP appears temporarily to provide feedback and then disappears, creating a periodic action that maintains framing accuracy while eliminating constant self-awareness discomfort

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system implements feedback by using the face detection algorithm to monitor framing and trigger the self-view PIP only when framing is improper. This feedback mechanism provides necessary correction information while avoiding unnecessary continuous display, resolving the contradiction between feedback effectiveness and participant comfort

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If no self-view feedback is provided, then participant comfort is maintained, but framing accuracy deteriorates as participants wait to be guided back into the picture

Engineering Contradiction:
Improveparticipant comfortVSAvoidframing accuracy
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The face detection algorithm provides automated feedback by detecting when participants are improperly framed and triggering the self-view PIP accordingly. This enables participants to self-correct framing issues without constant visual reminders, maintaining comfort while improving framing accuracy

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system enables participants to self-service their own framing by providing them with the information needed to adjust their position. The feedback mechanism allows participants to independently correct their own framing without external intervention, balancing comfort with framing accuracy

Inventive Principle:
Principle #25Self-service

3Reliability

If the self-view PIP is displayed continuously, then framing feedback is always available, but the realism of the videoconference environment deteriorates

Engineering Contradiction:
Improveframing feedback availabilityVSAvoidenvironmental realism
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The self-view PIP operates periodically, activating only when framing issues are detected by the face detection algorithm. This periodic operation ensures framing feedback is available when needed while maintaining the natural, realistic appearance of the videoconference environment during proper framing

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts the display state of the self-view PIP based on real-time framing conditions. The PIP transitions between visible and hidden states according to the detection results, providing reliable feedback when necessary while preserving environmental realism during normal operation

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS8390667B2Pop-up PIP for people not in picture
Publication Date: 2013.03.05 CISCO TECHNOLOGY INC
  • US8390667B2 patent drawing
  • US8390667B2 patent drawing
  • US8390667B2 patent drawing

AI summary

A system and method for alerting participants in a videoconference that one or more participants are improperly framed by the videoconference camera is provided. An embodiment comprises a temporary self-view picture-in-picture image appearing when the number of faces detected by the videoconference camera changes. A face detection algorithm is used to determine when the number of faces being detected by the videoconference camera has changed. The self-view picture-in-picture image displays, for a duration of time, a representation of the image being captured by the videoconference camera, allowing participants who are not properly framed by the videoconference camera to adjust their position to that their faces are captured by the videoconference camera.