Dynamic Video Stream Switching for Conference Visual Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video conferences, users often need to monitor multiple video feeds to detect non-verbal activity, which can be distracting and inefficient, especially in large groups or on devices with limited display space, and current systems fail to effectively display non-verbal events without disrupting the primary audio and video of speaking users.
Innovation Solution
A communication system that implements a 'Storied Experience View' by selecting and displaying video streams based on detected changes in visual content, such as enter/leave events and user movements, using a central server to manage video streams and allocate bandwidth efficiently, allowing users to focus on key activities without replacing speaking users' audio and video.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If all video streams are displayed in a grid layout, then all participants are visible, but display space is wasted and user focus is diluted
Solution Approach 1:
The system dynamically switches between grid layout and spotlight layout based on detected visual changes. When non-verbal activity is detected, the system transitions from a static grid displaying all participants to a dynamic spotlight view that focuses on the active participant, optimizing display space while maintaining visibility of relevant information.
Solution Approach 2:
The display is segmented into two functional areas: the main spotlight area that shows the active participant in high detail, and a secondary area that maintains context about other participants. This segmentation allows efficient use of display space while preserving awareness of overall participant activity.
2Loss of information
If video streams are switched frequently to show non-verbal activity, then spatial awareness is improved, but user distraction increases
Solution Approach 1:
The system employs periodic detection of visual changes at controlled intervals rather than continuous monitoring. When changes are detected, the system transitions to spotlight view temporarily, then returns to grid view, creating a rhythmic pattern that maintains spatial awareness without causing continuous distraction.
Solution Approach 2:
The system applies partial action by showing only the specific portion of video content that contains non-verbal activity rather than switching between all participants. This selective display provides necessary spatial information while minimizing disruption to user focus on the primary conversation.
3Loss of information
If bandwidth is allocated to all video streams, then all participants are visible, but network resources are wasted
Solution Approach 1:
The system extracts and prioritizes transmission of only the video stream containing non-verbal activity when such activity is detected. Other participant video streams are either reduced in quality or temporarily suspended, extracting the essential information needed while eliminating wasteful bandwidth consumption.
Solution Approach 2:
The system dynamically changes video stream parameters (resolution, frame rate, bitrate) based on activity detection. When non-verbal activity is detected in a particular stream, that stream receives high-quality parameters while other streams are downgraded or suspended, optimizing bandwidth efficiency while preserving necessary information.
4Loss of information
If speaking users' audio and video are replaced to show non-verbal activity, then spatial awareness is improved, but communication quality deteriorates
Solution Approach 1:
The system uses an intermediary approach by introducing a secondary display area or overlay that shows non-verbal activity without replacing the primary speaking user's audio and video. This intermediary element provides additional spatial information while maintaining the reliability of the main communication channel.
Solution Approach 2:
The system applies partial action by showing non-verbal activity in a limited, non-intrusive manner (such as a small overlay or secondary window) rather than fully replacing the speaking user's feed. This provides awareness of participant activity while preserving the primary communication quality.
Data Source
AI summary
In a communication event between a first user and one or more second users via a communication network. A plurality of video streams is received via the network at a computer connected to the network. Each of the streams carries a respective moving image of at least one respective user. The computer causes the respective moving image of a first of the video streams to be displayed at a user device of the first user for a first time interval. The computer detects, in the respective moving image of a second of the video streams that is not displayed at the user device in the first time interval, a change in the visual content thereof. In response to detecting said change in the visual content, the computer causes at least the second video stream to be displayed at the user device for a second time interval.