Dynamic Video Conference Layout Adaptation for Screen Space Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video conferencing systems inefficiently utilize screen space, leading to a poor user experience due to redundant and uninteresting areas being displayed, especially when participants are absent or when sites have varying numbers of participants, and manual layout adjustments are cumbersome.
Innovation Solution
Implementing a dynamic and adaptive layout system that automatically determines the region of interest (ROI) in video images, using algorithms for flesh tone detection, motion vectors, and audio energy analysis to optimize segment size and location, ensuring only relevant areas are displayed, and adjusting layout in real-time as participants join or leave.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a continuous presence layout displays all participant sites simultaneously, then all participants are visible, but screen space is wasted showing redundant empty areas when participants are absent
Solution Approach 1:
The patent extracts and removes empty or redundant segments from the video conference layout. The system detects when a participant site has no active video content and removes the corresponding segment from the display, preventing waste of screen space while maintaining continuous presence of active participants.
Solution Approach 2:
The layout dynamically adapts by adding or removing segments based on real-time detection of active video content. When a participant joins or leaves, the system automatically reconfigures the layout to optimize screen space utilization, transitioning from a static to a dynamic arrangement that responds to content availability.
2Area of stationary object
If manual layout adjustments are made to optimize screen space, then relevant areas can be prioritized, but user convenience decreases due to cumbersome operations
Solution Approach 1:
The system performs automatic layout optimization without requiring user intervention. The MCU detects active video content and autonomously configures the layout by adding or removing segments, eliminating the need for users to manually adjust settings while still achieving optimal screen space utilization.
Solution Approach 2:
The system continuously monitors video content from participant sites and uses this feedback to automatically adjust the layout. When content availability changes, the system responds by reconfiguring segments, creating a closed-loop system that optimizes display without user input.
3Device complexity
If uniform segment sizes are used in continuous presence layout, then layout simplicity is maintained, but relevance is reduced when sites have varying numbers of participants
Solution Approach 1:
The patent applies different segment configurations to different participant sites based on their specific needs and content availability. Rather than enforcing uniformity, the system allows each segment to be optimized independently, creating local variations in size and arrangement that reflect the actual video content at each site.
Data Source
AI summary
Dynamically adapting a continuous presence (CP) layout in a videoconference enhances a videoconferencing experience by providing optimum visibility to regions of interest within the CP layout and ignoring regions of no interest. Based on the CP layout, a CP video image can be built, in which a conferee at a receiving endpoint can observe, simultaneously, several other participants' sites in the conference. For example, more screen space within the CP layout is devoted to presenting the participants in the conference and little or no screen space is used to present an empty seat, an empty room, or an unused portion of a room. Aspect ratios of segments of the CP layout (e.g., landscape vs. portrait) can be adjusted to optimally present the regions of interest. The CP layout can be adjusted as regions of interest change depending on the dynamics of the video conference.