Dynamic Video Conference Display Prioritization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current videoconferencing architectures face challenges in optimizing display use during multiscreen endpoints in multipoint meetings, failing to provide a realistic experience by using blunt mechanisms for image rendering that do not account for participant activity levels or hierarchy.
Innovation Solution
A communication system that dynamically adjusts image rendering based on participation levels, calculated from inputs such as speech frequency, body language, and eye gaze metrics, to prioritize active participants and manage screen real estate effectively, simulating an in-person meeting experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If more participants are included in a multipoint meeting, then the meeting comprehensiveness is improved, but the display optimization becomes more difficult when there are more participants than available displays
Solution Approach 1:
The system dynamically changes display parameters (participant selection, positioning, scaling) based on real-time participation metrics. The multipoint controller monitors speech frequency, volume, and other participation indicators, then adjusts which participants are displayed and how they are positioned on available screens, resolving the contradiction between including all participants and optimizing limited display resources.
2Reliability
If all participants are displayed on available screens, then participant visibility is improved, but the screen real estate utilization becomes inefficient when participants exceed display capacity
Solution Approach 1:
The system applies different display qualities and priorities to different participants based on their current participation levels. Active speakers receive prominent display positions with larger screen real estate, while inactive participants are minimized or hidden. This local differentiation resolves the contradiction by ensuring visible display of important participants while efficiently utilizing limited screen resources.
Solution Approach 2:
The display configuration dynamically adjusts participant visibility and positioning based on real-time participation metrics. As participants become more or less active, their display prominence automatically changes, ensuring that screen real estate is continuously optimized for current meeting needs while maintaining participant visibility when relevant.
3Device complexity
If static image rendering is used, then system complexity is reduced, but the realism of meeting experience deteriorates compared to in-person interactions
Solution Approach 1:
The system implements feedback loops where the multipoint controller continuously monitors participation metrics (speech frequency, volume, engagement) and uses this information to dynamically adjust image rendering. This feedback mechanism enables realistic meeting experiences with automatic speaker highlighting and participant positioning without requiring complex manual configuration, resolving the contradiction between simplicity and realism.
Data Source
AI summary
A method is provided in one example embodiment and includes monitoring a plurality of inputs associated with end users involved in a video session in which a plurality of displays are used. At least one of the inputs is associated with a frequency of speech of the end users. The method also includes determining a participation level for each of the end users based on the inputs, and determining which image data associated with the end users is to be rendered on a selected one of the plurality of displays based on the participation levels.