Gaze Tracking Participant Selection for Video Conferencing Layouts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video conferencing systems face challenges in displaying a large number of participants seamlessly, as they often limit the display to a subset, leading to inefficiencies in participant selection and user experience, especially in determining which participants to prioritize for display without manual intervention.
Innovation Solution
The implementation of gaze tracking technology to assign a 'measure of interest' to participants based on user attention, dynamically updating the display layout to prioritize participants the user is most interested in, ensuring they are prominently featured without requiring user action.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the display layout shows a subset of participants, then the display complexity is reduced, but the participant selection accuracy deteriorates
Solution Approach 1:
The system implements feedback by tracking user gaze behavior and using this information to dynamically adjust participant selection for display. The gaze tracking data provides continuous feedback about user interest, which is processed to automatically update which participants are shown in the video conference interface, resolving the contradiction between simplified display and accurate selection.
Solution Approach 2:
The system enables self-service by automatically selecting which participants to display based on gaze tracking without requiring manual user intervention. The system serves itself by using its own collected gaze data to make intelligent decisions about participant prioritization, eliminating the need for users to manually configure display preferences while maintaining accurate participant selection.
2Measurement precision
If manual intervention is required for participant selection, then the participant selection accuracy is improved, but the ease of operation deteriorates
Solution Approach 1:
The system eliminates manual intervention by implementing self-service through automatic participant selection based on gaze tracking. The system autonomously determines which participants to display by analyzing user gaze behavior, thereby maintaining accurate participant selection while completely removing the operational burden from the user.
Solution Approach 2:
The system replaces manual mechanical interaction (user clicking or selecting participants) with an automated optical system (gaze tracking). By substituting the mechanical selection process with eye-tracking technology and automated decision-making algorithms, the system achieves both accurate participant selection and ease of operation simultaneously.
3Measurement precision
If gaze tracking is implemented, then the participant selection accuracy is improved, but the device complexity increases
Solution Approach 1:
The system uses gaze tracking as an intermediary mechanism to bridge the gap between user attention and participant selection. Rather than directly implementing complex selection logic, the system introduces gaze tracking data as an intermediate input that automatically informs participant prioritization, thereby achieving accurate selection while managing complexity through a dedicated sensing layer.
Data Source
AI summary
A method is disclosed and in one embodiment includes presenting to a user a display layout associated with a video conferencing session, the display layout comprising a plurality of images of participants in the video conferencing session, wherein each of the participants is assigned to a layout category; accumulating gaze tracking information indicative of an amount of time the user has spent looking at the image of a first one of the participants relative to the images of other ones of the participants; assigning a measure of interest (“MOI”) to the first one of the participants based on the accumulated gaze tracking information; determining whether the assigned MOI meets a first threshold value; if the assigned MOI meets the first threshold value, updating the layout category to which the first one of the participants is assigned; and updating the display layout using the updated layout category to which the first one of the participants is assigned.