Camera Tracking via Engagement Priority in Video Calls
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video communication systems struggle to dynamically adjust their field of view and focus on participants during video calls, leading to an unnatural user experience due to limitations in tracking moving individuals and prioritizing engaged participants.
Innovation Solution
A device equipped with a motorized camera and display system that uses computer vision and natural language processing to detect and prioritize participants based on engagement, allowing for dynamic panning, tilting, and zooming to maintain focused attention on the most engaged individuals, even as they move within the environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the camera system uses traditional fixed-position video communication, then the system structure is simple, but the user experience becomes unnatural when participants move
Solution Approach 1:
The camera system transitions from a fixed position to a dynamic tracking system that automatically follows participants based on their engagement levels. The camera pan, tilt, and zoom mechanisms are controlled dynamically to maintain focus on the most engaged participant, resolving the contradiction by making the system adaptive rather than static.
Solution Approach 2:
The system uses computer vision to continuously analyze participant engagement and provides feedback to the camera control system. This closed-loop feedback mechanism allows the camera to automatically adjust its position and focus based on real-time analysis of participant behavior, improving user experience without requiring manual intervention.
2Adaptability or versatility
If the system tracks all participants equally, then the system is simple to implement, but it cannot prioritize engaged participants leading to unnatural interaction
Solution Approach 1:
The system applies different tracking priorities to different participants based on their engagement levels. Instead of treating all participants equally, the computer vision system identifies and prioritizes the most engaged participant, allocating camera resources dynamically to those who need attention, thus achieving adaptability in participant prioritization.
Solution Approach 2:
The system changes the priority parameter for each participant based on real-time engagement analysis. The computer vision system continuously evaluates engagement metrics and adjusts the tracking priority accordingly, allowing the system to adapt to changing interaction dynamics without requiring complex manual configuration.
3Ease of operation
If users remain stationary for natural tracking, then the tracking system is simpler, but it limits user mobility and creates an unnatural experience
Solution Approach 1:
The system replaces manual positioning requirements with an automated computer vision-based tracking system. Instead of requiring users to stay in fixed positions for the camera to work properly, the system uses image processing and engagement analysis to automatically follow participants wherever they move, thereby improving user mobility while maintaining tracking accuracy.
Data Source
AI summary
Devices and techniques are generally described for selection of an object to follow during a video call. In various examples, a first frame of image data may be received from a camera. First image data representing a first person and second image data representing a second person may be determined. A first priority level may be determined for the first person at a first time. A second priority level for the second person may be determined at the first time. The camera may be controlled to follow the first person based at least in part on the first priority level and the second priority level.