Video Chat Head Tracking via Depth Camera Sub-Frame Reframing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video communication systems require users to remain stationary in front of the camera to be optimally viewed, limiting mobility and user experience.
Innovation Solution
A method and system that automatically tracks the position of a user's head, neck, and shoulders using a depth camera, allowing movement within a field of view while maintaining optimal video feed display to remote users by identifying and displaying sub-frames of pixels containing these features.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user moves within the field of view, then user mobility and freedom of movement are improved, but the user is no longer optimally viewed by the camera and remote user
Solution Approach 1:
The system dynamically adjusts the captured video frame based on the user's movement. The camera continuously tracks the user's head, neck, and shoulders position, and automatically reframes the video feed to keep the user optimally positioned. This dynamic adaptation allows the user to move freely while maintaining consistent video quality, as the system actively compensates for position changes rather than requiring the user to remain stationary.
Solution Approach 2:
The system uses real-time feedback from depth camera data to detect user movement and automatically adjusts the video frame in response. By continuously monitoring the user's position and providing immediate corrective framing adjustments, the system ensures that user mobility does not compromise video quality. The feedback loop between movement detection and automatic reframing resolves the contradiction between freedom of movement and consistent video quality.
2Manufacturing precision
If the user remains stationary in front of the camera, then optimal video quality is maintained, but user mobility is limited
Solution Approach 1:
The system performs self-service by automatically detecting user movement and adjusting the video frame without requiring user intervention. The automatic tracking and reframing functionality eliminates the need for the user to manually adjust their position or interact with camera controls, allowing them to move freely while the system independently maintains optimal video quality. This self-adjusting capability resolves the contradiction by making the system responsive to user movement rather than constraining it.
3Ease of operation
If automatic tracking of head, neck and shoulders position is implemented, then user movement within field of view is enabled, but system complexity increases
Solution Approach 1:
The system replaces complex mechanical tracking mechanisms with computational image processing and depth camera analysis. Instead of using physical sensors or mechanical devices to track user position, the system uses software algorithms to analyze video frames and detect the user's head, neck, and shoulders position. This substitution of mechanical systems with computational methods reduces physical complexity while enabling automatic tracking and reframing functionality.
Data Source
AI summary
A system for automatically tracking movement of a user participating in a video chat application executing in a computing device is disclosed. A capture device connected to the computing device captures a user in a field of view of the capture device and identifies a sub-frame of pixels identifying a position of the head, neck and shoulders of the user in a capture frame of a capture area. The sub-frame of pixels is displayed to a remote user at a remote computing system who is participating in the video chat application with the user. The capture device automatically tracks the position of the head, neck and shoulders of the user as the user moves to a next location within the capture area. A next sub-frame of pixels identifying a position of the head, neck and shoulders of the user in the next location is identified and displayed to the remote user at the remote computing device.