Virtual Hand Representation for Videoconferencing Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Videoconferencing systems face challenges in accurately depicting user interactions, such as touch gestures on a touchscreen, when the user's hand is outside the camera's field of view, leading to a lack of clarity and engagement in real-time communication.
Innovation Solution
The implementation of videoconferencing circuitry that performs motion and touch analysis to determine when a user's hand is out of the camera's field of view, allowing for the presentation of a virtual representation of the user's hand on remote devices, enhancing visibility and interaction clarity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the camera field of view is used to capture user interactions, then the system structure remains simple, but user interactions outside the field of view cannot be captured
Solution Approach 1:
The patent introduces touch sensor data as an intermediary to bridge the gap between physical touch interactions and their visual representation. When the hand is outside the camera field of view, the system uses touch sensor coordinates to generate a virtual representation of the hand position, allowing remote participants to see interactions that the camera cannot capture directly
Solution Approach 2:
The patent creates a virtual copy of the user's hand based on touch sensor data when the real hand is not visible to the camera. This virtual hand representation is transmitted to remote devices to indicate the location and nature of touch interactions, effectively copying the essential information about the interaction without requiring the physical hand to be in the camera's view
2Measurement precision
If motion analysis is performed to detect hand position, then interaction detection accuracy improves, but processing time increases
Solution Approach 1:
The system continuously tracks hand motion and predicts hand position in advance using motion analysis algorithms. By performing preliminary motion analysis and maintaining a buffer of hand position data, the system can quickly determine whether the hand is within the camera field of view without performing complex real-time analysis for each frame
Solution Approach 2:
The patent replaces complex real-time video analysis with a more efficient approach that combines simplified motion detection with touch sensor data. Instead of analyzing every video frame to detect hand position, the system uses motion vectors and touch coordinates to determine hand location, significantly reducing processing time while maintaining accuracy
Data Source
AI summary
A device may include videoconferencing circuitry. The videoconferencing circuitry may access video data of a user captured through a camera. The videoconferencing circuitry may further determine, for the captured video data, that a user portion of the user is not in a field of view of the camera, such as the hand of the user. The videoconferencing circuitry may augment the video data to include a virtual representation of the user portion of the user and transmit the video data augmented with the virtual representation of the user portion to a remote videoconferencing device.