Video Conference Camera Control via Participant Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video conferencing systems lack the ability to dynamically adjust the camera's viewing angle based on individual participants' preferences, often forcing remote participants to view only the speaker, regardless of their interest.
Innovation Solution
A method and apparatus that generate reference data from images and movement patterns of participants, allowing for the extraction and transmission of control parameters to adjust the camera's direction and zoom, enabling participants to control their viewing angle by sensing movements such as eye turns, head movements, and upper body tilts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the camera is controlled by a main speaker to focus on the speaking participant, then the clarity of the speaker is improved, but the viewing angle flexibility deteriorates
Solution Approach 1:
The system captures participant movements (eye direction, head orientation, body tilt) as feedback signals and uses these to automatically adjust camera parameters. This feedback mechanism enables the camera to respond to individual participant preferences, resolving the contradiction between maintaining speaker focus and providing viewing angle flexibility.
Solution Approach 2:
Each participant can independently control the camera by making natural movements without requiring manual intervention from a main speaker. The system interprets individual participant gestures (such as eye direction or head turning) to automatically adjust the camera angle, allowing participants to serve themselves in choosing their preferred view.
2Reliability
If the camera focuses on the main speaker only, then the speaker visibility is improved, but the participant choice deteriorates
Solution Approach 1:
The patent replaces manual camera control mechanisms with an automated gesture recognition system. Instead of requiring participants to manually operate the camera or rely on a main speaker to control it, the system uses sensors to detect natural body movements and automatically translates these into camera control commands, thereby substituting mechanical/manual operation with an automated sensing and control system.
3Ease of operation
If manual camera control is implemented, then the viewing angle control is improved, but the system complexity deteriorates
Solution Approach 1:
The system introduces an intermediary gesture recognition module that translates natural participant movements into camera control parameters. This intermediary layer simplifies the interface between participant intent and camera action, avoiding the need for complex manual control mechanisms while maintaining ease of operation.
Data Source
AI summary
A method and apparatus for widening a viewing angle in a video conferencing system are provided. The apparatus for widening a viewing angle in a video conferencing system includes: generating reference data from images of a video conference participant captured by a camera included in the video conferencing system; generating movement data based on the video conference participant's movements sensed by the camera; extracting a first control parameter by comparing the reference data with the movement data; transmitting the first control parameter to the other end of the conference; receiving a second control parameter generated at the other end of the conference; and controlling the camera by the second control parameter.