Video Call Display Gesture Recognition Without Visible Hand Motions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video call services face challenges in effectively integrating gesture recognition functions without distracting or inconveniencing users, as gestures made during calls are often visible to the other party, leading to potential discomfort and loss of concentration.
Innovation Solution
A display apparatus and method that identifies and processes a gesture recognition area within a captured image, excluding the gesture from the transmitted image to the counterpart device, allowing seamless integration of gesture recognition during video calls without showing the gesture to the other party.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If gesture recognition is integrated into video call service, then gesture control functionality is improved, but user comfort and concentration are worsened due to gestures being visible to the other party
Solution Approach 1:
The image captured by the camera is divided into two separate areas: a transmission area that is sent to the counterpart device for video call display, and a gesture recognition area that is processed locally for gesture control. This segmentation allows gestures to be recognized without being transmitted, thus maintaining functionality while eliminating the harmful effect of visible gestures to the other party.
Solution Approach 2:
The gesture recognition area is extracted and separated from the transmission area. By taking out the gesture recognition function from the transmitted image stream and processing it independently in a dedicated area, the system enables gesture control without including gesture information in the video feed sent to the counterpart device, thereby preventing user discomfort.
2Loss of information
If the entire captured image is transmitted for video call, then video quality is improved, but gesture recognition capability is worsened due to lack of dedicated recognition area
Solution Approach 1:
The captured image is segmented into a transmission area for video call quality and a gesture recognition area for gesture control. This segmentation ensures that the transmission area maintains high quality for video communication while the gesture recognition area is optimized for detecting hand movements and gestures, thus improving both video quality and gesture recognition capability simultaneously.
Data Source
AI summary
A display apparatus includes: a display; a communicator, a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions. The at least one processor is configured to execute the one or more instructions to: identify a transmission area and a gesture recognition area in an image area of a first image captured by a camera for a video call; control the communicator to transmit a second image corresponding to the transmission area to a counterpart display apparatus participating in the video call, in order to provide a video call service; perform gesture recognition in a third image corresponding to the gesture recognition area; and perform a function corresponding to a recognized gesture from the gesture recognition in the third image.