User Behavior Recognition in Video Conferencing Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In existing video conferencing systems, it is difficult for users to identify which user among multiple participants has performed a specific action, such as speaking, due to the concurrent display of video and speech from multiple locations.
Innovation Solution
An information processing device equipped with a user recognition unit to identify users in captured images and a behavior recognition unit to recognize user actions, generating and transmitting user behavior information for display on a screen, allowing users to visually associate user images with their actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video and speech from multiple users are displayed concurrently, then information exchange capability is improved, but user behavior identification capability deteriorates
Solution Approach 1:
The patent segments the display information by associating each user's video/speech with their identified behavior, creating separate information channels for different users. This segmentation allows the system to maintain concurrent display of multiple users while enabling precise identification of individual user behaviors through visual indicators such as icons or labels attached to each user's video feed.
2Productivity
If multiple users' video and speech are played simultaneously, then communication efficiency is improved, but behavior attribution clarity deteriorates
Solution Approach 1:
The patent employs visual indicators such as color-coded icons or labels associated with each user to clearly attribute behaviors to specific users. These visual markers change or differentiate based on the user's detected behavior (e.g., speaking, listening, reacting), allowing users to quickly understand who is performing which action without interrupting the concurrent video conference flow.
Data Source
AI summary
An information processing apparatus may include a user recognition unit to recognize a user in a captured image, and a behavior recognition unit to recognize a behavior of a user. In addition, the apparatus may include a generation unit to generate user behavior information including information of the recognized user and the recognized behavior of the recognized user. Further, the apparatus may include a communication unit to transmit the user behavior information to an external apparatus.