Mobile Device Gesture Control for Telepresence Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing videoconferencing technologies do not effectively optimize telepresence for mobile users participating in remote sessions, lacking efficient and affordable solutions for live, interactive communication across various geographic locations, and failing to adequately transmit nonverbal cues for enhanced collaboration.
Innovation Solution
The optimized telepresence technique utilizes a mobile device connected to a network to receive and transmit live video and audio, allowing users to gesture and control the display of remote users' video and audio, incorporating motion-sensing and gaze awareness features to create an immersive experience, compatible with conventional devices and networks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional videoconferencing technology is used, then basic audio and video communication is achieved, but telepresence optimization and nonverbal cue transmission are insufficient
Solution Approach 1:
The system dynamically adapts audio and video presentation based on detected user gestures and gaze direction. The mobile device continuously monitors user behavior and adjusts the telepresence experience in real-time, transitioning from static to dynamic control to optimize engagement and information delivery.
Solution Approach 2:
The mobile device automatically detects gestures and gaze without requiring explicit user commands. The system self-adjusts the telepresence parameters based on implicit user behavior, eliminating the need for manual configuration and making the technology easier to operate while improving reliability.
2Adaptability or versatility
If mobile devices are used for telepresence, then accessibility and affordability are improved, but device complexity and control capabilities are limited
Solution Approach 1:
The patent replaces complex mechanical control interfaces with gesture-based and gaze-based control mechanisms. By utilizing the mobile device's camera and motion sensors to detect natural user behaviors, the system eliminates the need for physical buttons, switches, or complex menus, thereby reducing perceived device complexity while maintaining versatility across different mobile platforms.
3Ease of operation
If gesture-based control is implemented, then user interaction and engagement are enhanced, but system complexity and processing requirements increase
Solution Approach 1:
The system uses the mobile device's existing camera and motion sensors as intermediaries to capture gesture and gaze information. Rather than adding complex dedicated sensing hardware, the patent leverages the mobile device's native capabilities as mediators between the user's physical actions and the telepresence control system, reducing overall system complexity while enabling intuitive gesture-based interaction.
Data Source
AI summary
Telepresence of a mobile user (MU) utilizing a mobile device (MD) and remote users who are participating in a telepresence session is optimized. The MD receives video of a first remote user (FRU). Whenever the MU gestures with the MD using a first motion, video of the FRU is displayed. The MD can also receive video and audio of the FRU and a second remote user (SRU), display a workspace, and reproduce the audio of the FRU and SRU in a default manner. Whenever the MU gestures with the MD using the first motion, video of the FRU is displayed and audio of the FRU and SRU is reproduced in a manner that accentuates the FRU. Whenever the MU gestures with the MD using a second motion, video of the SRU is displayed and audio of the FRU and SRU is reproduced in a manner that accentuates the SRU.