Dynamic Interaction Model Adaptation for Multi-Device Engagement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interaction models for computing devices, particularly between laptops/desktops and mobile devices like tablets and phones, are inefficient for seamless user interaction, especially when transitioning between devices or interacting with multiple devices simultaneously.
Innovation Solution
The system dynamically adapts interaction models based on user engagement by utilizing sensors to determine the user's focus, allowing for optimized input gestures and user interface controls across various devices, including mobile devices, remote computers, and embedded home devices, with automatic transitions and machine learning for improved accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a mobile device displays content on a remote display screen, then content visibility is improved, but user interaction with the remote content becomes difficult
Solution Approach 1:
The mobile device acts as an intermediary between the user and the remote display. It captures user input from its own touchscreen and transmits this input to the remote display system, enabling indirect control of the remote content through the mobile device's interface
Solution Approach 2:
The system creates a copy of the remote display content on the mobile device screen. This local copy allows users to interact with the content using the mobile device's touchscreen, and these interactions are then synchronized with the remote display, effectively copying the interaction capability from the remote system to the mobile device
2Ease of operation
If the system automatically transitions between interaction models based on user engagement, then user interaction optimization is improved, but system complexity increases
Solution Approach 1:
The system continuously monitors user engagement signals (gaze direction, device proximity, active applications) and uses this feedback to automatically determine which interaction model to apply. This closed-loop feedback mechanism enables dynamic adaptation without requiring complex manual configuration
Solution Approach 2:
The interaction model is made dynamic rather than static. The system can automatically transition between different interaction models (local device control, remote display control, collaborative mode) based on real-time user engagement detection, allowing the system to adapt its behavior to current usage context
Data Source
AI summary
The techniques disclosed herein enable dynamic device interaction adaptation based on user engagement. In general, a computer can leverage sensors to determine a user's level of engagement with one or more devices. As the user transitions his or her attention to different devices, the computer can utilize different interaction models to assist the user in interacting with each device that meets a threshold level of engagement with the user. Individual interaction models can configure the computer to direct input gestures received by the computing device to a selected device, and adapt the computer's input modality to provide user interface controls that are optimized for the selected device. When a user is interacting with two or more devices, automatic transitions between different interaction models can help improve the user's interaction with each device.