Contextual User Interface Adaptation for Input Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
User interfaces for various devices are often not optimized for the specific interaction method or environmental context, leading to difficulties in task completion, as they are not adapted for the chosen input device or environmental conditions such as obstructions.
Innovation Solution
The system analyzes the interaction context using signals like color image data, 3D image data, and audio signals to automatically optimize the user interface, adjusting its characteristics to suit the chosen input device and environmental conditions, such as moving menu items to avoid obstructions and adapting to different handedness or device usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user interface is designed for one form of interaction, then it is optimized for that specific interaction method, but it is not suitable or optimized for a second kind of interaction
Solution Approach 1:
The user interface dynamically adapts its characteristics based on the detected input device. The system monitors which input device the user is employing (e.g., remote control, gestures, voice) and automatically adjusts interface parameters such as button sizes, navigation methods, and interaction patterns to optimize usability for that specific device, thereby resolving the contradiction between specialized optimization and multi-device adaptability
2Productivity
If the interface objects are positioned for easy access, then interaction efficiency is improved, but interface visibility may be reduced when objects are obscured by obstructions
Solution Approach 1:
The interface dynamically repositions menu items and interactive elements based on real-time detection of obstructions using image data from cameras or depth sensors. When an obstruction is detected blocking access to interface objects, the system automatically moves these elements to unobstructed areas of the display, maintaining both visibility and accessibility without requiring manual user adjustment
Solution Approach 2:
The system continuously monitors the physical environment through sensors and cameras to detect obstructions between the user and the display. This feedback loop enables the interface to automatically adjust object positions in response to detected obstructions, ensuring that interactive elements remain both visible and accessible despite changes in the physical environment
Data Source
AI summary
Embodiments of the present invention analyze a context in which a user interacts with a computer interface and automatically optimizes the interface for the context. The controller or control mode the user selects for interaction may define the context, in part. Examples of control modes include gesturing, audio control, use of companion devices, and use of dedicated control devices, such as game controllers and remote controls. The different input devices are designed for different tasks. Nevertheless, a user will frequently attempt to perform a task using a control input that is not adapted for the task. Embodiments of the present invention change the characteristics of the user interface to make it easier for the user to complete an intended task using the input device of the user's choice.