Adaptive UI Layouts for Touchscreen and Mouse Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing user interface designs for computing devices face challenges in accommodating varying input modalities, such as mouse-based and touchscreen-based inputs, leading to inefficient user interactions and unnecessary data processing due to mismatched click target sizes.
Innovation Solution
A user interface model is employed to optimize UI elements based on the current input modality, determining layout features and importance scores to adjust click target sizes and arrangements, using machine-learned models to analyze usage data and user interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a fixed user interface design is used for all input modalities, then device complexity is reduced, but user interaction efficiency deteriorates due to mismatched click target sizes
Solution Approach 1:
The user interface dynamically adjusts click target sizes based on the detected input modality. The system transitions from a static, fixed interface design to a dynamic one that automatically reconfigures UI element dimensions according to whether touchscreen, mouse, or keyboard input is being used, thereby optimizing usability for each input type without requiring multiple separate interface designs
Solution Approach 2:
The interface modifies specific parameters (click target sizes) based on the input modality. By changing the size parameter of UI elements according to the detected input device, the system achieves optimal interaction efficiency for each input type while maintaining the same underlying interface structure, thus avoiding the complexity of entirely separate interface designs
2Ease of operation
If click target sizes are increased for touchscreen input, then ease of operation improves, but data processing efficiency deteriorates due to unnecessary processing of large click targets
Solution Approach 1:
The system applies different click target size qualities to different input modalities locally. Instead of uniformly increasing all click target sizes, the interface selectively adjusts sizes only when touchscreen input is detected, maintaining appropriate smaller sizes for mouse/keyboard modes, thus optimizing for each input type without unnecessary processing overhead
3Adaptability or versatility
If separate user interface designs are created for different input modalities, then adaptability improves, but device complexity increases
Solution Approach 1:
A single user interface design serves multiple input modalities through automatic detection and adaptation. The system implements one universal interface that can handle touchscreen, mouse, and keyboard inputs by dynamically adjusting parameters, eliminating the need to manage multiple separate interface designs and their associated complexity
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Aspects of the subject technology relate to dynamically adjusting a UI based on the current modality. Layout features of a UI may be determined based on an input modality of a computing device. The arrangement of the UI elements may be determined based on the layout features and respective importance scores of the UI elements. The UI elements arranged based on the arrangement may be provided for display of the computing device.