Gesture-Based Object Selection Interface for Mobile Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Resource-constrained mobile devices with touch-sensitive screens face challenges in accurately selecting objects due to limited screen space, overlapping items, and the difficulty of using thumbs or fingers to distinguish between closely positioned elements without causing accidental selections.
Innovation Solution
A system that suggests a gesture to users by displaying graphic elements, receives and interprets gestures via input mechanisms, and determines the associated command or object by calculating a generalized distance metric based on the gesture's location and direction, providing visual feedback and learning from user habits to reduce errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a shift and magnification window is used to facilitate object selection, then selection accuracy is improved, but operation time increases and other objects may be obscured
Solution Approach 1:
The system displays multiple selectable objects in advance on the screen before the user makes a selection. This allows users to see all available options simultaneously without needing to wait for a shift window to appear, enabling faster multi-object selection while maintaining accuracy
Solution Approach 2:
The system transitions from a 2D flat display to a 3D spatial arrangement where objects are positioned at different depths and locations. This dimensional enhancement allows users to distinguish and select multiple objects more efficiently by providing spatial context and visual hierarchy
2Measurement precision
If a shift and magnification window is used to facilitate object selection, then selection accuracy is improved, but the interface complexity increases
Solution Approach 1:
The user interface is segmented into distinct functional zones: a main display area showing multiple objects, a toolbar with selection tools, and a status area. This segmentation allows each component to perform its function independently without requiring complex interactions, simplifying the overall interface while maintaining selection accuracy
Solution Approach 2:
The system automatically manages the display of selectable objects and their spatial relationships without requiring users to manually adjust or navigate complex menus. The interface self-organizes to present relevant objects based on user context, reducing the perceived complexity while maintaining precise selection capability
Data Source
Figure 1
Figure 2(A)~2(F)
Figure 3(A)~3(E)
AI summary
One embodiment of the present invention provides a system that facilitates invoking a command. During operation, the system suggests (802) with a graphic element a gesture to use to invoke a command. The system then receives (804) the gesture from a user at a device. Note that the gesture is received via an input mechanism, and also note that the gesture is a predetermined manipulation of the input mechanism. The system then determines (806) a graphic element within the user interface that is associated with the gesture. Finally, upon determining (810) the object associated with the gesture, the system invokes the command associated with the graphic element.