Touchscreen Object Summoning via Gesture Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing touch screen interfaces, especially large displays, require users to physically navigate to interact with user interface objects, which can be inconvenient and inefficient, as they often involve moving to find and access objects hidden or overlaid by others.
Innovation Solution
Implementing a system where user interface objects are automatically summoned to the user's gesture position, allowing static or dynamic gestures to recognize and move objects to the user's input location, enabling various transition methods such as disappearance, movement, animation, scaling, or reorientation, and supporting multiple object summoning configurations like cascading, scaling, or stacking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users physically navigate to user interface objects on large touch screen displays, then users can interact with the objects, but users must walk or move to different positions which is inconvenient and inefficient
Solution Approach 1:
Instead of requiring the user to navigate to the object, the system inverts the approach by automatically summoning the object to the user's current position. The object detection module detects objects near the cursor position, and the object summoning module brings these objects to the user, reversing the traditional navigation paradigm and eliminating the need for physical movement across large displays.
Solution Approach 2:
The system implements self-service by automatically detecting and summoning user interface objects without requiring user initiation or manual navigation. The object detection module continuously monitors the display area around the cursor, and when objects are detected, the summoning module automatically brings them to the user's position, making the system serve the user proactively rather than requiring the user to search for and access objects.
2Productivity
If users manually search for user interface objects hidden or overlaid by others, then users can locate the objects, but the process involves excessive user manipulation and is inefficient
Solution Approach 1:
The system performs preliminary action by proactively detecting user interface objects in the vicinity of the cursor position before the user needs to access them. The object detection module continuously scans the display area, identifying objects that are hidden or overlaid, and prepares to summon them automatically, eliminating the need for users to manually search through layers of overlapping interfaces.
Solution Approach 2:
The system introduces an intermediary mechanism between the user and the hidden objects. The object detection module acts as an intermediary that detects objects on behalf of the user, and the object summoning module serves as another intermediary that brings these detected objects to the user's position, simplifying the interaction by removing the need for users to directly manipulate or search through overlapping interface elements.
3Ease of operation
If user interface objects are automatically summoned to the user's gesture position, then user convenience is enhanced and interaction is simplified, but the system requires advanced gesture recognition and object management capabilities
Solution Approach 1:
The system implements dynamics by enabling flexible and adaptive object summoning based on user gestures. The gesture recognition module detects various user gestures, and the object summoning module dynamically responds by bringing objects to the user's position according to the detected gesture, allowing the system to adapt to different user interactions while maintaining simplicity.
Solution Approach 2:
The system applies segmentation by dividing the complex task of object summoning into distinct functional modules: a gesture recognition module that handles user input, an object detection module that identifies target objects, and an object summoning module that executes the summoning action. This modular segmentation manages system complexity by organizing functions into separate, manageable components that work together seamlessly.
Data Source
AI summary
Provided is a system and method for summoning user interface object(s) of a display to a gesture position of a user. In a pressure sensitive display embodiment, a user maintains a convenient touch position to the display, performs a summon gesture, and user interface object(s) are automatically moved to the user's touch position as requested. When a summon gesture is recognized, a user interface object, or point or interest thereof, automatically transitions to a desired position where the gesture was recognized. Objects can transition in a variety of manners. Also, a magnetic mode can be activated for virtually magnetizing objects of interest to a user's position, for example as the user touches various places on the display. A user's configurations can be stored into a cloud system for convenient access and use at a plurality of different data processing system user interfaces.