Multi-Contact Gesture Recognition for Graphical Object Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Interactive input systems face challenges in accurately determining the intended image processing operations during user pointer interaction with graphical objects, leading to ambiguous interpretations and limited communication of user intent.
Innovation Solution
A method and system that receive input events from an interactive surface, determine the number of contacts, track their movement, and identify graphical object manipulations based on the number of contacts and object type, allowing for specific actions such as moving, resizing, copying, and deleting graphical objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If pointer-based inputs are used for manipulating graphical objects, then the system provides intuitive visual interaction, but the interpretation of user intent becomes ambiguous
Solution Approach 1:
The system changes the parameters of pointer input by detecting multiple contact points (fingers) simultaneously and using their relative positions, distances, and movement patterns to differentiate between various manipulation intents. This transforms ambiguous single-pointer input into distinguishable multi-parameter gestures that clearly indicate user intent.
Solution Approach 2:
The system segments the pointer input into multiple contact points, each with its own position and movement characteristics. By analyzing the relationship between these segmented contact points (distance, relative movement, contact timing), the system can distinguish between different manipulation operations such as moving, resizing, or rotating graphical objects.
2Measurement precision
If multiple contact points are detected to determine user intent, then the accuracy of manipulation identification improves, but the system complexity increases
Solution Approach 1:
The system creates a simplified representation of the multi-contact gesture by calculating key parameters such as distance between contacts, relative movement vectors, and contact patterns. These copied/derived parameters serve as features for classification, reducing the complexity of analyzing raw multi-contact data while maintaining high accuracy in identifying manipulation intent.
3Adaptability or versatility
If the system supports multiple manipulation operations for different object types, then the versatility of the input system improves, but the difficulty of determining intended operation increases
Solution Approach 1:
The system applies different analysis rules and parameter weightings based on the local context of each graphical object type. For example, different manipulation operations may be more likely or appropriate for different object types (images, text, shapes), and the system adjusts its interpretation accordingly. This localized adaptation reduces ambiguity without requiring a complete reanalysis for each object type.
Data Source
AI summary
A method comprises receiving an input event generated when at least one contact is made on an interactive surface at a location corresponding to a graphical object; determining the number of contacts associated with the input event; tracking movement of the at least one contact on the interactive surface; identifying a graphical object manipulation based on the number of contacts, the movement of the at least one contact, and the graphical object type; and performing the graphical object manipulation.