Multi-touch-movement Gesture Recognition for Tablet Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Developers face challenges in creating distinct and user-friendly gestures for tablet computing devices, as the design space of available gestures is limited, making it difficult to formulate gestures that are both unique and easily rememberable for end users.
Innovation Solution
The implementation of multi-touch-movement (MTM) gestures, which involve grasping the device with two hands and performing specific movements or static postures, such as tilting, flipping, or pivoting, to invoke various behaviors or control operations, allowing for a broader range of user interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If developers create idiosyncratic and complex gestures to distinguish from existing gestures, then gesture distinctiveness is improved, but user ease of operation deteriorates
Solution Approach 1:
The patent introduces device movement as a new dimension to gesture recognition. Instead of only analyzing finger movements on the touchscreen surface, the system now considers the spatial trajectory and orientation changes of the entire device in 3D space. This additional dimensional information allows for creation of distinct gestures without increasing finger movement complexity, resolving the contradiction between gesture distinctiveness and ease of operation.
Solution Approach 2:
The patent makes the device itself participate in the gesture interaction by using its movement capabilities. The device's motion sensors and inertial measurement units are leveraged to detect gestures, transforming the device from a passive input receiver to an active gesture participant. This multi-functional approach enables simple finger movements combined with device motion to create unique, easily memorable gestures.
2Adaptability or versatility
If developers expand the number of recognized gestures to provide a robust user interface, then interface functionality is improved, but gesture design complexity increases
Solution Approach 1:
By adding device movement trajectory and orientation as new dimensions to gesture space, the patent exponentially expands the number of possible distinct gestures without requiring more complex finger movements. For example, a simple circular finger motion can be differentiated into multiple gestures based on the device's movement path and orientation during the gesture, enabling robust interface functionality while maintaining simple gesture designs.
3Ease of operation
If developers create simple and memorable gestures, then ease of operation is improved, but gesture distinctiveness deteriorates
Solution Approach 1:
The patent resolves this contradiction by encoding gesture identity not in the complexity of finger movements but in the device's spatial trajectory and orientation changes. Simple finger gestures like tapping or swiping remain easy to perform, while the device's movement patterns (acceleration, rotation, trajectory) provide the distinguishing characteristics that enable gesture distinctiveness.
Data Source
AI summary
Functionality is described herein for detecting and responding to gestures performed by a user using a computing device, such as, but not limited to, a tablet computing device. In one implementation, the functionality operates by receiving touch input information in response to the user touching the computing device, and movement input information in response to the user moving the computing device. The functionality then determines whether the input information indicates that a user has performed or is performing a multi-touch-movement (MTM) gesture. The functionality can then perform any behavior in response to determining that the user has performed an MTM gesture, such as by modifying a view or invoking a function, etc.