Touch Interface Gesture Recognition for Multi-Object Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for manipulating user interface objects on touch-sensitive surfaces are cumbersome and inefficient, particularly when using multiple simultaneous inputs, leading to a significant cognitive burden and energy wastage, especially in battery-operated devices.
Innovation Solution
A computing device with a touch screen display that simultaneously displays multiple user interface objects and a destination object, allowing for detection of multiple user inputs to perform actions associated with the destination object, such as moving or resizing objects with gestures, thereby enhancing efficiency and reducing cognitive load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional mouse-based sequential inputs are used to manipulate user interface objects, then the manipulation can be performed with simple interface design, but the operation becomes tedious and creates significant cognitive burden on the user
Solution Approach 1:
The patent combines multiple input actions into a single simultaneous gesture. For example, selecting and moving an object is achieved by touching the object and dragging it in one continuous motion, rather than requiring separate select and move commands. This merging of actions directly reduces cognitive burden by eliminating the need to remember and execute multiple sequential steps.
Solution Approach 2:
The patent introduces multi-dimensional input capabilities by utilizing simultaneous contact points across the touch surface. Instead of linear sequential inputs, the system interprets spatial relationships between multiple fingers touching different objects or areas at the same time, adding a spatial dimension to the interaction model that enables more intuitive manipulation.
2Productivity
If existing methods use simultaneous inputs to perform manipulations, then operation speed may improve, but the methods become cumbersome and inefficient
Solution Approach 1:
The patent implements dynamic gesture recognition that adapts to the user's intent based on the configuration of contact points. The system dynamically determines whether simultaneous contacts represent selection, movement, resizing, or other operations based on real-time analysis of finger positions, contact pressure, and motion trajectories, making simultaneous inputs intuitive rather than cumbersome.
Solution Approach 2:
The system automatically interprets the user's intent from the gesture configuration itself without requiring explicit commands. For example, when two fingers touch different objects simultaneously, the system self-determines that the user intends to select both objects for a subsequent operation, eliminating the need for the user to manually initiate each action step.
3Loss of time
If conventional methods are used for manipulating user interface objects, then the interface design remains simple, but the manipulation process takes longer than necessary and wastes energy
Solution Approach 1:
The patent performs preliminary selection and preparation actions automatically as part of the gesture recognition process. When the system detects a gesture pattern indicating intended manipulation, it pre-preps the objects and operations before the user completes the gesture, reducing the overall time required for the manipulation task and allowing the device to enter low-power states more quickly.
Data Source
AI summary
A computing device with a touch screen display simultaneously displays on the touch screen display a plurality of user interface objects and at least one destination object. The computing device detects a first input by a user on a destination object displayed on the touch screen display. While continuing to detect the first input by the user on the destination object, the computing device detects a second input by the user on a first user interface object displayed on the touch screen display. In response to detecting the second input by the user on the first user interface object, the computing device performs an action on the first user interface object. The action is associated with the destination object.