Graphical Object Manipulation via Multi-Touch Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Creating intuitive and user-friendly graphical user interfaces (GUIs) for 2D and 3D digital modeling that accommodate various hardware capabilities and user skill levels, particularly in manipulating graphical objects with multiple degrees of freedom, is challenging due to the complexity of translating 2D user inputs into 3D object movements and ensuring consistency across devices.

Innovation Solution

The system uses a processor to determine alternative target orientations of graphical objects based on user input and physical models, applying supplemental display characteristics gradually to facilitate intuitive manipulation, allowing users to easily position, rotate, and scale objects using single or multi-point control inputs, thereby reducing interaction time and user frustration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If separate controls are provided for each degree of movement (scaling, rotating, translating) in traditional interfaces, then precise control is achieved, but the interface complexity and number of controls increase significantly

Engineering Contradiction:
Improveease of object manipulationVSAvoidnumber of controls
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent combines multiple control functions (translation, rotation, scaling) into a unified multi-touch gesture system. Users can manipulate graphical objects using combinations of touch points where the relative positions and movements of multiple fingers simultaneously control different degrees of freedom, eliminating the need for separate controls for each transformation operation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The multi-touch gesture system serves multiple functions through a single interface mechanism. The same touch interface that enables object selection also enables translation, rotation, and scaling operations, making the control system universal rather than requiring specialized controls for each manipulation type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multi-touch gestures are used to manipulate graphical objects with multiple degrees of freedom, then the number of controls is reduced, but the system must accommodate varying user skill levels and hardware capabilities

Engineering Contradiction:
Improveadaptability to user skill levelsVSAvoidgesture recognition system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system dynamically adapts its behavior based on detected user gestures and skill level. It provides haptic feedback and visual guidance that adjust in real-time according to the user's manipulation style, making the system responsive and adaptive rather than static and rigid.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates haptic feedback mechanisms that provide tactile guidance to users during object manipulation. The feedback loop detects user gestures and provides appropriate haptic responses to assist users in performing complex multi-degree-of-freedom transformations, making the system more accessible to users of varying skill levels.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If the system provides haptic feedback and visual guidance to assist users, then ease of operation improves, but processing requirements and system resources increase

Engineering Contradiction:
Improveuser guidanceVSAvoidprocessing resources
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system provides guidance and feedback selectively rather than continuously. Haptic feedback and visual guidance are activated only when needed based on detected user gestures and skill level assessments, avoiding unnecessary processing and resource consumption while still providing assistance when beneficial.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10089965B1User-controlled movement of graphical objects
Publication Date: 2018.10.02 SAGA INNOVATIONS INC
  • US10089965B1 patent drawing
  • US10089965B1 patent drawing
  • US10089965B1 patent drawing

AI summary

Disclosed are methods and systems for moving and manipulating graphical objects on a device that may include one or more pointing device, such as a mouse, a touchpad, or a touch screen, some of which may be multi-touch enabled. In some embodiments, a method may include, concurrent with and in response to user input from a pointing device: moving a first graphical object, determining a plurality of alternative target orientations for that first graphical object, selecting one of the target orientations, and gradually changing certain display characteristics of the first object based on characteristics of the selected target orientation.