Multitouch Gesture Interface for Constrained 3D Object Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D modeling solutions are limited by 2D displays and single-point 2D input methods, making them difficult to use with touch devices due to the 'fat finger' problem and requiring cluttering widgets and keyboard shortcuts, which are not intuitive for multitouch inputs.

Innovation Solution

A multitouch interface that maps different gestures directly to 3D manipulation tasks, eliminating widgets and using a small set of gestures for axis or plane selection and transformation modes, allowing seamless manipulation of 3D objects without visual handles, enabling intuitive and context-aware control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional 3D manipulation interfaces use widgets and mode-switching buttons, then control precision is improved, but device complexity and ease of operation deteriorate due to screen clutter and fat finger problem

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent extracts and removes traditional widgets, buttons, and mode-switching elements from the interface. Instead of using visual handles and control widgets that clutter the screen, the system uses direct multitouch gestures on the 3D object itself to manipulate translation, rotation, and scaling, eliminating the need for separate control elements

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions from 2D widget-based control to 3D spatial gesture control. By using the third dimension (spatial position and orientation of fingers in 3D space) to define manipulation axes and planes, the system achieves precise control without requiring precise 2D widget selection, thus solving the fat finger problem

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If traditional interfaces use small control widgets, then manipulation precision is improved, but ease of operation worsens due to the fat finger problem on touch devices

Engineering Contradiction:
Improvemanipulation precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent uses 3D spatial gestures where the orientation and position of multiple fingers in 3D space define the manipulation axis and plane. This spatial dimension allows large, easy-to-hit gesture targets while maintaining precise control, as the system interprets the geometric relationship between fingers rather than requiring precise 2D widget selection

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent makes the 3D object itself the universal control interface. The same gesture performed on different parts of the object or with different finger orientations produces different manipulation effects (translation along different axes, rotation around different points, scaling in different directions), eliminating the need for multiple specialized widgets

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If traditional 3D modeling software uses keyboard shortcuts and mode-switching buttons, then control precision is improved, but productivity deteriorates due to tedious editing steps

Engineering Contradiction:
Improvecontrol precisionVSAvoidproductivity
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent enables continuous gesture-based manipulation without interruption for mode switching. Users can perform translation, rotation, and scaling operations in a continuous gesture sequence directly on the 3D object, eliminating the need to repeatedly press mode-switching buttons or remember keyboard shortcuts between different manipulation tasks

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent extracts and removes mode-switching buttons and keyboard shortcut requirements from the workflow. By mapping different gesture types (single-finger, two-finger, three-finger gestures) directly to different manipulation modes, the system eliminates the need for explicit mode switching while maintaining precise control over translation, rotation, and scaling operations

Inventive Principle:
Principle #2Taking out (Extraction)

4Measurement precision

If traditional interfaces use visual handles and widgets, then control precision is improved, but device complexity worsens due to screen clutter

Engineering Contradiction:
Improvecontrol precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes all visual handles, widgets, and overlay controls from the interface. The system relies entirely on direct multitouch gestures performed on the 3D object itself, eliminating the need for separate visual control elements and reducing screen clutter while maintaining manipulation precision through gesture geometry interpretation

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9542068B2System and method for constrained manipulations of 3D objects by multitouch inputs
Publication Date: 2017.01.10 THE HONG KONG UNIV OF SCI & TECH
  • US9542068B2 patent drawing
  • US9542068B2 patent drawing
  • US9542068B2 patent drawing

AI summary

Described herein are systems and methods that employ a widgetless and buttonless multi-touch interface for constrained manipulations of 3D objects. The widget-less multi-touch user interface can map different multi-touch gestures to different 3D object manipulation tasks, allowing a user to manipulate 3D objects without operating widgets or performing mode switchings or tool selections. User interaction is greatly simplified by using single touch actions that simultaneously specify the transformation constraint, the transformation type, and the magnitude of transformation and apply the transformation to the focus object. Additionally, the axis-based constrained manipulations support active snapping and axis transfer. Active snapping allows the user to draw a free touch path connecting two 3D objects to be snapped together, avoiding tedious operations required with standard transformation manipulations. Axis transfer provides a simple solution to achieve relative transformations between objects, allowing an object to be transformed along a specific predefined axis of another object.