Multi-Touch 3D Object Manipulation via Virtual Axes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face difficulties in intuitively positioning and orienting three-dimensional objects on graphical user interfaces, especially with multi-touch displays, as users find it challenging to control three-dimensional objects with six degrees of freedom using conventional methods like mice or trackballs, and existing hardware solutions like virtual reality gloves are expensive.

Innovation Solution

A multi-touch display system that allows users to manipulate three-dimensional objects by establishing axes of rotation using multiple touch points, enabling translation, rotation, scaling, and changing view depth through intuitive gestures on a touch-sensitive surface, using components like axis establishers, rotators, and scaler components to interpret user inputs and control the object's appearance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If special hardware interfaces like virtual reality gloves or six degree of freedom input devices are used, then the ability to manipulate three-dimensional objects is improved, but the cost becomes expensive

Engineering Contradiction:
Improveability to manipulate three-dimensional objectsVSAvoidcost
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The patent creates a virtual copy of physical manipulation on a two-dimensional touch screen surface. Multi-touch gestures (two or more fingers) simulate the function of expensive hardware interfaces by establishing virtual axes of rotation and translation on the screen, allowing three-dimensional object manipulation through software-based touch gestures rather than physical hardware devices.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces mechanical hardware systems (virtual reality gloves, spaceballs) with a software-based touch interface system. The mechanical manipulation functions are substituted by detecting and processing multi-touch gestures on a flat screen surface, where finger positions and movements map to three-dimensional object transformation parameters.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of manufacture

If software-based methods using ordinary mice, trackballs, and keyboards are used, then the cost is cheap, but the ability to control three-dimensional objects is inadequate and non-intuitive

Engineering Contradiction:
ImprovecostVSAvoidability to control three-dimensional objects
Core Design Contradiction:
Ease of manufactureVSEase of operation

Solution Approach 1:

The patent maps two-dimensional touch screen gestures to three-dimensional object manipulation by introducing virtual axes of rotation and translation. Multiple touch points on the 2D screen surface establish spatial relationships that correspond to 3D object orientation and position, effectively adding a dimensional mapping layer between the flat screen and three-dimensional object space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent divides the three-dimensional manipulation task into separate controllable components: two fingers establish axes of rotation while a third finger controls translation or rotation about those axes. This segmentation of control functions across multiple independent touch points makes complex 3D manipulation more intuitive and manageable than single-point input devices.

Inventive Principle:
Principle #1Segmentation

3Device complexity

If conventional single-touch methods are used, then the device complexity is low, but the ability to position and orient three-dimensional objects with six degrees of freedom is insufficient

Engineering Contradiction:
Improvedevice complexityVSAvoidability to position and orient three-dimensional objects
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent makes the touch screen interface universal by enabling it to handle multiple functions simultaneously: two fingers can establish rotation axes while a third finger performs translation or rotation about those axes. The same touch screen hardware supports both two-dimensional interface operations and full six-degree-of-freedom three-dimensional object manipulation without requiring additional specialized hardware.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent creates a dynamic mapping system where the interpretation of touch gestures adapts based on the number and configuration of touch points. The system dynamically adjusts which fingers control which degrees of freedom based on their spatial arrangement on the screen, allowing flexible adaptation to different manipulation tasks while maintaining a consistent interface model.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10198854B2Manipulation of 3-dimensional graphical objects for view in a multi-touch display
Publication Date: 2019.02.05 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10198854B2 patent drawing
  • US10198854B2 patent drawing
  • US10198854B2 patent drawing

AI summary

A system described herein provides six degrees of freedom with respect to a three-dimensional object rendered on a multi-touch display through utilization of three touch points. Multiple axes of rotation are established based at least in part upon location of a first touch point and a second touch point on a multi-touch display. Movement of a third touch point controls appearance of rotation of the three-dimensional object about two axes, and rotational movement of the first touch point relative to the second touch point controls appearance of rotation of the three-dimensional object about a third axis.