Two-Handed Multi-Stroke Marking Menus for 3D Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current user interfaces for animation and complex tasks, such as keyboards and mice, are non-intuitive and inefficient for navigating and selecting objects in three-dimensional environments, with graphical user interfaces often cluttering the display and requiring users to manually adjust numeric values for object placement.

Innovation Solution

The implementation of two-handed multi-stroke marking menus on multitouch devices, allowing users to draw simultaneous or alternating strokes with each hand to traverse menu hierarchies, with the system detecting hand positions and timing to provide intuitive and efficient selection of menu items and functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional keyboards and mice are used for navigation and object selection in three-dimensional environments, then basic input functions are provided, but the interface becomes non-intuitive and inefficient, requiring manual adjustment of numeric values and multiple steps for simple tasks

Engineering Contradiction:
Improveintuitiveness of interfaceVSAvoidefficiency of navigation and selection
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces traditional mechanical input devices (keyboards, mice) with a multi-touch sensing surface that directly detects finger contacts and gestures. This substitution enables intuitive spatial interaction where users can directly manipulate virtual objects by touching and gesturing on the display surface, eliminating the need for numeric value adjustment and multiple menu navigation steps.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If graphical user interfaces with icons, menus, and toolbars are implemented, then comprehensive functionality is provided, but the display becomes cluttered and the actual workspace for three-dimensional environment is reduced

Engineering Contradiction:
Improvefunctionality of interfaceVSAvoidworkspace area on display
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent extracts menu functions from traditional graphical interfaces and embeds them directly into the spatial context of the three-dimensional workspace. Context-sensitive menus appear near the user's finger contacts or near relevant objects, providing comprehensive functionality without occupying fixed display real estate. This extraction allows the workspace to remain uncluttered while maintaining full access to interface functions.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions from two-dimensional menu interfaces to three-dimensional spatial interaction. Users navigate and select objects by directly touching and gesturing in the three-dimensional space of the display, with menu options appearing in contextual locations rather than fixed two-dimensional positions. This dimensional transition maximizes the usable workspace area while providing comprehensive functionality.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If multi-touch devices support bimanual interactions, then interaction efficiency is increased through parallel hand motions, but the kinematics of the hand constrain the range of motions different fingers can make

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidrange of finger motions
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent segments the user interface into multiple independent contact zones that can be simultaneously activated by different fingers. Each finger contact can trigger independent functions or menu systems, allowing users to perform multiple operations in parallel without being constrained by the mechanical limitations of individual finger ranges. The system detects and responds to each contact point independently, enabling versatile bimanual interaction.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10180714B1Two-handed multi-stroke marking menus for multi-touch devices
Publication Date: 2019.01.15 PIXAR CORP
  • US10180714B1 patent drawing
  • US10180714B1 patent drawing
  • US10180714B1 patent drawing

AI summary

A user interface provides for multi-stroke marking menus and other uses, for use on multitouch devices. One variant of multi-stroke marking is where users draw strokes with either both hands simultaneously or alternating between the hands. Alternating strokes between hands doubles the number of accessible menu items for the same number of strokes. Other inputs can be used as well, such as timing, placement, and direction.