Self-revealing gesture input for command access speed

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional marking menus in software development are limited to single vectors for accessing and executing system commands, leading to cumbersome and slow access, which reduces developer productivity.

Innovation Solution

A method involving an initial user activation event and a direction-specific symbolic swipe gesture, where a first path is recorded, and upon pausing, possible symbolic gestures are displayed, allowing selection and execution of system commands, enhancing accessibility and execution efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If traditional marking menus use single vectors to access system commands, then the system structure remains simple, but access speed and execution efficiency are slow

Engineering Contradiction:
Improveaccess speedVSAvoidgesture complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent introduces multi-dimensional gesture input by combining initial activation events with direction-specific symbolic swipe gestures. Instead of single-vector commands, the system uses curved paths with multiple segments (first portion, second portion) that encode different commands, effectively adding spatial dimensions to the input method and enabling faster access to multiple system commands.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The gesture recognition system divides commands into segmented paths (first portion, second portion) that can be independently recorded and recognized. Each segment corresponds to specific directional movements that map to different system commands, allowing the system to process complex gestures as sequences of simpler segments for faster recognition.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If multiple system commands are accessed through single vectors, then command availability is limited, but input method remains simple

Engineering Contradiction:
Improvecommand accessibilityVSAvoidgesture recognition system
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system expands command accessibility by utilizing multi-dimensional gesture space with curved paths and multiple segments. Different directions, curves, and sequences of swipes map to different system commands, dramatically increasing the number of accessible commands while maintaining intuitive gesture-based input rather than complex keyboard shortcuts or menu navigation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The gesture recognition system is designed to handle multiple types of input devices (touchscreen, stylus, pointing device) and multiple gesture formats (curved paths, directional swipes, segmented movements) through a unified recognition framework, making the system universally applicable across different input methods while providing access to diverse system commands.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If traditional menus are used for command execution, then system structure remains simple, but developer productivity decreases

Engineering Contradiction:
Improvedeveloper productivityVSAvoidtime for command access
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system pre-records multiple gesture paths (first portion, second portion) and their corresponding system commands in advance. During execution, the system recognizes the gesture pattern and directly triggers the pre-mapped command, eliminating the need for users to navigate through menus or remember complex command sequences, thus significantly reducing command access time and improving developer productivity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3014426B1Self-revealing symbolic gestures
Publication Date: 2019.04.24 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3014426B1 patent drawingFigure 1
  • EP3014426B1 patent drawingFigure 2
  • EP3014426B1 patent drawingFigure 3A

AI summary

A computing device implemented method includes recording, in response to an initial user activation event, a first path of a first portion of a direction-specific symbolic swipe gesture. In response to a pause in the direction-specific symbolic swipe gesture, a selected number of possible symbolic gestures are displayed based on the recorded first path that reveal system commands that map to the symbolic gestures. A second path of a second portion of the direction-specific symbolic swipe gesture is recorded. In response to the recorded first and second paths of the direction-specific symbolic swipe gesture and a trigger, a first system command is accessed that maps to the first direction-specific gesture.