Bimodal Gesture Recognition for Menu Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques for accessing functions on computing devices become inefficient as the number of available functions increases, leading to user frustration and decreased utilization due to complex menu navigation.

Innovation Solution

The implementation of gesture techniques that utilize bimodal inputs, such as touch and stylus inputs, to recognize and execute various gestures like copy, staple, cut, punch-out, rip, edge, stamp, brush, carbon-copy, fill, cross-reference, and link gestures, allowing for intuitive and efficient operation of computing devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional menu navigation techniques are used to access device functions, then the device can provide a wide range of functions, but the complexity of navigation increases and user frustration increases

Engineering Contradiction:
Improveamount of functionsVSAvoidmenu navigation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical menu navigation (clicking through hierarchical menus) with gesture-based input recognition. The system detects gestures from input devices and directly maps them to functions, eliminating the need for complex menu traversal while maintaining access to diverse device functions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a gesture recognition system as an intermediary layer between the user and device functions. This intermediary interprets physical gestures and translates them into corresponding device operations, providing a more intuitive path to functions without requiring users to navigate complex menu structures.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If traditional menu navigation techniques are used to access device functions, then the device can provide a wide range of functions, but user utilization decreases due to frustration

Engineering Contradiction:
Improveamount of functionsVSAvoiduser utilization
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces cumbersome menu navigation with natural gesture-based input. Users can directly access functions through intuitive gestures recognized by the system, significantly improving ease of operation and user utilization while maintaining access to a wide range of device functions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The gesture recognition system automatically interprets user intentions from physical gestures and executes corresponding functions without requiring users to manually navigate through menus. This self-service approach reduces friction and improves user engagement with device functions.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If gesture recognition techniques are implemented to improve user interaction, then ease of operation increases, but device complexity increases

Engineering Contradiction:
Improveuser interaction simplicityVSAvoidgesture recognition system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a universal gesture recognition system that handles multiple gesture types and input devices through a single integrated framework. This multi-functional approach manages the inherent complexity by providing a unified interface that can recognize and respond to various gestures without requiring separate processing paths for each gesture type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10282086B2Brush, carbon-copy, and fill gestures
Publication Date: 2019.05.07 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10282086B2 patent drawing
  • US10282086B2 patent drawing
  • US10282086B2 patent drawing

AI summary

Techniques involving gestures and other functionality are described. In one or more implementations, the techniques describe gestures that are usable to provide inputs to a computing device. A variety of different gestures are contemplated, including bimodal gestures (e.g., using more than one type of input) and single modal gestures. Additionally, the gesture techniques may be configured to leverage these different input types to increase the amount of gestures that are made available to initiate operations of a computing device.