Multi-stroke Smart Ink Gesture Language for Stylus Action Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital ink user interfaces require users to switch input modes or use non-pen methods for actions and navigation, disrupting the natural flow of using a stylus or active pen for creating content.

Innovation Solution

A multi-stroke smart ink gesture language that allows users to perform actions and input content using natural digital ink strokes, where a digital ink stroke can be determined as an action input based on proximity or chronological immediacy to a prior-received stroke, enabling actions to be performed without mode-switching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users switch input modes or use non-pen methods for actions and navigation, then actions can be performed, but the natural flow of using stylus for content creation is disrupted

Engineering Contradiction:
Improvenatural flow of content creationVSAvoidability to perform actions
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The digital ink stroke recognition system enables the stylus to serve multiple functions: it can create content (handwriting, sketches, diagrams) and perform actions (navigation, selection, commands) without requiring mode switching. The system universally interprets ink strokes for both content creation and action execution, allowing one tool to do everything.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the content creation function and action input function into a single unified interface. Instead of separating pen input for content and touch/mouse input for actions, the system combines both functions into the digital ink stroke recognition mechanism, eliminating the need for users to switch between different input modes.

Inventive Principle:
Principle #5Merging (Combining)

2Ease of operation

If digital ink user interface requires mode switching for actions, then distinct input methods are available, but usability is reduced and creative mode is interrupted

Engineering Contradiction:
ImproveusabilityVSAvoidinput mode management
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the action input capability from separate input modes (touch, mouse, keyboard) and integrates it directly into the digital ink stroke recognition system. By taking out the need for mode switching and embedding action recognition within the ink interface itself, the system simplifies the user experience while maintaining full functionality.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If multiple input methods are used for content and actions, then functional versatility is achieved, but user flow and productivity are reduced

Engineering Contradiction:
Improvecontent creation efficiencyVSAvoidinput method options
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system provides functional versatility through a single universal input method. The digital ink interface can recognize both content creation strokes and action commands, eliminating the need for multiple input methods while maintaining the ability to perform diverse functions. This universal approach actually improves productivity by keeping users in a consistent creative mode throughout.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3610361B1Multi-stroke smart ink gesture language
Publication Date: 2024.02.14 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3610361B1 patent drawingFigure 1
  • EP3610361B1 patent drawingFigure 2
  • EP3610361B1 patent drawingFigure 3

AI summary

This document describes techniques for, and systems that enable, a multi-stroke smart ink gesture language. The described techniques enable a digital ink user interface that allows a display, that is capable of receiving a digital ink stroke from a passive stylus or an active pen, to receive the digital ink stroke as either a content input or an action input. The digital ink stroke may be determined to be an action input based on proximity to, intersection with, or chronological immediacy to a prior-received digital ink stroke. When multiple digital ink strokes are determined to represent a multi-stroke gesture associated with an action input, the action input is provided to the application, which can then perform the action associated with the action input. The multi-stroke gesture allows users to input both content and actions using the passive stylus or active pen and natural digital inking strokes.