Digital Pen Haptic Feedback for Scribble Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In digital pen-based computing environments, users face challenges with limited visual feedback due to occlusion by the pen or device, and distinguishing between important interface elements and scribble inputs, which affects interaction efficiency and accuracy.

Innovation Solution

The system provides haptic, visual, or audible feedback when interacting with points of interest and detects scribble inputs, allowing for contextual menu options and automatic erasure of scribbles, enhancing user interaction and feedback in digital pen-based computing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If visual feedback is provided on the display interface, then user confidence and interaction speed improve, but screen real estate is reduced due to occlusion by the digital pen device and hand

Engineering Contradiction:
Improveinteraction speedVSAvoidscreen real estate
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent transitions feedback from the two-dimensional display surface to the three-dimensional tactile domain by implementing haptic feedback through the digital pen device itself. This allows feedback to be delivered without occupying display real estate, resolving the contradiction between providing feedback and maintaining screen space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The digital pen device serves as an intermediary that delivers feedback to the user through haptic actuators. Instead of displaying feedback visually on the limited screen space, the pen acts as a mediator to convey interaction information through tactile sensations, thereby preserving screen real estate while maintaining feedback functionality.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the system provides comprehensive visual feedback, then user confidence improves, but the feedback may be occluded by the user's hand or digital pen device

Engineering Contradiction:
Improveuser confidenceVSAvoidocclusion
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent replaces the visual feedback mechanism (which is susceptible to occlusion by hand or pen) with a haptic feedback mechanism delivered through the digital pen device. This substitution eliminates the occlusion problem by delivering feedback through tactile sensations that are not blocked by the user's hand or the pen itself.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system implements haptic feedback through the digital pen device to provide reliable interaction information to the user. This feedback mechanism ensures that users receive consistent interaction confirmation without the reliability issues associated with visual feedback that can be occluded by hand or pen positioning.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the system distinguishes between interface elements and scribble inputs, then interaction accuracy improves, but system complexity increases due to scribble recognition algorithms

Engineering Contradiction:
Improveinteraction accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs scribble recognition algorithms that analyze parameters such as stroke density, duration, and spatial distribution to distinguish between intentional interface interactions and scribble inputs. By changing and monitoring multiple parameters of the input signal, the system achieves accurate differentiation without requiring overly complex system architecture.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The scribble recognition system operates autonomously to filter and interpret user inputs, automatically distinguishing between valid interface interactions and scribble noise. This self-service capability reduces the burden on the overall system complexity by handling discrimination tasks independently through embedded algorithms.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP3282350B1Feedback via an input device and scribble recognition
Publication Date: 2019.09.25 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3282350B1 patent drawingFigure 1
  • EP3282350B1 patent drawingFigure 2
  • EP3282350B1 patent drawingFigure 3

AI summary

Feedback via an input device associated with an interaction with a point of interest (POI) and scribble recognition is provided. When using an input device to navigate a GUI, various POIs may be determined as elements beneficial for a user to notice, pay attention to, or avoid. When an input is received that may be associated with a POI, feedback may be provided. Feedback may include haptic, visual, or audible feedback. Scribble recognition may also be provided. When using an input device (e.g., digital pen), a user may "scribble" in a margin to test pen attributes. Upon recognizing a scribble, alternative pen attributes may be presented in a contextual menu. In addition, the scribble may be automatically erased upon selection of a pen attribute or upon receiving input in another area of the UI or alternatively, feedback may be provided prior to erasure of the scribble input.