Inline Handwriting Recognition and Correction Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Handwriting recognition in pen-based computing systems is error-prone for users with poor handwriting, those who write at an angle, or those who write quickly, requiring manual correction of machine-generated text.

Innovation Solution

Implementing inline handwriting recognition and correction features that allow users to write with an electronic pen, convert digital ink to text in real-time, and provide a correction interface for editing individual characters, with triggers for conversion and adjustment of text display to accommodate editing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If handwriting recognition is used to convert digital ink to text, then text input efficiency is improved, but recognition accuracy deteriorates for users with poor handwriting

Engineering Contradiction:
Improvetext input efficiencyVSAvoidrecognition accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the text input process into two distinct modes: ink mode for initial handwriting input and text mode for corrected text editing. This segmentation allows users to leverage the speed of handwriting while having the option to correct recognition errors, thus resolving the contradiction between input efficiency and recognition accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically switches between ink mode and text mode based on user interaction. When a user selects a recognized word, the system transitions to text mode allowing character-by-character editing. This dynamic adaptation enables the system to maintain high input efficiency for clear handwriting while providing accuracy correction capabilities when needed.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If real-time conversion of digital ink to text is implemented, then user effort is reduced, but complexity of the system increases

Engineering Contradiction:
Improveuser effortVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs automatic recognition and conversion of digital ink to text without requiring manual intervention. The recognizer continuously processes ink input and automatically updates the text display, reducing user effort while managing complexity through automated background processing.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system integrates multiple functions into a unified interface: ink capture, real-time recognition, text conversion, and error correction all occur within the same application environment. This multi-functionality reduces the need for separate tools and minimizes overall system complexity despite the advanced capabilities provided.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If correction interface is provided for editing individual characters, then text accuracy is improved, but time required for correction increases

Engineering Contradiction:
Improvetext accuracyVSAvoidcorrection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system allows users to correct only the specific portions of text that contain errors rather than requiring complete review and correction of the entire text. Users can selectively edit individual characters or words that need correction, minimizing the time investment required while maintaining high text accuracy.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system performs preliminary recognition and conversion of ink to text before the user needs to review it. By the time the user views the text, the recognition process is already complete, allowing corrections to be made quickly without waiting for processing delays.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9507435B2Inline handwriting recognition and correction
Publication Date: 2016.11.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9507435B2 patent drawing
  • US9507435B2 patent drawing
  • US9507435B2 patent drawing

AI summary

As a user writes using a handheld writing device, such as an electronic pen or stylus, handwriting input is received and initially displayed as digital ink. The display of the digital ink is converted to recognized text inline with additional digital ink as the user continues to write. A user may edit a word of recognized text inline with other text by selecting the word. An enlarged version of the word is displayed in a character correction user interface that allows a user to make corrections on an individual character basis and also provides other correction options for the word.